Talk to anything
Point a phone at a mug, tap it, and talk to it.
01 / What it was
Our first interface that wasn't typing. You point your phone's camera at an everyday object, tap it, and it wakes up with a cartoon face, a personality, and a voice of its own. Then you talk back.
It was a hackathon build, deliberately playful. The question underneath was serious: does talking feel different when the thing you talk to has a face and a place in the room?
02 / How it worked
- Object detection runs on the phone, in the browser, so the face can stay pinned to the object as it moves.
- A vision model looks at the object once, writes its opening line and personality, and picks a voice.
- Follow-up conversation is fast and stays in character, and up to three objects can talk at once.
03 / What we saw
Talking out loud felt natural as soon as the thing we talked to had a face and a position in the room.
04 / Where it led
It pushed us toward giving an AI a body and a place, which became the holographic co-founder a month later.