School of Tomorrow's AI
School of Tomorrow's AI
Embodied AI interface prototype

Your hand is the remote.

This presentation uses your webcam and browser-based hand tracking to control slides with gestures. Camera processing runs locally in the browser. No video data leaves your device.

Move your left hand to the left to go back. Move your right hand to the right to advance. You can pause gesture controls at any time.

Gesture Remote

Camera
waiting
Controls
paused
Detected
none
Gesture
none
Action
none
Camera runs locally
controls paused
left hand ← previous
right hand → next
A enable
D pause
G HUD
Hub Meet / Embodied AI

Your Hand Is the Prompt

Designing Embodied AI Interfaces

● Camera runs locally · No data leaves your device
How to use this system

Gesture remote control

Enable gesturesClick Enable gestures or press A. The system will listen to gestures.
Pause gesturesClick Pause gestures or press D. Use this when speaking or moving casually.
Left hand ←Move your left hand to the left to go to the previous slide.
Right hand →Move your right hand to the right to go to the next slide.

The interface is simple on purpose: one hand, one direction, one intention.

Opening question

Tool × Machine

When we call AI a tool, we imagine control.

When we call it a machine, we imagine operation.

What if it is neither — but an environment?

Question for the chat Is AI a tool, a machine, an instrument, a collaborator, or an environment?
tool
machine
instrument
interface
environment
Interaction grammar

Input → Processing → Output

Every interactive system needs a grammar: what enters, what transforms, and what responds.

Input

Gesture, touch, sensor, voice, gaze, distance, image, pressure, rhythm.

→

Processing

Rules, mappings, code, machine learning, interpretation, thresholds.

→

Output

Light, sound, text, movement, visual feedback, robot action, spatial response.

Embodied AI

Two prototyping paths

Electronics + sensorsThe body touches circuits, materials, buttons, textiles, conductive paint, motors and microcontrollers.
Computer visionThe body becomes visible to the system through webcam, hands, face, pose, depth or spatial tracking.

In both paths, the body becomes part of the interface — not only the user of the interface.

Path 1 / Electronics

Touch, material, circuit

Media slot: Maze Circuit Replace with image/video. Use it as the input example.
InputHands touch a physical circuit. The body closes, opens or modulates a connection.

ProcessingThe circuit translates touch into signal, state, voltage, logic or behavior.

Design questionWhat does the user understand through touch that they would not through a button?
Path 1 / Electronics

From signal to response

Output example: Mr. SonnetHow electronics can produce movement, sound, light, text or a poetic response.

Electronics make interaction tangible: the interface has weight, friction, wires, delay, resistance and surprise.

Media slot: Mr. Sonnet Replace with video/gif/image of the output behavior.
Path 2 / Computer Vision

Computer vision as low-floor prototyping

With a browser, a webcam and a few tracked points, designers can prototype embodied interactions very quickly.

HandsPinch, point, open palm, fist, distance between fingers, left/right hand.
FacePresence, position, mask, gaze-like direction, playful filters.
Pose / bodyArms, shoulders, posture, spatial composition, movement patterns.
Vibe-coded study / computer vision

Carousel

Pinch distance becomes speed.

Speed:0%
L:0%
R:0%
How to use

Left pinch

Open the distance between thumb and index.

← moves left

Right pinch

Open the distance between thumb and index.

moves right →

Vibe-coded study / Computer vision

Chinese numbers

Some gesture systems already exist culturally. In China, numbers from 1 to 10 can be shown with one hand — instead of inventing gestures from scratch, we can learn from existing embodied symbolic systems.

Chinese one-hand numbers

1
Chinese hand number 1
index finger
2
Chinese hand number 2
index + middle
3
Chinese hand number 3
three extended fingers
4
Chinese hand number 4
four fingers, thumb closed
5
Chinese hand number 5
open hand, thumb spread
6
Chinese hand number 6
thumb + pinky
7
Chinese hand number 7
pinched fingertips
8
Chinese hand number 8
thumb + index
9
Chinese hand number 9
hooked index
10
Chinese hand number 10
fist / ten
Simplified recognition sketch. Regional gesture variations exist, especially for 7, 9 and 10.
Detected gesture
–
Show one hand to the camera
Vibe-coded study / 3D interaction

Object in Space

Move an open hand in the center to rotate the cube.

mode idle
show open hand in central zone
Vibe-coded study / face tracking

Fashion Dictator

A face filter about the aesthetics of power.

current look The Bureaucrat
Choose a look
01
The Bureaucratround glasses · tie
1
02
The Generalcap · medal · moustache
2
03
The Strongmanheavy moustache · sash
3
04
The Monocleone lens · chain · collar
4
show your face
From gesture to robot

Mr. Robovit

The hand does not only control the screen. It can control a body in space.

computer vision
gesture mapping
robotics
feedback loop
Media slot: Mr. RobovitShow video of vision controlling robot behavior.
Climax project

Human Operator

Media slot: Human OperatorReplace with documentation image/video.

At this point, the question becomes less technical and more political:

What does it mean to operate a human body as an interface?

body
control
command
vulnerability
ethics
About

Lina Lopes

Brazilian artist, data scientist and creative technologist based in Switzerland.

  • Machine learning and AI for creative practices
  • Creative coding, computer vision and interactive installations
  • Bio-art, wearables, electronics and embodied interfaces
  • Founder of School of Tomorrow's AI
Media slot: portrait / portfolio collageAdd your image, website screenshot or project montage.
Closing question

What would you design?

What interaction would you create if the body — not the keyboard — was the prompt?

gesture
presence
touch
space
movement
AI