Skip to work
OverviewAsh Shah
02 / Magic Leap

Magic Leap

Magic LeapPrototype engineerSpatial UI, Interaction systems, Unity development, Technical art2021–present

Assist was a remote guidance product for Magic Leap 2.

I built interface pieces shared between headset and web: spatial annotation, interactive 3D web components, menu systems, and tutorial prototypes.

A Magic Leap 2 wearer could work with remote participants who saw the surrounding context, marked up the space, and returned files or 3D content.

Assist interface systems

Interface pieces for the remote viewer, spatial content, and shared annotation.

The annotation system is the one I built for Workshop, running here too. Each participant draws in their own colour, so a stroke says who made it.

The remote-room diagram labels the desktop viewer’s Camera Window, Toolbar, Mesh Window, Your Video Window, and Control Bar. The selected-turbine view shows the model on a table with the session control bar below.

Four differently colored annotation strokes, one per participant, appear beside four participant video tiles.
Shared annotation strokes beside four participant video tiles.
An annotated desktop viewer diagram labels the Camera Window, Toolbar, Mesh Window, Your Video Window, and Control Bar.
Remote-room desktop viewer with its interface regions labeled.
A turbine model is selected on a table with the session control bar below.
Selected turbine model with the session control bar.

Assist

Remote experts, connected to the wearer’s space.

Assist was used for live guidance, training, and support, with the remote participant joining from a browser rather than a second headset.

Assist browser interface at the start of a remote support session.
Web session
A worker uses a Magic Leap headset during an Assist session.
Assist in use
A worker receives spatial guidance while using Magic Leap 2.
Guided work