Thomas Huang - Spatial Computing

Spatial Computing

Spatial Productivity: Exploring AR Sticky Notes & Checklists on Vision Pro (2025)

At Spatial Delivery, we're experimenting with AR Notes on Apple Vision Pro to bridge the gap between physical and digital workflows. Our goal is to enhance productivity by creating an intuitive system for managing user feedback, checklists and tasks in dynamic environments.

The Challenge

On-site reviews, such as those for construction, store design, or facility inspections, are often fast-paced and information-rich. However, traditional note-taking methods create a lag in real-time visibility and seamless sharing. This disconnect is further exacerbated by the lack of spatial context, hindering effective review and collaboration.

Quick Proof of Concept: Bridging Physical & Digital with AR Sticky Notes & Checklists

We think that AR Notes and Checklists can bridge this gap. By leveraging the power of Apple Vision Pro, we're experimenting with overlaying checklists, notes and tasks information directly onto the real world. This allows users to create sticky notes linked to specific locations or objects using natural language input or computer vision. A centralized dashboard further streamlines progress tracking and decision-making.

Key Functionalities

Intuitive Interaction: Create notes using natural language via speech-to-text.
Spatial Anchoring: Position notes precisely where they're relevant.
Centralized Dashboard: Aggregate tasks and communication in one location.
Project Management Integration: Connect spatial notes with existing workflows via Function Calling (in the future we will also explore using Model Context Protocol) - e.g. Google Task or JIRA connection.

Learning and Collaboration

We're excited to share our learnings and collaborate with forward-thinking partners who share our passion for shaping the future of work. Reach out for a demo or discussion.

Collaborative Design with Apple Vision Pro (2025)

At Spatial Delivery, we’re unlocking the future of real-time collaborative design.

In this demo, three users — spreading from the East to the West Coast of US — worked seamlessly in real-time, together immersed in the same store digitally to plan its visual merchandising layout. The experience of working with colleagues thousands of miles apart was nothing short of extraordinary. Spatial Personas and real-time collaboration truly broke the fourth wall, making it feel like we were all in the same room. Collaborative design on Apple Vision Pro is revolutionizing the way we work together!

Introducing real-time collaboration on the Apple Vision Pro:

FaceTime & SharePlay enable seamless communication, allowing multiple users to co-design and review layouts simultaneously
Spatial Personas elevate communication with natural interactions, incorporating body language, gestures, and facial expressions, making remote collaboration feel natural and human. All changes and edits are instantly visible to everyone.
Immersive environment: Participants can use Augmented Reality if they are physically onsite, with remote participants fully immersive in a Digital Twin virtual environment.

We’re leveraging the latest in spatial technology, including visionOS 2, SwiftUI, RealityKit, and Spatial Audio.

Store Design & Visual Merchandising (2024)

As a co-founder and head of product at Spatial Delivery, I lead the team to spearheaded the product initiative of a groundbreaking space design solution with spatial computing. The application is live on the Apple Vision Pro app store.

Spatial Delivery brings an intuitive and immersive platform powered by our proprietary Spatial Planning Engine (SPE). Discover a paradigm shift in how you interact with space design, ushering in a new era of immersive spatial planning.

Key Features

Immersive Visualization: Design in both augmented (AR) and virtual reality (VR) modes with a human-centric approach.
Intuitive Interaction: Design naturally using hands and eyes for seamless creation and adjustment.
Data-Driven Insights: Integrate business intelligence metrics in spatial contexts and heat maps data visualization.
Real-time Collaboration: Collaborate remotely or co-locally in real-time, uniting teams across distances.
Streamlined Workflow: Leverages Universal Scene Description (USD) for interoperability, and brings CAD to immersive 3D layouts.

In-Store Shopping with AR Headsets (2023-2024)

The Store No 8 Project Archer utilized the concept of a Back to School shopping trip to delve into the future possibilities of AR in-store shopping with Head Mounted Displays (HMDs) like HoloLens 2 and Magic Leap 2. As the product director, I lead the transformative initiative in B2C in-store retail experiences using Magic Leap 2. We pioneered an industry-leading in-store testing program, conducting over 250 qualitative tests across crucial areas such as in-store navigation, shelf filtering, product searching, and AR-based in-store experiential advertisements.

Our collaboration with Stationary Merchants from Walmart and Newell - Elmers Squishies culminated in an innovative AR marketing experience within the store environment. This groundbreaking initiative was showcased at CES 2024 within the Walmart booth, highlighting our forward-thinking approach to retail technology.

Home Planner (2021-2023)

As the Lead Product Manager, I brought cross-functional teams together to develop and launched 3D home furnishing experiences.

Try out the room planner experiences with the following links:

https://www.target.com/c/home-planner/-/N-4cir4

https://www.target.com/room-planner/home

See It On You AR (2019-2023)

As the Lead Product Manager, I partnered with cross-function teams to enable new augmented reality capability to Target's guest-facing experience portfolio. My role was to lead the development from proof of concept prototyping to operationalizing content production, and being the voice of product to communicate between business, engineering and content production teams. The See It On You - Sunglasses AR experience is enabled on Android, iOS and mobile web platforms.

Mask Try-On (2020-2023)

As the Lead XR Technical Owner, I partnered with cross-function teams to enable new augmented reality capability to Target's guest-facing experience portfolio. My role was to lead the development from proof of concept prototyping to operationalizing content production, and being the technical liaison between product, production, engineering, and product design teams. The See It On You - Face Masks AR experience is enabled on Android, iOS and mobile web platforms.

Christmas Trees (2018-2023)

Target’s Making Christmas Tree Shopping (and More) Easier Than Ever With Augmented Reality

As the Lead XR Technical Owner, I led the proof of concept prototype on mobile AR and on web, and finalized the content technical specification for scalable production plan with Target Merchants and 3D production team. With close collaboration with art production, UI, and engineering teams, Target enabled See It In Your Space - Christmas Mobile AR experience on Android, iOS, mobile and desktop Web. In 2020, new dynamic lighting and viewers are implemented to enhance the visual quality.

Target Limited Time Offer AR XXO (2019)

Target Celebrates 20 Years of Designer Partnership with an Anniversary Collection

As the Lead XR Technical Owner, I was responsible for 3D technical and animation direction. My technical USDZ research unlocked the animation capability in iOS AR Quick Look, before official transcoder support in early 2019. As part of the cross-function team, I provided confidence to the campaign to be able to add motion elevate fun moments to the campaign.

Limited Time Offer - Hunter (2018)

An Update on the Hunter for Target Collaboration

For Hunter project (2018), I provided consultation with 3D expertise to Target Creative, bringing realistic, realtime 3D content to celebrate Hunter & Target's Limited Time Offer. We resulted in elevating the experience with high quality, 360 product spinner to Target.com.

Snapchat Lenses (2018-2020)

I had some fun producing these Snap Lenses for campaign works. I directed animation and technical art, also got my hand dirty in coding and music! The projects were developed and published from the Lens Studio.

XR for FinTech (2017)

In partnership with Citi Innovation Lab, 8ninths produced this proof of concept envisioning XR as disruptive technology to change financial trading workflow. This was selected project for the Microsoft Holographic Academy, which I participated as a graduate team. I was responsible of UX ideation and 3D visualization, in collaboration with developers and a creative director.

XR for Retail (2017)

Proof of Concept envisioning XR application for Retail vertical by enhancing planogram, analytics, and interaction. I was responsible for developing and optimizing content and shaders for Windows Mixed Reality and Google Daydream platform.

XR for Automotive (2017)

Proof of Concept of XR for automotive dealership experience that enable guests to customize with different accessory options and depict different life styles through showcasing the automotive in various environments. I was responsible for leading interactive content development and custom shaders for Windows Mixed Reality platform on HoloLens.

XR for Engineering (2017)

Proof of Concept envisioning XR application for engineering design. I was responsible for content development (modeling, rigging, animation) and custom shaders for Windows Mixed Reality platform on HoloLens.

Daydream VR - Maze: Underwater Treasure Hunt (2016)

This is a VR interactive experience on Google Cardboard/ Daydream platform, developed with C# in Unity.

Daydream Controller Function Prototype (2016)

Prototype daydream controller behavior with C# in Unity, to respond with swipe and rotate menus, and able to point and drag objects.

Report abuse