TrackAR

Spatial tracking for AR/VR experience
with Dynamic Vision Sensor (DVS)

ROLE

Visual mockups for developing technology components, demo prototypes, video creating/editing

As a lead designer, worked with the project leader, project manager, and SW engineers

DURATION

Create and develop from April 2017 ~ Nov 2018

Project Introduction

Researched and developed a mobile device with visual intelligence and spatial awareness for the next generation of mobile experience. Key features of low-powered, lightweight sensor, inside-out camera tracking system with Dynamic Vision Sensor(DVS)

Challenges

Low-power and lightweight sensor-based AR technology for the widespread use cases

Logo Design

The logo shape represents a vision tracking based DVS camera. And the center diamond is especially pointing out the core camera pose which enables AR/VR application to estimate the position.

Technology demo application

Ver 1.0 - Plane Detection & 3D Object Positioning Experience

This prototype shows the integration of DVS spatial tracking, plane detection, and 3D object positioning in App. The simple user interface enables to show the development process of our technical feasibility.

Overall UI

Plane Detection

Ground Detection & 3D Object Placement

3D Object Manipulation

Horizontal Detection

Vertical Detection

Visualization of key features

Key Features

- High efficiency of power consumption (Battery life) for widespread adoption on mobile devices
- Robust camera tracking for multi-user AR experiences.
- Provide robustness for the high-speed motion
- Experience the camera senses scene without losing detail and without adjusting exposure in a sunny outdoor or low light indoor.

-Spatial understanding solution using DVS and alternate sensors