Keywords: Landmark AR, Billboard, Transparency, Refraction, Lazy Rendering, Audio, 3D Animation, Shared Experience, Interactive Installation
Goal: Based on 5G Technology combining with TikTok business scenario, find suitable application point, complete demo design development to show at the conference
World map transforms into a content visualizer with synchronized and geolocated TikTok content. All phones are synchronized to see the map animate and present new content simultaneously along with a soundtrack that plays in the installation through speakers.
Physical Installation
The sandbox is composed of four parts: the bottom round table, the plywood layer, the 2D trigger part and the 3D trigger part, as shown in Figure 1. 2D map trigger is sticked on the plywood layer, while 3d trigger has a number of pieces, overlapping with the land area in the 2D map. This sandbox is designed to work with both 2D trigger and 3D trigger. For each part, we will detail its specs (size, color, paint, texture), manufacture method and timeline.
Laser Cut Design
A laser cutter is a type of CNC (Computer Numerical Controlled) machine, meaning that it is controlled via a computer. A designer can design something in some sort of design software, and then send it to a laser cutter to have it cut out automatically, with just the push of a button.
A Laser cutter works very much like your everyday inkjet printer. Laser cutters come with specific drivers that allow them to take what is on the computer, convert it into a format that the laser cutter can read, and then allow the laser cutter to do its job.
Vector Cutting and Laser Rastering
Speakers and Audio
The installation features audio across 4 channels. Each video's soundtrack is panned positionally according to the the video's placement on the map. The audio is sequenced and spatialized in Ableton Live.Design Iteration
Design Iteration
Tecnical Iteration
Lazy Rendering
Billboard
GLSL Vertex shader: Rising Ocean
Anti-Aliasing
Fake Ocean Refraction Shader