Dynamic face-mapped illustration for Chloé.
We worked in collaboration with Dalziel & Pow to bring an unique mirror display retail experience for Chloé eyewear, inviting people to interact with the in-store space in a novel way.
2021 / London, UK
The core idea is to establish a greater physical engagement in the different department stores where Chloé is present.
The installation is comprised of a LED screen placed behind a see-through mirror and individual column stands where each model of glasses rest. These glasses all have RFID tags that allow the application to detect when people pick up the glasses and send a message over the network to display our content: a portrait drawn from the person's face and moving in real-time.
We were working with beautiful illustrations used throughout the campaign as base material.
We've extracted the colors and adjusted them manually to fit the medium as the mirrors dim a the LED screens.
To go from 2D portraits to their 3D representation, we had to flatten and redraw them on a face mesh model.
To give life to the portraits and enhance the surprise effect on the mirror, we use eigenvectors to find the different shapes's optimal reveal direction.
Tensorflow face landmark detection was essential in detecting people's faces via a webcam placed behind the mirror.
Being released in 2020/2021, we've had to account for face masks and provide a fallback in case face detection fell through.
For the prototypes, the preview tool and the final application, we used our in-house creative coding tool Nodes.
The installation was to be installed at different locations all over the world so we packaged it as a bundled desktop app ready to be installed on new mirrors.