AR Eyewear — pipeline development @ Snap Inc.

As part of an initiative to reduce asset creation time for eyewear, I have developed a pipeline that enables the creation of eyewear in under 30 minutes, based on a images that can be found online. These items are extremely suitable for Virtual Try-On experiences. The tooling includes: a Blender Scene, a Blender Addon and a Substance Painter smart material.

→ Tools — python (bpy) | chatgpt l blender l substance painter l lens studio
→ Tags — pipeline development l automation l addon creation

Video is playing at 400% speed.

Product page images are compiled nearly instantly into a usable texture using the Substance Painter smart material. The user then only needs to apply the textures to a defined material in Blender and and then trace the glasses with one of the pre-set meshes. This mesh has a modifier stack applied and will immediately start shaping the glasses.

The pre-set Blender scene offers additional functionalities such as lens gradient editing, nose bridge editing, and eyewear fitting.

It also includes and extensive asset library with hardware pieces, such as nose-padding and hinges.

The included Blender add-on also enables mirroring or un-mirroring textures and allows users to choose between three thickness levels for the solidified mesh.

To create a pair of glasses like these, only two images are required as an input:
→ Image displaying the glasses from the front
→ Image displaying the glasses from the side (can be slightly skewed)