I worked on AI Clips, a new Lens format in Lens Studio powered by Snap's in-house generative video model. An AI Clip turns a single photo into a five-second video through a closed-prompt system, so a Snap or Camera Roll photo can place someone on a red carpet or in a surreal moment.
Bring AI Clips to Snapchatters: a Lens format that turns a single photo into a five-second AI video through a closed-prompt system.
I worked in R&D. Creating AI Clips relied on LoRA training, and I curated the datasets for it. That meant selecting high-quality source material and making a lot of video content. When generated videos fell short, I made the examples myself with video compositing. I also looked for effective prompts and generated the content with Snapchat's internal models.
After working extensively in the CMS, I gathered data on errors and reported them to the engineering team and my management. This led to optimizations that improved the speed and quality of these lenses.
Cinematic, personal, share-ready videos from a single photo.
After working on videoGen, I had my own ideas for lenses, and they were built.