Building Generative AI Products Responsibly at Snap Inc.

Tuesday, September 12, 2023 - 1:30 pm1:45 pm

Ilana Arbisser and Sofia Calatrava, Snap Inc.

Abstract: 

Generative AI models offer new opportunities and challenges for creating AI products responsibly. Existing literature in the field that focuses on the study of harmful or biased outcomes from AI and how to build AI responsibly has focused on discriminative models, where model performance can be evaluated across different demographic groups on objective measures. Generative AI models produce novel images and free-form text which require innovative methods for ensuring responsible product development and deployment. In this talk we discuss the approach we take at Snap for analyzing and correcting outcomes to create experiences that are high quality and comfortable for our community. We'll cover best practices including developing experiments to analyze and modify products before launch and ways to monitor product outcomes after launch using Snapchat's new chatbot, My AI, as a case study.

Ilana Arbisser, Snap Inc.

Ilana Arbisser: Ilana Arbisser, PhD, Stanford University (2018), is a privacy engineer at Snap Inc. She previously worked at Meta on AI infrastructure privacy compliance and at Cruise Automation on self-driving car safety.

Sofia Calatrava, Snap Inc.

Sofia Calatrava: Sofia Calatrava, Masters of Science, Columbia University (2019, 2022), is a Privacy Engineer at Snap Inc.

BibTeX
@conference {290845,
author = {Ilana Arbisser and Sofia Calatrava},
title = {Building Generative {AI} Products Responsibly at Snap Inc.},
year = {2023},
address = {Santa Clara, CA},
publisher = {USENIX Association},
month = sep
}