Engineering AI for Creativity and Curiosity on Mobile

Summary

Disclaimer: This summary has been generated by AI. It is experimental, and feedback is welcomed. Please reach out to info@qconsf.com with any comments or concerns.

This presentation by Bhavuk Jain discusses the process of engineering AI for creativity and curiosity on mobile devices, exploring how AI systems transition from research to scalable products.

Introduction

The talk addresses two AI products: AI wallpapers, which focus on generative creativity, and Circle to Search, a tool for contextual visual search. The discussion includes user experience (UX), latency, scalability, and safety concerns involved in bringing these AI solutions to mobile platforms.

AI Development Stages

  • Post Training: Aligns the foundational model with human preferences, style, and safety guidelines.
  • Fine Tuning: Specializes the model for specific use cases to enhance its effectiveness.
  • Retrieval and Grounding: Ensures the system is well-grounded, reducing hallucinations by connecting to factual sources.
  • Inference and Guardrails: Encompasses the deployment infrastructure and guards the model to ensure reliable and safe operations at scale.

Case Studies

  1. AI Wallpapers: Allows users to generate unique wallpapers. This application faced challenges such as UX simplicity, artistic quality control, safety, and cost. The innovation was integrating AI into Android's design philosophy, thereby enhancing user interface personalization.
  2. Circle to Search: Simplifies the visual search process by reducing steps. This tool leverages Google Lens' capabilities and integrates deeper with device OS for a seamless user experience, eliminating significant friction during searches.

Key Learnings

  • Clear product principles and evaluation pipelines are critical for generative AI projects to ensure artistic quality.
  • Deep integration with the OS can enhance user engagement by making experiences frictionless and more intuitive.
  • Establishing reliable trust through grounding in factual data is essential for maintaining user trust.

Overall, the presentation highlights the importance of principled AI development, user-centric design, and the balance between freedom and guided experiences to create innovative and scalable mobile AI products.

This is the end of the AI-generated content.


Abstract

This talk shares practical lessons from building production-grade AI for creativity and curiosity on mobile devices. I’ll walk through how we turned ambitious, research-driven ideas into scalable, reliable features that feel effortless to users, from generative tools for artistic expression to multimodal information experiences. Along the way, we’ll look at key decisions in model design, UX, latency, and safety, and how they come together to ship AI that genuinely delights users at scale. 


Speaker

Bhavuk Jain

Tech Lead @Google

Bhavuk Jain is a Tech Lead at Google, where he works on applied AI initiatives across multiple product areas. He focuses on turning cutting-edge research into scalable, production-grade features used by millions of people worldwide. Most recently, he has helped bring AI capabilities to Pixel devices, with his work landing in AOSP (Android Open Source Project) and being adopted by leading global device manufacturers. Prior to Google, Bhavuk worked at Tower Research Capital, building robust, low-latency systems in the high-frequency trading domain.

Read more

Date

Tuesday Nov 18 / 11:45AM PST ( 50 minutes )

Location

Ballroom BC

Share

From the same track

Session

Dynamic Moments: Weaving LLMs into Deep Personalization at DoorDash

Tuesday Nov 18 / 03:55PM PST

In this talk, we’ll walk through how DoorDash is redefining personalization by tightly integrating cutting-edge large language models (LLMs) with deep learning architectures such as Two-Tower Embeddings (TTE) and Multi-Task Multi-Label (MTML) models.

Speaker image - Sudeep Das

Sudeep Das

Head of Machine Learning and Artificial Intelligence, New Business Verticals @DoorDash, Previously Machine Learning Lead @Netflix, 15+ Years in Machine Learning

Speaker image - Pradeep Muthukrishnan

Pradeep Muthukrishnan

Head of Growth for New Business Verticals @DoorDash, Previously Founder & CEO @TrustedFor, 15+ Years in Machine Learning

Session AI Agents

From Content to Agents: Scaling LLM Post-Training Through Real-World Applications and Simulation

Tuesday Nov 18 / 02:45PM PST

This talk presents a comprehensive journey through modern AI post-training techniques, from Pinterest's production-scale content discovery systems to enterprise agent training through Veris AI’s simulation.

Speaker image - Faye Zhang

Faye Zhang

Staff Software Engineer @Pinterest, Tech Lead on GenAI Search Traffic Projects, Speaker, Expert in AI/ML with a Strong Background in Large Distributed System

Speaker image - Andi Partovi

Andi Partovi

Co-Founder @Veris AI, Making AI Agents World-Ready

Session AI/ML

Automating the Web With MCP: Infra That Doesn’t Break

Tuesday Nov 18 / 05:05PM PST

AI agents are only as strong as the infrastructure beneath them. In this talk, we’ll walk through the architecture behind Browserbase’s model context protocol (MCP), built to support stateful browser automation at scale.

Speaker image - Paul Klein

Paul Klein

Founder @Browserbase, previously Director of Self-Service & Engineering Manager @Mux, Co-Founder & CTO @Stream Club, Technical Lead @Twilio Inc.

Session AI Agents

Engineering at AI Speed: Lessons from the First Agentically Accelerated Software Project

Tuesday Nov 18 / 10:35AM PST

Claude Code is the first developer tool built specifically to maximize AI development velocity.

Speaker image - Adam Wolff

Adam Wolff

Engineer and Individual Contributor to Claude Code @Anthropic, Previously @Robinhood, @Facebook

Session AI/ML

Improving Meta Generative Ad Text using Reinforcement Learning

Tuesday Nov 18 / 01:35PM PST

Reinforcement Learning with Performance Feedback (RLPF) unlocks a new way of turning generic GenAI models into customized models fine-tuned for specific tasks. This approach is especially powerful when combined with in-house data and performance metrics.

Speaker image - Alex Nikulkov

Alex Nikulkov

Research Scientist (RL lead for Monetization GenAI) @Meta