Speaker: David Cheney

Lead, Copilot Proxy @GitHub, Open Source Contributor and Project Member for Go Programming Language, Previously @VMware

David is an open source contributor and project member for the Go programming language. David is a well-respected voice within the tech community, speaking on a variety of topics such as software design, performance, and the Go programming language.

Find David Cheney at:

Session

How GitHub Copilot Serves 400 Million Completion Requests a Day

GitHub Copilot is the largest LLM powered Code Completion service in the world, serving hundreds of millions of requests per day with an average response time of under 200ms. This is the story of the architecture which powers this product.

Read more

Date

Monday Nov 18 / 03:55PM PST ( 50 minutes )

Location

Ballroom A

Topics

HTTP Load balancing High Scale

Slides

Slides are not available

Share

Share Share