Inflection Points in Engineering Productivity as Amazon Grew 30x

I joined Amazon in 2009, when we were a 3000-engineer company, and got to experience its fast growth from 3k to 90k engineers over a 15-yr period. During that time, our engineering productivity needs had a number of interesting inflection points. A little toil here and there was a minor annoyance when we were 3k engineers but it became a much larger bottleneck when we were 10k, and things that didn’t matter with 10k engineers mattered greatly with 90k engineers. We had to continuously evolve the way we thought about our development practices as the company grew.

Having worked at Google as well exposed me to how some fundamentally different architectural decisions these companies made shaped the way they test and release software in significantly distinct ways. For example, Google chose to maintain a single shared monorepo where more than a hundred thousand engineers work with no branches, whereas Amazon chose an architecture with tens of thousands of independent microrepos. Both systems work at scale but require very different investments in engineering productivity, such as how test environments fit in the picture, and what kind of testing happens before and after submit.

Join me and learn about my journey as I saw Amazon grow by 30x!


Speaker

Carlos Arguelles

Senior Principal Engineer @Amazon, 27 Years Experience in Developer Productivity Engineering, Previously @Google and @Microsoft

Carlos Arguelles is a Senior Principal Engineer at Amazon. He has 27 years of experience working in various aspects of Developer Productivity Engineering at Amazon, Google and Microsoft. He was a Technical Lead for company-wide Infrastructure for Integration Testing at Amazon for 6 years and held the same position at Google for 4 years.

Carlos is passionate about Continuous Integration / Continuous Delivery and Core Developer Infrastructure for mid-to-large software companies. Spending nearly three decades at three of the largest software companies in the world, he has seen first-hand how hundreds of thousands of developers write code, review code, test code and deploy code at large scale. At these large companies, little inefficiencies can aggregate to developer fatigue and millions, hundreds of millions of dollars of productivity lost or wasted hardware resources. Carlos obsesses about how to make engineers' lives better, remove toil, improve efficiency, and raise the bar in engineering and operational excellence.

Carlos writes stories about his life at Amazon, Google and Microsoft in his blog. You can follow him at Linkedin.

Read more
Find Carlos Arguelles at:

Date

Tuesday Nov 19 / 11:45AM PST ( 50 minutes )

Location

Seacliff ABC

Topics

Engineering productivity Continuous Integration Continuous Delivery Developer Infrastructure Software Testing

Share

From the same track

Session Productivity

Productivity Lessons in Moving from Big Tech to Scaling a Startup

Tuesday Nov 19 / 10:35AM PST

Most productivity research happens in large tech companies. Many of the lessons learned there apply to the world of Startups as well, but some don't carry over.

Speaker image - Rachel Potvin

Rachel Potvin

SVP Eng @Sanity.io with 25 Years in Tech, Previously @Google and @GitHub, Engineering Leader Focused on Building Productive Happy Teams

Session

Security or Convenience - Why Not Both?

Tuesday Nov 19 / 01:35PM PST

Traditionally, security is all about creating obstacles and making it difficult to access data. This is at odds with our drive for a more smooth and faster development process. How can we keep the software we’re building secure without adding friction for engineers?

Speaker image - Dorota Parad

Dorota Parad

CEO @Authress, Product and Team Builder, Test Enthusiast

Session AI/LLMs

Slack's AI-Powered, Hybrid Approach for Large-Scale Migration from Enzyme to React Testing Library

Tuesday Nov 19 / 05:05PM PST

With the Enzyme test framework no longer supporting React 18, migrating to React Testing Library (RTL) became imperative.

Speaker image - Sergii Gorbachov

Sergii Gorbachov

Staff Software Engineer @Slack, Specializing in AI-Driven Tools for Automating Code Migrations and Test Authorship

Session Research

Supporting Engineering Productivity for All

Tuesday Nov 19 / 02:45PM PST

Understanding what drives software development productivity is the key to making high-impact investments in engineering productivity.

Speaker image - Emerson  Murphy-Hill

Emerson Murphy-Hill

Research Scientist at the Intersection of Software Engineering and Human-Computer Interaction, Former Googler and Professor

Session Engineering Efficiency

Shifting Left for Better Engineering Efficiency

Tuesday Nov 19 / 03:55PM PST

In this presentation, I will share two critical migration stories - one focuses on production monitoring and the other on production deployments with automated validations.

Speaker image - Ying Dai

Ying Dai

Principal Software Engineer @Roblox, Working on Improving Engineering Efficiency. Previously @Google & @LinkedIn