Session + Live Q&A
Production Readiness: Fighting Fires or Building Better Systems?
In 2018 Tanya Reilly gave a talk called ‘The History of Fire Escapes’ in which she argues that we need to ‘focus on better software, not better incident response’. When I was recently asked how much time SREs should spend firefighting, that talk came to mind. The ideal amount of time to spend responding to incidents is 0 (which we never achieve, but that’s the goal). A healthy SRE team spends most of its time improving the systems it is responsible for.
Reilly also argues that ‘software needs a fire code’, in other words, a set of best practices to prevent or mitigate failures - just as building regulations have evolved over time to reduce the incidence and impact of building fires.
We don’t have fire codes for software. But many organisations use Production Readiness Reviews (PRRs) as a model to improve reliability of software systems. This talk will discuss why we don’t have a fire code for software; what PRRs can and cannot achieve in terms of reliability; the difference between PRRs run by a team that is onboarding a service and PRRs run by consulting teams; and what to do when all your team does is fight fires.
Speaker

Laura Nolan
Senior Staff Engineer @Slack, Contributor to Seeking SRE, & SRECon Steering Committee
Laura Nolan's background is in Site Reliability Engineering, software engineering, distributed systems, and computer science. She wrote the 'Managing Critical State' chapter in the O'Reilly 'Site Reliability Engineering' book, as well as contributing to the more recent...
Read moreFrom the same track
Prod Lessons - Deployment Validation and Graceful Degradation
Wednesday Nov 10 / 12:10PM EST
Key to Site Reliability Engineering is building frameworks and “guardrails” that enable the product to be developed safely. If patterns can be identified in outages and bugs, preventing those problems systematically gives SRE unparalleled leverage to improve stability. During...

Anika Mukherji
Software Engineer @Pinterest
Incidents, PRRs, and Psychological Safety
Wednesday Nov 10 / 01:10PM EST
A Production Readiness Review is a process that identifies the reliability needs of a service based on its specific details. Few organizations have the benefit of starting with a robust PRR process. In most instances, the PRR process came about because of a production incident. The fact is there...

Nora Jones
Founder and CEO @jeli_io
Panel: Real-World Production Readiness
Wednesday Nov 10 / 02:10PM EST
What does it mean for an app to truly be ready for Production? Join Ines Sombra (Senior Director of Engineering at Fastly), Kolton Andrus (CEO of Gremlin), and Laura Nolan (Seeking SRE Contributor) as we discuss production readiness. Topics we’ll dive into range from the...

Kolton Andrus
Founder and CEO of @GremlinInc

Laura Nolan
Senior Staff Engineer @Slack, Contributor to Seeking SRE, & SRECon Steering Committee

Ines Sombra
Director of Engineering @Fastly