You are viewing content from a past/completed QCon Plus - November 2021

The video on-demand of this session is available to logged in QCon attendees only. Please login to your QCon account to watch the session.

Session + Live Q&A

Production Readiness: Fighting Fires or Building Better Systems?

In 2018 Tanya Reilly gave a talk called ‘The History of Fire Escapes’ in which she argues that we need to ‘focus on better software, not better incident response’. When I was recently asked how much time SREs should spend firefighting, that talk came to mind. The ideal amount of time to spend responding to incidents is 0 (which we never achieve, but that’s the goal). A healthy SRE team spends most of its time improving the systems it is responsible for.

Reilly also argues that ‘software needs a fire code’, in other words, a set of best practices to prevent or mitigate failures - just as building regulations have evolved over time to reduce the incidence and impact of building fires.

We don’t have fire codes for software. But many organisations use Production Readiness Reviews (PRRs) as a model to improve reliability of software systems. This talk will discuss why we don’t have a fire code for software; what PRRs can and cannot achieve in terms of reliability; the difference between PRRs run by a team that is onboarding a service and PRRs run by consulting teams; and what to do when all your team does is fight fires.


Speaker

Laura Nolan

Senior Staff Engineer @Slack, Contributor to Seeking SRE, & SRECon Steering Committee

Laura Nolan's background is in Site Reliability Engineering, software engineering, distributed systems, and computer science. She wrote the 'Managing Critical State' chapter in the O'Reilly 'Site Reliability Engineering' book, as well as contributing to the more recent...

Read more

Date

Wednesday Nov 10 / 11:10AM EST (40 minutes)

Track

Production Readiness

Topics

Production ReadinessDevopsInfrastructureSREDistributed Programming

Add to Calendar

Add to calendar

Share

From the same track

Session + Live Q&A Production Readiness

Prod Lessons - Deployment Validation and Graceful Degradation

Wednesday Nov 10 / 12:10PM EST

Key to Site Reliability Engineering is building frameworks and “guardrails” that enable the product to be developed safely. If patterns can be identified in outages and bugs, preventing those problems systematically gives SRE unparalleled leverage to improve stability. During...

Anika Mukherji

Software Engineer @Pinterest

Session + Live Q&A Production Readiness

Incidents, PRRs, and Psychological Safety

Wednesday Nov 10 / 01:10PM EST

A Production Readiness Review is a process that identifies the reliability needs of a service based on its specific details. Few organizations have the benefit of starting with a robust PRR process. In most instances, the PRR process came about because of a production incident. The fact is there...

Nora Jones

Founder and CEO @jeli_io

PANEL DISCUSSION + Live Q&A Production Readiness

Panel: Real-World Production Readiness

Wednesday Nov 10 / 02:10PM EST

What does it mean for an app to truly be ready for Production? Join Ines Sombra (Senior Director of Engineering at Fastly), Kolton Andrus (CEO of Gremlin), and Laura Nolan (Seeking SRE Contributor) as we discuss production readiness. Topics we’ll dive into range from the...

Kolton Andrus

Founder and CEO of @GremlinInc

Laura Nolan

Senior Staff Engineer @Slack, Contributor to Seeking SRE, & SRECon Steering Committee

Ines Sombra

Director of Engineering @Fastly

View full Schedule