{"id":1582,"date":"2016-05-25T09:12:03","date_gmt":"2016-05-25T13:12:03","guid":{"rendered":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/?p=1582"},"modified":"2016-10-20T10:11:57","modified_gmt":"2016-10-20T14:11:57","slug":"reliability-engineers-what-its-like-to-recreate-data-center-disaster","status":"publish","type":"post","link":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/reliability-engineers-what-its-like-to-recreate-data-center-disaster\/","title":{"rendered":"Google Site Reliability Engineers: What it&#8217;s like to Recreate a Data Center Disaster"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1585\" src=\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/files\/2016\/05\/Google-Site-Reliability-Engineers-What-its-like-to-Recreate-a-Data-Center-Disaster.jpg\" alt=\"Google, Data recovery\" width=\"800\" height=\"350\" srcset=\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/files\/2016\/05\/Google-Site-Reliability-Engineers-What-its-like-to-Recreate-a-Data-Center-Disaster.jpg 800w, https:\/\/solutionsreview.com\/backup-disaster-recovery\/files\/2016\/05\/Google-Site-Reliability-Engineers-What-its-like-to-Recreate-a-Data-Center-Disaster-300x131.jpg 300w, https:\/\/solutionsreview.com\/backup-disaster-recovery\/files\/2016\/05\/Google-Site-Reliability-Engineers-What-its-like-to-Recreate-a-Data-Center-Disaster-768x336.jpg 768w, https:\/\/solutionsreview.com\/backup-disaster-recovery\/files\/2016\/05\/Google-Site-Reliability-Engineers-What-its-like-to-Recreate-a-Data-Center-Disaster-600x263-2.jpg 600w, https:\/\/solutionsreview.com\/backup-disaster-recovery\/files\/2016\/05\/Google-Site-Reliability-Engineers-What-its-like-to-Recreate-a-Data-Center-Disaster-180x79-1.jpg 180w, https:\/\/solutionsreview.com\/backup-disaster-recovery\/files\/2016\/05\/Google-Site-Reliability-Engineers-What-its-like-to-Recreate-a-Data-Center-Disaster-400x175.jpg 400w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/><\/p>\n<p style=\"text-align: justify\">Google wonders, what better way to test a backup and disaster recovery plan, than to create a disaster and see how long it takes site managers to respond, and recover?<\/p>\n<p style=\"text-align: justify\">Imagine what&#8217;s it like to have\u00a0what may be the coolest job ever: a Google Site Reliability Engineer. Much like how large corporations hire hackers to infiltrate their databases on purpose, Site Reliability Engineers quite literally force entry, and wreak havoc on unassuming google divisions. <a href=\"https:\/\/www.storagecraft.com\/blog\/how-does-google-prepare-for-disaster-they-create-their-own\/\" target=\"_blank\">Storagecraft.com&#8217;s<\/a>, Casey Morgan describes the teams plan of action:<\/p>\n<p style=\"text-align: justify\">&#8220;The team, which wears super-cool leather jackets with military-inspired patches, runs a simulated war on Google\u2019s infrastructure that they call DiRT (disaster recovery testing). This \u201cwar\u201d involves everything from causing leaks in water pipes to staging protests to attempting to steal disks from the servers\u2014whatever it takes to bring down the infrastructure. The data center attacks aren\u2019t real, but they are hard to distinguish from an actual event, even though the SRE team has a little fun by attributing each attack to a fictional event like a zombie, alien, or supernatural attack.&#8221;<\/p>\n<p style=\"text-align: justify\">The magic is in the timing, as google plans a site attack about once per year, and database incident managers have no idea when an event will happen, or if they are in fact one the DiRT to-do list.<\/p>\n<p style=\"text-align: justify\">Kripa Krishnan, is the Google\u00a0engineer who heads the annual exercise. She lays down some rules to the attack team: \u201cDo not attempt to fix anything.\u00a0As far as the people on the job are concerned, we do not exist. If we\u2019re really lucky, we won\u2019t break anything.\u201d \u00a0Historically,\u00a0among Google Incident Managers around the world, the first report of a\u00a0false attack was made within five minutes.<\/p>\n<p style=\"text-align: justify\">\u201cMy role is to come up with big tests that really expose weaknesses,\u201d Krishnan says. \u201cOver the years, we\u2019ve also become braver in how much we\u2019re willing to disrupt in order to make sure everything works.\u201d<\/p>\n<p style=\"text-align: justify\">For more on the wild world of Google Site Reliability engineers, check out Steven Levy&#8217;s recount of his trip to a\u00a0top-secret Google Data Center on <a href=\"https:\/\/www.wired.com\/2012\/10\/ff-inside-google-data-center\/3\/\" target=\"_blank\">Wired.com<\/a><\/p>\n<hr \/>\n<p>&nbsp;<\/p>\n<p style=\"text-align: center\"><div class=\"widget\"><div class=\"aside-card\">\t\t\t<div class=\"textwidget\"><p><a class=\"speedbump-3\" href=\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/data-protection-vendor-map\/\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" class=\"alignleft size-full wp-image-1682\" title=\"Data Protection Vendor Map\" src=\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/files\/2020\/02\/DP_VM_SB_800.jpg\" alt=\"Download Link to Data Protection Vendor Map\" width=\"800\" height=\"100\" \/><\/a><\/p>\n<\/div>\n\t\t<\/div><\/div><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Google wonders, what better way to test a backup and disaster recovery plan, than to create a disaster and see how long it takes site managers to respond, and recover? Imagine what&#8217;s it like to have\u00a0what may be the coolest job ever: a Google Site Reliability Engineer. Much like how large corporations hire hackers to [&hellip;]<\/p>\n","protected":false},"author":29,"featured_media":1585,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[3,204],"tags":[],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Google Site Reliability Engineers: What it&#039;s like to Recreate a Data Center Disaster - Best Backup and Disaster Recovery Tools, Software, Solutions &amp; Vendors<\/title>\n<meta name=\"description\" content=\"Imagine what&#039;s it like to\u00a0have\u00a0what may be the coolest job ever: a Google Site Reliability Engineer.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/reliability-engineers-what-its-like-to-recreate-data-center-disaster\/\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/reliability-engineers-what-its-like-to-recreate-data-center-disaster\/\",\"url\":\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/reliability-engineers-what-its-like-to-recreate-data-center-disaster\/\",\"name\":\"Google Site Reliability Engineers: What it's like to Recreate a Data Center Disaster - Best Backup and Disaster Recovery Tools, Software, Solutions &amp; Vendors\",\"isPartOf\":{\"@id\":\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/reliability-engineers-what-its-like-to-recreate-data-center-disaster\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/reliability-engineers-what-its-like-to-recreate-data-center-disaster\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/files\/2016\/05\/Google-Site-Reliability-Engineers-What-its-like-to-Recreate-a-Data-Center-Disaster.jpg\",\"datePublished\":\"2016-05-25T13:12:03+00:00\",\"dateModified\":\"2016-10-20T14:11:57+00:00\",\"author\":{\"@id\":\"\"},\"description\":\"Imagine what's it like to\u00a0have\u00a0what may be the coolest job ever: a Google Site Reliability Engineer.\",\"breadcrumb\":{\"@id\":\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/reliability-engineers-what-its-like-to-recreate-data-center-disaster\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/reliability-engineers-what-its-like-to-recreate-data-center-disaster\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/reliability-engineers-what-its-like-to-recreate-data-center-disaster\/#primaryimage\",\"url\":\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/files\/2016\/05\/Google-Site-Reliability-Engineers-What-its-like-to-Recreate-a-Data-Center-Disaster.jpg\",\"contentUrl\":\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/files\/2016\/05\/Google-Site-Reliability-Engineers-What-its-like-to-Recreate-a-Data-Center-Disaster.jpg\",\"width\":800,\"height\":350,\"caption\":\"Google, Data recovery\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/reliability-engineers-what-its-like-to-recreate-data-center-disaster\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Google Site Reliability Engineers: What it&#8217;s like to Recreate a Data Center Disaster\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/#website\",\"url\":\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/\",\"name\":\"Best Backup and Disaster Recovery Tools, Software, Solutions &amp; Vendors\",\"description\":\"Solutions Review\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"\",\"url\":\"https:\/\/solutionsreview.com\/backup-disaster-recovery\/author\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Google Site Reliability Engineers: What it's like to Recreate a Data Center Disaster - Best Backup and Disaster Recovery Tools, Software, Solutions &amp; Vendors","description":"Imagine what's it like to\u00a0have\u00a0what may be the coolest job ever: a Google Site Reliability Engineer.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/reliability-engineers-what-its-like-to-recreate-data-center-disaster\/","twitter_misc":{"Written by":"","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/reliability-engineers-what-its-like-to-recreate-data-center-disaster\/","url":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/reliability-engineers-what-its-like-to-recreate-data-center-disaster\/","name":"Google Site Reliability Engineers: What it's like to Recreate a Data Center Disaster - Best Backup and Disaster Recovery Tools, Software, Solutions &amp; Vendors","isPartOf":{"@id":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/#website"},"primaryImageOfPage":{"@id":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/reliability-engineers-what-its-like-to-recreate-data-center-disaster\/#primaryimage"},"image":{"@id":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/reliability-engineers-what-its-like-to-recreate-data-center-disaster\/#primaryimage"},"thumbnailUrl":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/files\/2016\/05\/Google-Site-Reliability-Engineers-What-its-like-to-Recreate-a-Data-Center-Disaster.jpg","datePublished":"2016-05-25T13:12:03+00:00","dateModified":"2016-10-20T14:11:57+00:00","author":{"@id":""},"description":"Imagine what's it like to\u00a0have\u00a0what may be the coolest job ever: a Google Site Reliability Engineer.","breadcrumb":{"@id":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/reliability-engineers-what-its-like-to-recreate-data-center-disaster\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/solutionsreview.com\/backup-disaster-recovery\/reliability-engineers-what-its-like-to-recreate-data-center-disaster\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/reliability-engineers-what-its-like-to-recreate-data-center-disaster\/#primaryimage","url":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/files\/2016\/05\/Google-Site-Reliability-Engineers-What-its-like-to-Recreate-a-Data-Center-Disaster.jpg","contentUrl":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/files\/2016\/05\/Google-Site-Reliability-Engineers-What-its-like-to-Recreate-a-Data-Center-Disaster.jpg","width":800,"height":350,"caption":"Google, Data recovery"},{"@type":"BreadcrumbList","@id":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/reliability-engineers-what-its-like-to-recreate-data-center-disaster\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/"},{"@type":"ListItem","position":2,"name":"Google Site Reliability Engineers: What it&#8217;s like to Recreate a Data Center Disaster"}]},{"@type":"WebSite","@id":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/#website","url":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/","name":"Best Backup and Disaster Recovery Tools, Software, Solutions &amp; Vendors","description":"Solutions Review","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"","url":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/author\/"}]}},"_links":{"self":[{"href":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/wp-json\/wp\/v2\/posts\/1582"}],"collection":[{"href":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/wp-json\/wp\/v2\/users\/29"}],"replies":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/wp-json\/wp\/v2\/comments?post=1582"}],"version-history":[{"count":0,"href":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/wp-json\/wp\/v2\/posts\/1582\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/wp-json\/wp\/v2\/media\/1585"}],"wp:attachment":[{"href":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/wp-json\/wp\/v2\/media?parent=1582"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/wp-json\/wp\/v2\/categories?post=1582"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/solutionsreview.com\/backup-disaster-recovery\/wp-json\/wp\/v2\/tags?post=1582"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}