{"id":1092,"date":"2015-09-25T11:55:44","date_gmt":"2015-09-25T15:55:44","guid":{"rendered":"https:\/\/solutionsreview.com\/data-integration\/?p=1092"},"modified":"2016-10-05T11:04:23","modified_gmt":"2016-10-05T15:04:23","slug":"google-tackles-big-data-with-new-cloud-dataproc-platform","status":"publish","type":"post","link":"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/","title":{"rendered":"Google Tackles Big Data With New Cloud Dataproc Platform"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1096\" src=\"https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/oie_25162816oTEAeoQC.jpg\" alt=\"Google Cloud Platform\" width=\"600\" height=\"270\" srcset=\"https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/oie_25162816oTEAeoQC.jpg 600w, https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/oie_25162816oTEAeoQC-300x135.jpg 300w\" sizes=\"(max-width: 600px) 100vw, 600px\" \/><\/p>\n<p>Google made news this week with the launch of Google Cloud Dataproc, a new infrastructure as a service offering that makes Spark and Hadoop easier, faster, and cheaper. The platform was launched in beta on Wednesday. The service lets users take advantage of open source data tools for batch processing, querying, streaming, and machine learning. In addition, Cloud Dataproc\u00a0allows for swift cluster creation with easy-to-manage tools that will help to save organizations money by turning off clusters that are not being used.<\/p>\n<p>James Malone, Product Manager at Google said this in a recent blog post about Cloud Dataproc: &#8220;Working with large datasets requires powerful tools, but too often those tools add new layers of complexity. To use your data efficiently, you need to minimize the time from data capture to insights. But concerns about deployment, scaling, monitoring, utilization, and cost can get in the way of what matters most: your data. With more data being generated each day, you have less time to peel back the layers of complexity around the tools you rely on for success. We think using powerful data tools should be easy as 1-2-3.&#8221;<\/p>\n<p>According to Google: &#8220;Cloud Dataproc minimizes the time you spend on administration and management.&#8221; Some of the features that make Cloud Dataproc intriguing compared to other competing cloud services include:<\/p>\n<p><strong><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-1097 alignleft\" src=\"https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/speed-guage-plain.png\" alt=\"Google Speed\" width=\"52\" height=\"53\" srcset=\"https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/speed-guage-plain.png 174w, https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/speed-guage-plain-70x70.png 70w, https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/speed-guage-plain-60x60.png 60w\" sizes=\"(max-width: 52px) 100vw, 52px\" \/>Fast and Scalable Data Processing<\/strong><\/p>\n<p>Cloud Dataproc clusters can be created quickly, resized at any time, and can integrate between three and hundreds of nodes and many machine types to alleviate any concerns with data pipelines outgrowing clusters. Users will have more time to focus on the insights and less on the infrastructure with each cluster action taking less than 90 seconds.<\/p>\n<p><strong>Affor<img loading=\"lazy\" decoding=\"async\" class=\"wp-image-1098 alignleft\" src=\"https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/penny-cloud-cpu.png\" alt=\"Penny Cloud\" width=\"62\" height=\"41\" srcset=\"https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/penny-cloud-cpu.png 241w, https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/penny-cloud-cpu-220x144.png 220w\" sizes=\"(max-width: 62px) 100vw, 62px\" \/>dable Pricing<br \/>\n<\/strong><\/p>\n<p>Google Cloud Dataproc has a low-cost and easy to understand price structure which is based\u00a0on actual use and is measured per minute. In addition, Cloud Dataproc clusters are equipped to include preemptible instances with lower computing prices, which give users powerful clusters at a reduced cost.<\/p>\n<p><strong><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-1099 alignleft\" src=\"https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/dataproc-integrations.png\" alt=\"Open Source\" width=\"66\" height=\"46\" srcset=\"https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/dataproc-integrations.png 291w, https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/dataproc-integrations-70x50.png 70w\" sizes=\"(max-width: 66px) 100vw, 66px\" \/>Open Source Ecosystem<\/strong><\/p>\n<p>Spark and Hadoop ecosystem provides tools, libraries, and documents that you can leverage with the Cloud Dataproc platform. Users can get started without needing to learn new tools or APIs because the platform offers frequently updated and native versions of Spark, Hadoop, Pig, and Hive. Conversely, existing projects or ETL pipelines can be moved without redevelopment.<\/p>\n<p>For more information, or to read Google&#8217;s introductory post about Google Cloud Dataproc, <a href=\"https:\/\/googlecloudplatform.blogspot.com\/2015\/09\/Google-Cloud-Dataproc-Making-Spark-and-Hadoop-Easier-Faster-and-Cheaper.html\" target=\"_blank\">click here<\/a>.<\/p>\n<br \/>Widget not in any sidebars<br \/>\n","protected":false},"excerpt":{"rendered":"<p>Google made news this week with the launch of Google Cloud Dataproc, a new infrastructure as a service offering that makes Spark and Hadoop easier, faster, and cheaper. The platform was launched in beta on Wednesday. The service lets users take advantage of open source data tools for batch processing, querying, streaming, and machine learning. [&hellip;]<\/p>\n","protected":false},"author":23,"featured_media":1095,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[3],"tags":[191,19,193,99,55,155],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Google Tackles Big Data With New Cloud Dataproc Platform<\/title>\n<meta name=\"description\" content=\"Google launched Google Cloud Dataproc, a new infrastructure as a service offering that makes Spark and Hadoop easier, faster, and cheaper.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Tim King\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/\"},\"author\":{\"name\":\"Tim King\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c\"},\"headline\":\"Google Tackles Big Data With New Cloud Dataproc Platform\",\"datePublished\":\"2015-09-25T15:55:44+00:00\",\"dateModified\":\"2016-10-05T15:04:23+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/\"},\"wordCount\":418,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#organization\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/oie_25161320gPlfuYII.png\",\"keywords\":[\"Alphabet\",\"Big Data\",\"Cloud Dataproc\",\"Google\",\"Hadoop\",\"Spark\"],\"articleSection\":[\"Data Integration News\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/\",\"name\":\"Google Tackles Big Data With New Cloud Dataproc Platform\",\"isPartOf\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/oie_25161320gPlfuYII.png\",\"datePublished\":\"2015-09-25T15:55:44+00:00\",\"dateModified\":\"2016-10-05T15:04:23+00:00\",\"description\":\"Google launched Google Cloud Dataproc, a new infrastructure as a service offering that makes Spark and Hadoop easier, faster, and cheaper.\",\"breadcrumb\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/#primaryimage\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/oie_25161320gPlfuYII.png\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/oie_25161320gPlfuYII.png\",\"width\":600,\"height\":270},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/solutionsreview.com\/data-integration\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Google Tackles Big Data With New Cloud Dataproc Platform\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#website\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/\",\"name\":\"Data Integration Tools &amp; ETL Software | Solutions Review\",\"description\":\"Evaluating Enterprise ETL Tools, Cloud iPaaS &amp; Real-Time Data Streaming Platforms.\",\"publisher\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/solutionsreview.com\/data-integration\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#organization\",\"name\":\"Solutions Review\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png\",\"width\":225,\"height\":90,\"caption\":\"Solutions Review\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c\",\"name\":\"Tim King\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2023\/12\/tk.jpg\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2023\/12\/tk.jpg\",\"caption\":\"Tim King\"},\"description\":\"Tim is Solutions Review's Executive Editor covering the human impact of AI on the future of work and learning. He is also the Media Strategist behind Insight Jam (1M+ on YouTube) events and programming. A 2017 and 2018 Most Influential Business Journalist and 2021 \\\"Who's Who\\\" in multiple categories, Tim is a recognized thought leader in enterprise tech and AI.\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/author\/timking\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Google Tackles Big Data With New Cloud Dataproc Platform","description":"Google launched Google Cloud Dataproc, a new infrastructure as a service offering that makes Spark and Hadoop easier, faster, and cheaper.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/","twitter_misc":{"Written by":"Tim King","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/#article","isPartOf":{"@id":"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/"},"author":{"name":"Tim King","@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c"},"headline":"Google Tackles Big Data With New Cloud Dataproc Platform","datePublished":"2015-09-25T15:55:44+00:00","dateModified":"2016-10-05T15:04:23+00:00","mainEntityOfPage":{"@id":"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/"},"wordCount":418,"commentCount":0,"publisher":{"@id":"https:\/\/solutionsreview.com\/data-integration\/#organization"},"image":{"@id":"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/#primaryimage"},"thumbnailUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/oie_25161320gPlfuYII.png","keywords":["Alphabet","Big Data","Cloud Dataproc","Google","Hadoop","Spark"],"articleSection":["Data Integration News"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/","url":"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/","name":"Google Tackles Big Data With New Cloud Dataproc Platform","isPartOf":{"@id":"https:\/\/solutionsreview.com\/data-integration\/#website"},"primaryImageOfPage":{"@id":"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/#primaryimage"},"image":{"@id":"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/#primaryimage"},"thumbnailUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/oie_25161320gPlfuYII.png","datePublished":"2015-09-25T15:55:44+00:00","dateModified":"2016-10-05T15:04:23+00:00","description":"Google launched Google Cloud Dataproc, a new infrastructure as a service offering that makes Spark and Hadoop easier, faster, and cheaper.","breadcrumb":{"@id":"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/#primaryimage","url":"https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/oie_25161320gPlfuYII.png","contentUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2015\/09\/oie_25161320gPlfuYII.png","width":600,"height":270},{"@type":"BreadcrumbList","@id":"https:\/\/solutionsreview.com\/data-integration\/google-tackles-big-data-with-new-cloud-dataproc-platform\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/solutionsreview.com\/data-integration\/"},{"@type":"ListItem","position":2,"name":"Google Tackles Big Data With New Cloud Dataproc Platform"}]},{"@type":"WebSite","@id":"https:\/\/solutionsreview.com\/data-integration\/#website","url":"https:\/\/solutionsreview.com\/data-integration\/","name":"Data Integration Tools &amp; ETL Software | Solutions Review","description":"Evaluating Enterprise ETL Tools, Cloud iPaaS &amp; Real-Time Data Streaming Platforms.","publisher":{"@id":"https:\/\/solutionsreview.com\/data-integration\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/solutionsreview.com\/data-integration\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/solutionsreview.com\/data-integration\/#organization","name":"Solutions Review","url":"https:\/\/solutionsreview.com\/data-integration\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/logo\/image\/","url":"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png","contentUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png","width":225,"height":90,"caption":"Solutions Review"},"image":{"@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c","name":"Tim King","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/image\/","url":"https:\/\/solutionsreview.com\/data-integration\/files\/2023\/12\/tk.jpg","contentUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2023\/12\/tk.jpg","caption":"Tim King"},"description":"Tim is Solutions Review's Executive Editor covering the human impact of AI on the future of work and learning. He is also the Media Strategist behind Insight Jam (1M+ on YouTube) events and programming. A 2017 and 2018 Most Influential Business Journalist and 2021 \"Who's Who\" in multiple categories, Tim is a recognized thought leader in enterprise tech and AI.","url":"https:\/\/solutionsreview.com\/data-integration\/author\/timking\/"}]}},"_links":{"self":[{"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/posts\/1092"}],"collection":[{"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/users\/23"}],"replies":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/comments?post=1092"}],"version-history":[{"count":0,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/posts\/1092\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/media\/1095"}],"wp:attachment":[{"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/media?parent=1092"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/categories?post=1092"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/tags?post=1092"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}