{"id":2429,"date":"2020-08-21T14:20:11","date_gmt":"2020-08-21T18:20:11","guid":{"rendered":"https:\/\/solutionsreview.com\/data-management\/?p=2429"},"modified":"2020-08-21T14:25:22","modified_gmt":"2020-08-21T18:25:22","slug":"qubole-pipelines-service-enables-streaming-data-pipeline-building","status":"publish","type":"post","link":"https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/","title":{"rendered":"Qubole Pipelines Service Enables Streaming Data Pipeline Building"},"content":{"rendered":"
\"Qubole

Source: Qubole<\/p><\/div>\n

Qubole recently announced the launch of Qubole Pipelines Service, a new solution that enables users to build scalable streaming data pipelines. The offering lets customers build, test, deploy, monitor and manage streaming data pipelines in a single platform. Qubole Pipelines Service is designed to augment an organization’s existing data lake in a manged environment via the public cloud of their choice.<\/p>\n

Our Buyer’s Guide for Data Management Platforms<\/em><\/a> helps you evaluate the best solution for your use case and features profiles of the leading providers, as well as a category overview of the marketplace.<\/div>\n

Named to the 2020 DBTA 100 and featured in our list of Data Management Vendors Our Editors Are Tracking<\/em><\/a>, Qubole adds in its official press release<\/a>: “With Qubole Pipelines Service, businesses can complement their existing data lake with advanced features that help them instantly capture streaming data from various sources, accelerate development of streaming applications and run highly reliable and observable production applications at the lowest cost.”<\/p>\n

Qubole Pipelines Service includes a number of built-in connectors, a code generation wizard, dry run framework, and quick-start options that help hasten development. A pipeline can be developed “within a few minutes” without the user having to write any code. Qubole’s newest innovation utilizes Apache Spark Structured Streaming. Qubole has added enhancements like Rocksdb slate storage, direct writes, and memory pressure scheduling for reliability in building and deploying long-running streaming applications.<\/p>\n

The solution touts a broad set of APIs and user interfaces for engineers to manage the streaming application lifecycle. Data management and consistency come via Qubole’s ACID framework to compact small files in the background while allowing concurrent read \/ write operations that don’t hinder performance.<\/p>\n

In a statement about the news, Qubole co-founder and CTO Joydeep Sarma said: “The arrival of Pipelines Service not only equips data teams and engineers with the most comprehensive solution to quickly build streaming data pipelines and analyze massive streams of data And it also underscores Qubole\u2019s longstanding tradition of providing businesses with an open data lake platform for batch and streaming analytics.”<\/p>\n

Qubole Pipelines Services is now available on AWS, Google Cloud, and Microsoft Azure.<\/p>\n

Learn more about Qubole Pipeline Services<\/a>.<\/p>\n

<\/div><\/p>\n

\t\t\t

\"Download<\/a><\/p>\n<\/div>\n\t\t<\/div><\/div><\/p>\n","protected":false},"excerpt":{"rendered":"

Qubole recently announced the launch of Qubole Pipelines Service, a new solution that enables users to build scalable streaming data pipelines. The offering lets customers build, test, deploy, monitor and manage streaming data pipelines in a single platform. Qubole Pipelines Service is designed to augment an organization’s existing data lake in a manged environment via […]<\/p>\n","protected":false},"author":23,"featured_media":2431,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[1],"tags":[809,279,808],"acf":[],"yoast_head":"\nQubole Pipelines Service Enables Streaming Data Pipeline Building<\/title>\n<meta name=\"description\" content=\"Qubole recently announced the launch of Qubole Pipelines Service, a new solution that enables users to build scalable streaming data pipelines.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Qubole Pipelines Service Enables Streaming Data Pipeline Building\" \/>\n<meta property=\"og:description\" content=\"Qubole recently announced the launch of Qubole Pipelines Service, a new solution that enables users to build scalable streaming data pipelines.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/\" \/>\n<meta property=\"og:site_name\" content=\"Best Data Management Software, Vendors and Data Science Platforms\" \/>\n<meta property=\"article:published_time\" content=\"2020-08-21T18:20:11+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-08-21T18:25:22+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/solutionsreview.com\/data-management\/files\/2020\/08\/oie_oEqZAFTE9Uoe.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"799\" \/>\n\t<meta property=\"og:image:height\" content=\"400\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Tim King\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Tim King\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/\",\"url\":\"https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/\",\"name\":\"Qubole Pipelines Service Enables Streaming Data Pipeline Building\",\"isPartOf\":{\"@id\":\"https:\/\/solutionsreview.com\/data-management\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/solutionsreview.com\/data-management\/files\/2020\/08\/oie_oEqZAFTE9Uoe.jpg\",\"datePublished\":\"2020-08-21T18:20:11+00:00\",\"dateModified\":\"2020-08-21T18:25:22+00:00\",\"author\":{\"@id\":\"https:\/\/solutionsreview.com\/data-management\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c\"},\"description\":\"Qubole recently announced the launch of Qubole Pipelines Service, a new solution that enables users to build scalable streaming data pipelines.\",\"breadcrumb\":{\"@id\":\"https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/#primaryimage\",\"url\":\"https:\/\/solutionsreview.com\/data-management\/files\/2020\/08\/oie_oEqZAFTE9Uoe.jpg\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-management\/files\/2020\/08\/oie_oEqZAFTE9Uoe.jpg\",\"width\":799,\"height\":400,\"caption\":\"Source: Qubole\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/solutionsreview.com\/data-management\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Qubole Pipelines Service Enables Streaming Data Pipeline Building\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/solutionsreview.com\/data-management\/#website\",\"url\":\"https:\/\/solutionsreview.com\/data-management\/\",\"name\":\"Best Data Management Software, Vendors and Data Science Platforms\",\"description\":\"Enterprise Information Management\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/solutionsreview.com\/data-management\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/solutionsreview.com\/data-management\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c\",\"name\":\"Tim King\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-management\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/solutionsreview.com\/data-management\/files\/2023\/12\/tk.jpg\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-management\/files\/2023\/12\/tk.jpg\",\"caption\":\"Tim King\"},\"description\":\"Tim is Solutions Review's Executive Editor and leads coverage on data management and analytics. A 2017 and 2018 Most Influential Business Journalist and 2021 \\\"Who's Who\\\" in Data Management, Tim is a recognized industry thought leader and changemaker. Story? Reach him via email at tking@solutionsreview.com.\",\"url\":\"https:\/\/solutionsreview.com\/data-management\/author\/timking\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Qubole Pipelines Service Enables Streaming Data Pipeline Building","description":"Qubole recently announced the launch of Qubole Pipelines Service, a new solution that enables users to build scalable streaming data pipelines.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/","og_locale":"en_US","og_type":"article","og_title":"Qubole Pipelines Service Enables Streaming Data Pipeline Building","og_description":"Qubole recently announced the launch of Qubole Pipelines Service, a new solution that enables users to build scalable streaming data pipelines.","og_url":"https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/","og_site_name":"Best Data Management Software, Vendors and Data Science Platforms","article_published_time":"2020-08-21T18:20:11+00:00","article_modified_time":"2020-08-21T18:25:22+00:00","og_image":[{"width":799,"height":400,"url":"https:\/\/solutionsreview.com\/data-management\/files\/2020\/08\/oie_oEqZAFTE9Uoe.jpg","type":"image\/jpeg"}],"author":"Tim King","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Tim King","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/","url":"https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/","name":"Qubole Pipelines Service Enables Streaming Data Pipeline Building","isPartOf":{"@id":"https:\/\/solutionsreview.com\/data-management\/#website"},"primaryImageOfPage":{"@id":"https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/#primaryimage"},"image":{"@id":"https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/#primaryimage"},"thumbnailUrl":"https:\/\/solutionsreview.com\/data-management\/files\/2020\/08\/oie_oEqZAFTE9Uoe.jpg","datePublished":"2020-08-21T18:20:11+00:00","dateModified":"2020-08-21T18:25:22+00:00","author":{"@id":"https:\/\/solutionsreview.com\/data-management\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c"},"description":"Qubole recently announced the launch of Qubole Pipelines Service, a new solution that enables users to build scalable streaming data pipelines.","breadcrumb":{"@id":"https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/#primaryimage","url":"https:\/\/solutionsreview.com\/data-management\/files\/2020\/08\/oie_oEqZAFTE9Uoe.jpg","contentUrl":"https:\/\/solutionsreview.com\/data-management\/files\/2020\/08\/oie_oEqZAFTE9Uoe.jpg","width":799,"height":400,"caption":"Source: Qubole"},{"@type":"BreadcrumbList","@id":"https:\/\/solutionsreview.com\/data-management\/qubole-pipelines-service-enables-streaming-data-pipeline-building\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/solutionsreview.com\/data-management\/"},{"@type":"ListItem","position":2,"name":"Qubole Pipelines Service Enables Streaming Data Pipeline Building"}]},{"@type":"WebSite","@id":"https:\/\/solutionsreview.com\/data-management\/#website","url":"https:\/\/solutionsreview.com\/data-management\/","name":"Best Data Management Software, Vendors and Data Science Platforms","description":"Enterprise Information Management","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/solutionsreview.com\/data-management\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/solutionsreview.com\/data-management\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c","name":"Tim King","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-management\/#\/schema\/person\/image\/","url":"https:\/\/solutionsreview.com\/data-management\/files\/2023\/12\/tk.jpg","contentUrl":"https:\/\/solutionsreview.com\/data-management\/files\/2023\/12\/tk.jpg","caption":"Tim King"},"description":"Tim is Solutions Review's Executive Editor and leads coverage on data management and analytics. A 2017 and 2018 Most Influential Business Journalist and 2021 \"Who's Who\" in Data Management, Tim is a recognized industry thought leader and changemaker. Story? Reach him via email at tking@solutionsreview.com.","url":"https:\/\/solutionsreview.com\/data-management\/author\/timking\/"}]}},"_links":{"self":[{"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/posts\/2429"}],"collection":[{"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/users\/23"}],"replies":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/comments?post=2429"}],"version-history":[{"count":0,"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/posts\/2429\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/media\/2431"}],"wp:attachment":[{"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/media?parent=2429"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/categories?post=2429"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/tags?post=2429"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}