{"id":237,"date":"2016-06-22T19:59:52","date_gmt":"2016-06-22T19:59:52","guid":{"rendered":"https:\/\/solutionsreview.com\/data-management\/?p=237"},"modified":"2016-10-24T18:13:57","modified_gmt":"2016-10-24T18:13:57","slug":"survey-data-management-bogged-down-by-data-pollution","status":"publish","type":"post","link":"https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/","title":{"rendered":"Survey: Data Management Bogged Down by Data Pollution"},"content":{"rendered":"<p style=\"text-align: justify\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-239\" src=\"https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_7OlpMqlaYPaT.jpg\" alt=\"Data Pollution\" width=\"800\" height=\"350\" srcset=\"https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_7OlpMqlaYPaT.jpg 800w, https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_7OlpMqlaYPaT-300x131.jpg 300w, https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_7OlpMqlaYPaT-768x336.jpg 768w, https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_7OlpMqlaYPaT-600x263.jpg 600w, https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_7OlpMqlaYPaT-180x79.jpg 180w, https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_7OlpMqlaYPaT-400x175.jpg 400w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/><\/p>\n<p style=\"text-align: justify\">In a <a href=\"https:\/\/www.marketwired.com\/press-release\/big-data-or-bad-data-survey-shows-enterprises-struggle-to-manage-big-data-flows-2136589.htm\" target=\"_blank\">recent release<\/a>, StreamSets, a vendor that delivers <a href=\"https:\/\/streamsets.com\/\" target=\"_blank\">performance management for data flows <\/a>announced the results from a <a href=\"https:\/\/streamsets.com\/big-data-global-survey\/\" target=\"_blank\">global survey<\/a> of over 300 professionals in the <a href=\"https:\/\/solutionsreview.com\/data-management\/\" target=\"_blank\">Data Management space<\/a>. The survey was conducted by <a href=\"https:\/\/www.dimensiondata.com\/en-US\/Pages\/NewHomePage1.aspx\" target=\"_blank\">Dimensional Data<\/a>, an independent research firm. According to the results of the survey, enterprises are increasingly being challenged on a wide range of key data performance management issues as a result of failing to stop bad data from interrupting the operational efficiency of data flows. As a result, 90 percent of those who took part in the survey reported that bad data has flown into their data stores. On the flip side of the coin, only 12 percent consider that they are doing a good job at data flow performance management.<\/p>\n<p style=\"text-align: justify\">As a result of all this bad data, data pollution has become a major threat to enterprise analytics. If enterprises run analytics on data that they fail to recognize as polluted, the insights generated as a result will lead them down the wrong paths.\u00a0With real-time and streaming analytics via self-service methods quickly becoming the new normal in the enterprise, data professionals simply do not have the time or resources to spend on data quality that they once did. The results can become catastrophic, as clean data is the first step in generating worthwhile insights that create true business value.<\/p>\n<p style=\"text-align: justify\">Additional report highlights include:<\/p>\n<ul>\n<li style=\"text-align: justify\">68 percent noted that data quality was the most common challenge they faced when managing Big Data flows<\/li>\n<li style=\"text-align: justify\">74 percent of respondents reported having bad data in their stored currently, despite cleansing it throughout its lifecycle<\/li>\n<li style=\"text-align: justify\">Nearly two-thirds still use legacy ETL integration tools and 77 percent use hand-coding to design their data pipelines<\/li>\n<li style=\"text-align: justify\">The only metric where a large majority felt positively about their capabilities was in detecting a down pipeline, with 66 percent saying they were comfortable in identifying this issue<\/li>\n<\/ul>\n<p style=\"text-align: justify\">Girish Pancha, CEO at StreamSets, concludes: &#8220;In today&#8217;s world of real-time analytics, data flows are the lifeblood of an enterprise.\u00a0The industry has long been fixated on managing data at rest and this myopia creates a real risk for enterprises as they attempt to harness big and fast data. It is imperative that we shift our mindset towards building continuous data operations capabilities that are in tune with the time-sensitive, dynamic nature of today&#8217;s data.&#8221;<\/p>\n<p><a href=\"https:\/\/streamsets.com\/big-data-global-survey\/\" target=\"_blank\">Click here to read the survey\u00a0in full.<\/a><\/p>\n<div class=\"widget\"><div class=\"aside-card\">\t\t\t<div class=\"textwidget\"><p><a class=\"speedbump\" href=\"https:\/\/solutionsreview.com\/data-management\/data-management-data-warehouse-buyers-guide\/\" title=\"Download link to Data Management Buyers Guide\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" class=\"alignleft size-full wp-image-1682\" src=\"https:\/\/solutionsreview.com\/data-management\/files\/2019\/01\/data-management-speedbump-cta.jpg\" alt=\"Download Link to Data Management Buyers Guide\" width=\"800\" height=\"225\" \/><\/a><\/p>\n<\/div>\n\t\t<\/div><\/div>\n","protected":false},"excerpt":{"rendered":"<p>In a recent release, StreamSets, a vendor that delivers performance management for data flows announced the results from a global survey of over 300 professionals in the Data Management space. The survey was conducted by Dimensional Data, an independent research firm. According to the results of the survey, enterprises are increasingly being challenged on a [&hellip;]<\/p>\n","protected":false},"author":23,"featured_media":239,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[3],"tags":[73,81,80,79],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Survey: Data Management Bogged Down by Data Pollution<\/title>\n<meta name=\"description\" content=\"A new survey reveals that Data Management professionals are having trouble ridding their data stores of polluted data.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Survey: Data Management Bogged Down by Data Pollution\" \/>\n<meta property=\"og:description\" content=\"A new survey reveals that Data Management professionals are having trouble ridding their data stores of polluted data.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/\" \/>\n<meta property=\"og:site_name\" content=\"Data Management Software &amp; Infrastructure | Solutions Review\" \/>\n<meta property=\"article:published_time\" content=\"2016-06-22T19:59:52+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2016-10-24T18:13:57+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_7OlpMqlaYPaT.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"800\" \/>\n\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Tim King\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Tim King\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/\",\"url\":\"https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/\",\"name\":\"Survey: Data Management Bogged Down by Data Pollution\",\"isPartOf\":{\"@id\":\"https:\/\/solutionsreview.com\/data-management\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_7OlpMqlaYPaT.jpg\",\"datePublished\":\"2016-06-22T19:59:52+00:00\",\"dateModified\":\"2016-10-24T18:13:57+00:00\",\"author\":{\"@id\":\"https:\/\/solutionsreview.com\/data-management\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c\"},\"description\":\"A new survey reveals that Data Management professionals are having trouble ridding their data stores of polluted data.\",\"breadcrumb\":{\"@id\":\"https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/#primaryimage\",\"url\":\"https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_7OlpMqlaYPaT.jpg\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_7OlpMqlaYPaT.jpg\",\"width\":800,\"height\":350},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/solutionsreview.com\/data-management\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Survey: Data Management Bogged Down by Data Pollution\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/solutionsreview.com\/data-management\/#website\",\"url\":\"https:\/\/solutionsreview.com\/data-management\/\",\"name\":\"Data Management Software &amp; Infrastructure | Solutions Review\",\"description\":\"Evaluating Enterprise Master Data Management, Data Governance &amp; Storage Tools.\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/solutionsreview.com\/data-management\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/solutionsreview.com\/data-management\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c\",\"name\":\"Tim King\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-management\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/solutionsreview.com\/data-management\/files\/2023\/12\/tk.jpg\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-management\/files\/2023\/12\/tk.jpg\",\"caption\":\"Tim King\"},\"description\":\"Tim is Solutions Review's Executive Editor covering the human impact of AI on the future of work and learning. He is also the Media Strategist behind Insight Jam (1M+ on YouTube) events and programming. A 2017 and 2018 Most Influential Business Journalist and 2021 \\\"Who's Who\\\" in multiple categories, Tim is a recognized thought leader in enterprise tech and AI.\",\"url\":\"https:\/\/solutionsreview.com\/data-management\/author\/timking\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Survey: Data Management Bogged Down by Data Pollution","description":"A new survey reveals that Data Management professionals are having trouble ridding their data stores of polluted data.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/","og_locale":"en_US","og_type":"article","og_title":"Survey: Data Management Bogged Down by Data Pollution","og_description":"A new survey reveals that Data Management professionals are having trouble ridding their data stores of polluted data.","og_url":"https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/","og_site_name":"Data Management Software &amp; Infrastructure | Solutions Review","article_published_time":"2016-06-22T19:59:52+00:00","article_modified_time":"2016-10-24T18:13:57+00:00","og_image":[{"width":800,"height":350,"url":"https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_7OlpMqlaYPaT.jpg","type":"image\/jpeg"}],"author":"Tim King","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Tim King","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/","url":"https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/","name":"Survey: Data Management Bogged Down by Data Pollution","isPartOf":{"@id":"https:\/\/solutionsreview.com\/data-management\/#website"},"primaryImageOfPage":{"@id":"https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/#primaryimage"},"image":{"@id":"https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/#primaryimage"},"thumbnailUrl":"https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_7OlpMqlaYPaT.jpg","datePublished":"2016-06-22T19:59:52+00:00","dateModified":"2016-10-24T18:13:57+00:00","author":{"@id":"https:\/\/solutionsreview.com\/data-management\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c"},"description":"A new survey reveals that Data Management professionals are having trouble ridding their data stores of polluted data.","breadcrumb":{"@id":"https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/#primaryimage","url":"https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_7OlpMqlaYPaT.jpg","contentUrl":"https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_7OlpMqlaYPaT.jpg","width":800,"height":350},{"@type":"BreadcrumbList","@id":"https:\/\/solutionsreview.com\/data-management\/survey-data-management-bogged-down-by-data-pollution\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/solutionsreview.com\/data-management\/"},{"@type":"ListItem","position":2,"name":"Survey: Data Management Bogged Down by Data Pollution"}]},{"@type":"WebSite","@id":"https:\/\/solutionsreview.com\/data-management\/#website","url":"https:\/\/solutionsreview.com\/data-management\/","name":"Data Management Software &amp; Infrastructure | Solutions Review","description":"Evaluating Enterprise Master Data Management, Data Governance &amp; Storage Tools.","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/solutionsreview.com\/data-management\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/solutionsreview.com\/data-management\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c","name":"Tim King","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-management\/#\/schema\/person\/image\/","url":"https:\/\/solutionsreview.com\/data-management\/files\/2023\/12\/tk.jpg","contentUrl":"https:\/\/solutionsreview.com\/data-management\/files\/2023\/12\/tk.jpg","caption":"Tim King"},"description":"Tim is Solutions Review's Executive Editor covering the human impact of AI on the future of work and learning. He is also the Media Strategist behind Insight Jam (1M+ on YouTube) events and programming. A 2017 and 2018 Most Influential Business Journalist and 2021 \"Who's Who\" in multiple categories, Tim is a recognized thought leader in enterprise tech and AI.","url":"https:\/\/solutionsreview.com\/data-management\/author\/timking\/"}]}},"_links":{"self":[{"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/posts\/237"}],"collection":[{"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/users\/23"}],"replies":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/comments?post=237"}],"version-history":[{"count":0,"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/posts\/237\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/media\/239"}],"wp:attachment":[{"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/media?parent=237"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/categories?post=237"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/tags?post=237"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}