{"id":206,"date":"2016-06-15T20:59:29","date_gmt":"2016-06-15T20:59:29","guid":{"rendered":"https:\/\/solutionsreview.com\/data-management\/?p=206"},"modified":"2016-10-24T18:09:05","modified_gmt":"2016-10-24T18:09:05","slug":"data-lake-or-data-dump","status":"publish","type":"post","link":"https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/","title":{"rendered":"Data Lake or Data Dump?"},"content":{"rendered":"

\"Data<\/p>\n

Companies vary in their approach to Data Management. Some enterprises collect only a few types of data, thus the traditional data warehouse technique works quite well. For others, expanding sources from which they retain data is forcing them to change their\u00a0viewpoint, and they’ve moved over to collecting\u00a0all of their data into the Data Lake<\/a>. Now that we’ve covered the technological differences<\/a> between these two approaches, we need to have an extended look at how the composition of the Data Lake changes the way it is able to function.<\/p>\n

The benefits of the Data Lake<\/a> approach are numerous, and as data volumes continue to expand, companies are increasingly realizing the need for a more agile and unstructured way to manage enterprise data. Enter the Data Lake, a technology usually associated with the Hadoop platform that has taken the enterprise world by storm, with many of the top companies in the world investing. Data Lakes typically have very few to no regulatory functions, meaning that any size or scope of data can be collected. The companies that are finding this approach intriguing are the ones that collect data from non-conventional sources, including data from social media outlets and IoT product sensors, to name only two applications.<\/p>\n

In this way, the Data Lake enables the storage of data in its raw form, with virtually no limit as to how much data can sit in the waters at any one time. The data can be historical or streaming in real-time. This allows organizations to use data as it is funneled into the Data Lake or very far in the future.\u00a0Since data is collected straight from the source systems, companies don\u2019t have to put resources aside to regulate it.\u00a0The Data Lake enables digital businesses to go beyond the capabilities of data warehouses, but it does not come without added responsibility, and herein lies the crux of the\u00a0issue.<\/p>\n

\t\t\t

\"Download<\/a><\/p>\n<\/div>\n\t\t<\/div><\/div>\n

The Data Lake is\u00a0a breath of fresh air to many, especially those within an organization that regularly work with data and need the ability to run analysis on-demand, without waiting for IT. However, given the free spirited nature of what can be stored in the lake’s architecture, they\u00a0can quickly turn into data dumps. This comes as a result of the de-regulation of what can be stored, which can create headaches for those who need to query through potentially billions of records to find a single piece of information. So, Data Lakes were inherently developed to avoid large degrees of Data Governance – and this is a very big problem for those that take their data seriously.<\/p>\n

This unregulated “data dump” can also turn into a breeding ground for bad data, and not just data that doesn’t live up to an organization’s high standards. Think about it, if there’s no governance structure in place to vet what comes in, how can a business be sure that what is being dumped into their lake won’t potentially hurt them, let alone provide any long-standing business value? This is where security plays a bigger and bigger role as data volumes become in many cases, too much for companies to handle. Enterprises are trying to ensure that they can gain answers to the questions worth asking, but oftentimes, as a result of the structure of a Data Lake, wind up breaking compliance and regulatory rules as a result.<\/p>\n

This is where many organizations are running into trouble. They were pitched some admittedly great ideas by a vendor marketing team about how they would be able to full advantage of the Hadoop platform via their awesome new tool but live to find out that their connectors were really just dragging in data that will have no use for them in the present or future, with much of it being potentially hazardous to the health of their data infrastructure. On that same front, what makes the Data Lake unique is the fact that it can hold an undefined amount of unstructured data for an indefinite amount of time with very little oversight. Data architects and scientists remain in a conundrum as a result.<\/p>\n

Forward-thinking solution providers are undoubtedly aware of this murky situation, and what could differentiate one vendor from another in the not-so-distant future is which ones are able to provide the ability to collect and store overwhelming amounts of unstructured data but provide just enough governance and security to help ward off the trash that turns the Data Lake into a data dump. It’s a thin line to walk however, since too much regulation could wound\u00a0a technology which many data enthusiasts see as the future of Data Management. Data Lakes don’t yet allow data professionals who are accustomed to the too-structured data warehouse to have their cake and eat it too.<\/p>\n","protected":false},"excerpt":{"rendered":"

Companies vary in their approach to Data Management. Some enterprises collect only a few types of data, thus the traditional data warehouse technique works quite well. For others, expanding sources from which they retain data is forcing them to change their\u00a0viewpoint, and they’ve moved over to collecting\u00a0all of their data into the Data Lake. Now […]<\/p>\n","protected":false},"author":23,"featured_media":210,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[3],"tags":[39,70],"acf":[],"yoast_head":"\nData Lake or Data Dump?<\/title>\n<meta name=\"description\" content=\"Data Lakes typically have very few to no regulatory functions, meaning that any size or scope of data can be collected. This is a problem and a solution.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Data Lake or Data Dump?\" \/>\n<meta property=\"og:description\" content=\"Data Lakes typically have very few to no regulatory functions, meaning that any size or scope of data can be collected. This is a problem and a solution.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/\" \/>\n<meta property=\"og:site_name\" content=\"Data Management Software & Infrastructure | Solutions Review\" \/>\n<meta property=\"article:published_time\" content=\"2016-06-15T20:59:29+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2016-10-24T18:09:05+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_xeqDddu5mO3B.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"800\" \/>\n\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Tim King\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Tim King\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/\",\"url\":\"https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/\",\"name\":\"Data Lake or Data Dump?\",\"isPartOf\":{\"@id\":\"https:\/\/solutionsreview.com\/data-management\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_xeqDddu5mO3B.jpg\",\"datePublished\":\"2016-06-15T20:59:29+00:00\",\"dateModified\":\"2016-10-24T18:09:05+00:00\",\"author\":{\"@id\":\"https:\/\/solutionsreview.com\/data-management\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c\"},\"description\":\"Data Lakes typically have very few to no regulatory functions, meaning that any size or scope of data can be collected. This is a problem and a solution.\",\"breadcrumb\":{\"@id\":\"https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/#primaryimage\",\"url\":\"https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_xeqDddu5mO3B.jpg\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_xeqDddu5mO3B.jpg\",\"width\":800,\"height\":350},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/solutionsreview.com\/data-management\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Data Lake or Data Dump?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/solutionsreview.com\/data-management\/#website\",\"url\":\"https:\/\/solutionsreview.com\/data-management\/\",\"name\":\"Data Management Software & Infrastructure | Solutions Review\",\"description\":\"Evaluating Enterprise Master Data Management, Data Governance & Storage Tools.\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/solutionsreview.com\/data-management\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/solutionsreview.com\/data-management\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c\",\"name\":\"Tim King\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-management\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/solutionsreview.com\/data-management\/files\/2023\/12\/tk.jpg\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-management\/files\/2023\/12\/tk.jpg\",\"caption\":\"Tim King\"},\"description\":\"Tim is Solutions Review's Executive Editor covering the human impact of AI on the future of work and learning. He is also the Media Strategist behind Insight Jam (1M+ on YouTube) events and programming. A 2017 and 2018 Most Influential Business Journalist and 2021 \\\"Who's Who\\\" in multiple categories, Tim is a recognized thought leader in enterprise tech and AI.\",\"url\":\"https:\/\/solutionsreview.com\/data-management\/author\/timking\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Data Lake or Data Dump?","description":"Data Lakes typically have very few to no regulatory functions, meaning that any size or scope of data can be collected. This is a problem and a solution.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/","og_locale":"en_US","og_type":"article","og_title":"Data Lake or Data Dump?","og_description":"Data Lakes typically have very few to no regulatory functions, meaning that any size or scope of data can be collected. This is a problem and a solution.","og_url":"https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/","og_site_name":"Data Management Software & Infrastructure | Solutions Review","article_published_time":"2016-06-15T20:59:29+00:00","article_modified_time":"2016-10-24T18:09:05+00:00","og_image":[{"width":800,"height":350,"url":"https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_xeqDddu5mO3B.jpg","type":"image\/jpeg"}],"author":"Tim King","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Tim King","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/","url":"https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/","name":"Data Lake or Data Dump?","isPartOf":{"@id":"https:\/\/solutionsreview.com\/data-management\/#website"},"primaryImageOfPage":{"@id":"https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/#primaryimage"},"image":{"@id":"https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/#primaryimage"},"thumbnailUrl":"https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_xeqDddu5mO3B.jpg","datePublished":"2016-06-15T20:59:29+00:00","dateModified":"2016-10-24T18:09:05+00:00","author":{"@id":"https:\/\/solutionsreview.com\/data-management\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c"},"description":"Data Lakes typically have very few to no regulatory functions, meaning that any size or scope of data can be collected. This is a problem and a solution.","breadcrumb":{"@id":"https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/#primaryimage","url":"https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_xeqDddu5mO3B.jpg","contentUrl":"https:\/\/solutionsreview.com\/data-management\/files\/2016\/06\/oie_xeqDddu5mO3B.jpg","width":800,"height":350},{"@type":"BreadcrumbList","@id":"https:\/\/solutionsreview.com\/data-management\/data-lake-or-data-dump\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/solutionsreview.com\/data-management\/"},{"@type":"ListItem","position":2,"name":"Data Lake or Data Dump?"}]},{"@type":"WebSite","@id":"https:\/\/solutionsreview.com\/data-management\/#website","url":"https:\/\/solutionsreview.com\/data-management\/","name":"Data Management Software & Infrastructure | Solutions Review","description":"Evaluating Enterprise Master Data Management, Data Governance & Storage Tools.","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/solutionsreview.com\/data-management\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/solutionsreview.com\/data-management\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c","name":"Tim King","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-management\/#\/schema\/person\/image\/","url":"https:\/\/solutionsreview.com\/data-management\/files\/2023\/12\/tk.jpg","contentUrl":"https:\/\/solutionsreview.com\/data-management\/files\/2023\/12\/tk.jpg","caption":"Tim King"},"description":"Tim is Solutions Review's Executive Editor covering the human impact of AI on the future of work and learning. He is also the Media Strategist behind Insight Jam (1M+ on YouTube) events and programming. A 2017 and 2018 Most Influential Business Journalist and 2021 \"Who's Who\" in multiple categories, Tim is a recognized thought leader in enterprise tech and AI.","url":"https:\/\/solutionsreview.com\/data-management\/author\/timking\/"}]}},"_links":{"self":[{"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/posts\/206"}],"collection":[{"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/users\/23"}],"replies":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/comments?post=206"}],"version-history":[{"count":0,"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/posts\/206\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/media\/210"}],"wp:attachment":[{"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/media?parent=206"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/categories?post=206"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/solutionsreview.com\/data-management\/wp-json\/wp\/v2\/tags?post=206"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}