{"id":832,"date":"2016-03-03T04:45:46","date_gmt":"2016-03-03T09:45:46","guid":{"rendered":"https:\/\/solutionsreview.com\/data-integration\/?p=832"},"modified":"2018-03-21T16:42:24","modified_gmt":"2018-03-21T20:42:24","slug":"the-emergence-of-data-lake-pros-and-cons","status":"publish","type":"post","link":"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/","title":{"rendered":"The Emergence of Data Lake: Pros and Cons"},"content":{"rendered":"

\"Data<\/p>\n

The concept of the Data Lake is shrouded in mystery, what is it? Is there some kind of Loch Ness data monster swimming around at the bottom of it?<\/p>\n

As a term, Data Lake is being defined as it develops. But simply, a Data Lake holds raw data in its native format for later use. Pentaho<\/a>‘s CTO James Dixon is credited with inventing the term. The practice has grown in popularity recently, and is used heavily in Big Data initiatives. As a tool, Data Lake is disrupting the Data Integration market and helping to redefine the way enterprises handle their data. Providing a more in-depth definition, a Data Lake stores disparate information while ignoring almost everything. Unlike a data warehouse or datamart, which is a small slice of a data warehouse that users extract their data from, the lake pays no attention to how or when its data will be used, governed, defined or secured.<\/p>\n

Big Data initiatives have begun to use\u00a0Data Lakes much more of late because a Data Lake holds all of its data in an unstructured, unorganized format. The data is not specialized, meaning that it can be manipulated in a variety of ways. In lots of cases, Big Data works better in this way. In the past, data warehouses were sufficient storage areas for data because they were organized better, and that’s still true. However, it becomes difficult for data scientists to uncover insights when data is pre-organized.\u00a0Sure, it may take longer to get from point A to point B, but what the Data Lake has going for it is that all of the information stored within it is available at any given time, in its native format.<\/p>\n

In a competitive world where every scrap of data matters, the Data Lake can be intriguing. Considering that the Internet of Things is the next big topic in Data Integration, its popularity should continue to grow. The Data Lake is not limited to specific, static structures like a data warehouse is. Further, in using a Data Lake, one can dictate the kinds of analysis that are possible using that data, not the other way around.<\/p>\n

\t\t\t

\"Download<\/a><\/p>\n<\/div>\n\t\t<\/div><\/div><\/p>\n

Not everything is perfect at the lake, however. While it does allow for more advanced searching of larger volumes of data, there are no unique identifiers. The extractor has to start from scratch in order to create a new data analysis since there is no metadata. It’s a lot more difficult to search through a pool of unfiltered data when nothing has a category or class designation. In short, gaining value from a Data Lake is difficult.<\/p>\n

Since the data cannot be defined, there is no oversight as to what exactly is being dumped into a lake. Is the data useful? No one knows until it is analyzed. At least in the use of a data warehouse, data can be organized by quality. Here, it’s all meshed together. This also raises security concerns. If no one knows what kind of data resides in the lake, they might not find out that some of it is corrupt until it’s too late. Shortcomings in this space are important to note, as organizations have\u00a0started using this technology with no real push for security measures. Compromises in security need to be addressed.<\/p>\n

Business Intelligence tools have a tough time sifting through all the mud at the bottom of the lake. BI solutions, for the most part, are engineered to analyze organized data. They simply don’t function at a high level when asked to take on the task of completely unstructured information. Though data warehouses provide a lot less raw data, they are drastically\u00a0more defined. One of the biggest problems in the Data Integration space to begin with was a skills gap. The use of the data lake requires more highly-skilled integrators, something that may not be available for quite some time.<\/p>\n

In a recent post, Gartner warned against falling into the “Data Lake Fallacy.”<\/a>\u00a0Their viewpoint was clear: enterprises need to be careful of jumping right into Data Lakes and using them as their main integration source for analytics. They argue that while there are benefits, the industry has yet to adapt, and applications within the enterprise environment are uncertain at this point.<\/p>\n

Andrew White, VP of Gartner writes: “The need for increased agility and accessibility for data analysis is the primary driver for Data Lakes. Nevertheless, while it is certainly true that Data Lakes can provide value to various parts of the organization, the proposition of enterprise-wide data management has yet to be realized.”<\/p>\n

The industry has started to latch on to the Data Lake initiative. Informatica has just joined forces with Pivotal and Capgemini to put forth a Data Lake program they call Business Data Lake<\/a>, a solution that aims to reign in the Data Lake and make it usable for a wider audience of businesses.<\/p>\n

They describe the initiative: “Current Big Data solutions face limitations and are not comprehensive enough to support the data pipelines and real-time capabilities required for operational systems and often do not meet the required levels of data governance, quality and security. The Business Data Lake addresses these issues and helps businesses leverage their data in a way that makes sense, from both an individual and business perspective, rather than just a single enterprise view.”<\/p>\n

One has to think that Data Lakes will continue to grow in popularity as the Internet of Things boom looms<\/a> and all its connected devices begin to stream into the marketplace. For now though, it seems safer to store data outside of the lake, citing the concerns outlined above. It doesn’t look like Data Lakes will make warehouses obsolete any time soon, at least until someone finds a way to provide enough organization and security to them to make them worthwhile for medium-sized initiatives. But if someone\u00a0swoops in to organize and secure the Data Lakes, won’t that just make them Big Data warehouses?<\/p>\n

Read Forrester’s report for delivering governed Data Analytics at scale.<\/a><\/span><\/strong><\/p>\n
Widget not in any sidebars
\n","protected":false},"excerpt":{"rendered":"

The concept of the Data Lake is shrouded in mystery, what is it? Is there some kind of Loch Ness data monster swimming around at the bottom of it? As a term, Data Lake is being defined as it develops. But simply, a Data Lake holds raw data in its native format for later use. […]<\/p>\n","protected":false},"author":23,"featured_media":1550,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[1,251,252],"tags":[19,37,39,24,22,41,38],"acf":[],"yoast_head":"\nThe Emergence of Data Lake: Pros and Cons<\/title>\n<meta name=\"description\" content=\"As more and more data comes flowing in, it will be interesting to see if companies turn to the Data Lakes to meet their needs, regardless of the risks.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Tim King\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/\"},\"author\":{\"name\":\"Tim King\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c\"},\"headline\":\"The Emergence of Data Lake: Pros and Cons\",\"datePublished\":\"2016-03-03T09:45:46+00:00\",\"dateModified\":\"2018-03-21T20:42:24+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/\"},\"wordCount\":1028,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#organization\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/03\/oie_920156Ab8lppGz.jpg\",\"keywords\":[\"Big Data\",\"Data Lake\",\"Gartner\",\"Informatica\",\"Internet of Things\",\"Pentaho\",\"Pivotal\"],\"articleSection\":[\"Best Practices\",\"Featured\",\"Staff Pick\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/\",\"name\":\"The Emergence of Data Lake: Pros and Cons\",\"isPartOf\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/03\/oie_920156Ab8lppGz.jpg\",\"datePublished\":\"2016-03-03T09:45:46+00:00\",\"dateModified\":\"2018-03-21T20:42:24+00:00\",\"description\":\"As more and more data comes flowing in, it will be interesting to see if companies turn to the Data Lakes to meet their needs, regardless of the risks.\",\"breadcrumb\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/#primaryimage\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/03\/oie_920156Ab8lppGz.jpg\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/03\/oie_920156Ab8lppGz.jpg\",\"width\":800,\"height\":350},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/solutionsreview.com\/data-integration\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The Emergence of Data Lake: Pros and Cons\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#website\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/\",\"name\":\"Best Data Integration Vendors, News & Reviews for Big Data, Applications, ETL and Hadoop\",\"description\":\"Data Integration Buyers Guide and Best Practices\",\"publisher\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/solutionsreview.com\/data-integration\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#organization\",\"name\":\"Solutions Review\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png\",\"width\":225,\"height\":90,\"caption\":\"Solutions Review\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c\",\"name\":\"Tim King\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2023\/12\/tk.jpg\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2023\/12\/tk.jpg\",\"caption\":\"Tim King\"},\"description\":\"Tim is Solutions Review's Executive Editor covering the human impact of AI on the future of work and learning. He is also the Media Strategist behind Insight Jam (1M+ on YouTube) events and programming. A 2017 and 2018 Most Influential Business Journalist and 2021 \\\"Who's Who\\\" in multiple categories, Tim is a recognized thought leader in enterprise tech and AI.\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/author\/timking\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The Emergence of Data Lake: Pros and Cons","description":"As more and more data comes flowing in, it will be interesting to see if companies turn to the Data Lakes to meet their needs, regardless of the risks.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/","twitter_misc":{"Written by":"Tim King","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/#article","isPartOf":{"@id":"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/"},"author":{"name":"Tim King","@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c"},"headline":"The Emergence of Data Lake: Pros and Cons","datePublished":"2016-03-03T09:45:46+00:00","dateModified":"2018-03-21T20:42:24+00:00","mainEntityOfPage":{"@id":"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/"},"wordCount":1028,"commentCount":0,"publisher":{"@id":"https:\/\/solutionsreview.com\/data-integration\/#organization"},"image":{"@id":"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/#primaryimage"},"thumbnailUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/03\/oie_920156Ab8lppGz.jpg","keywords":["Big Data","Data Lake","Gartner","Informatica","Internet of Things","Pentaho","Pivotal"],"articleSection":["Best Practices","Featured","Staff Pick"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/","url":"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/","name":"The Emergence of Data Lake: Pros and Cons","isPartOf":{"@id":"https:\/\/solutionsreview.com\/data-integration\/#website"},"primaryImageOfPage":{"@id":"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/#primaryimage"},"image":{"@id":"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/#primaryimage"},"thumbnailUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/03\/oie_920156Ab8lppGz.jpg","datePublished":"2016-03-03T09:45:46+00:00","dateModified":"2018-03-21T20:42:24+00:00","description":"As more and more data comes flowing in, it will be interesting to see if companies turn to the Data Lakes to meet their needs, regardless of the risks.","breadcrumb":{"@id":"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/#primaryimage","url":"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/03\/oie_920156Ab8lppGz.jpg","contentUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/03\/oie_920156Ab8lppGz.jpg","width":800,"height":350},{"@type":"BreadcrumbList","@id":"https:\/\/solutionsreview.com\/data-integration\/the-emergence-of-data-lake-pros-and-cons\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/solutionsreview.com\/data-integration\/"},{"@type":"ListItem","position":2,"name":"The Emergence of Data Lake: Pros and Cons"}]},{"@type":"WebSite","@id":"https:\/\/solutionsreview.com\/data-integration\/#website","url":"https:\/\/solutionsreview.com\/data-integration\/","name":"Best Data Integration Vendors, News & Reviews for Big Data, Applications, ETL and Hadoop","description":"Data Integration Buyers Guide and Best Practices","publisher":{"@id":"https:\/\/solutionsreview.com\/data-integration\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/solutionsreview.com\/data-integration\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/solutionsreview.com\/data-integration\/#organization","name":"Solutions Review","url":"https:\/\/solutionsreview.com\/data-integration\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/logo\/image\/","url":"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png","contentUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png","width":225,"height":90,"caption":"Solutions Review"},"image":{"@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c","name":"Tim King","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/image\/","url":"https:\/\/solutionsreview.com\/data-integration\/files\/2023\/12\/tk.jpg","contentUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2023\/12\/tk.jpg","caption":"Tim King"},"description":"Tim is Solutions Review's Executive Editor covering the human impact of AI on the future of work and learning. He is also the Media Strategist behind Insight Jam (1M+ on YouTube) events and programming. A 2017 and 2018 Most Influential Business Journalist and 2021 \"Who's Who\" in multiple categories, Tim is a recognized thought leader in enterprise tech and AI.","url":"https:\/\/solutionsreview.com\/data-integration\/author\/timking\/"}]}},"_links":{"self":[{"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/posts\/832"}],"collection":[{"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/users\/23"}],"replies":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/comments?post=832"}],"version-history":[{"count":0,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/posts\/832\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/media\/1550"}],"wp:attachment":[{"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/media?parent=832"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/categories?post=832"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/tags?post=832"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}