{"id":615,"date":"2014-07-25T11:18:29","date_gmt":"2014-07-25T15:18:29","guid":{"rendered":"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/"},"modified":"2014-07-29T10:13:17","modified_gmt":"2014-07-29T14:13:17","slug":"big-data-is-innocent-data-variety-is-the-culprit","status":"publish","type":"post","link":"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/","title":{"rendered":"Big Data is Innocent, Data Variety is the Culprit"},"content":{"rendered":"<p><a href=\"https:\/\/solutionsreview.com\/business-intelligence\/files\/2014\/07\/Big-Data-is-Innocent-Data-Variety-is-the-Culprit.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignleft size-medium wp-image-611\" src=\"https:\/\/solutionsreview.com\/business-intelligence\/files\/2014\/07\/Big-Data-is-Innocent-Data-Variety-is-the-Culprit-300x140.jpg\" alt=\"Big Data is Innocent Data Variety is the Culprit\" width=\"300\" height=\"140\" \/><\/a>It seems as though IT people and business people alike are running around searching for solutions as big data and all of its fears are on the horizon.\u00a0 And this behavior in my opinion is justified as big data does present numerous challenges especially\u00a0if handled incorrectly.<\/p>\n<p>But when I\u00a0think about Big Data, the image that first comes to mind is quantitative, based on size, which makes sense since it is called \u201cBig\u201d Data. However, a survey of scientists reveals it\u2019s not just the amount of data that is presenting challenges, but the different types of data collected that is causing storage nightmares.<\/p>\n<p>In an eWeek article written by Nathan Eddy called \u201cData Storage Demands Complicated by Data Variety\u201d, Eddy reports that data scientists are seeing that data variety is harder to handle than data volume.<\/p>\n<p>\u201cNearly three-quarters (71 percent) of data scientists said big data had made their analytics more difficult and data variety, not volume, was to blame, according to a survey of 111 data scientists from computational database management system designer company, Paradigm4.\u201d<\/p>\n<p>The complexity of the diverse types of data seemed to be the driver to why data was left on the table. This makes sense to me because it\u2019s difficult to analyze information if it\u2019s not \u201capples to apples\u201d so there will be cases where the \u201cpeach\u201d is left out of the analysis. This can be a big problem as data scientists may only be seeing part of the picture as if \u201clooking through a keyhole.\u201d<\/p>\n<p>Eddy states, \u201cThe report also revealed 39 percent said their job had become more stressful with the growth of big data, while nearly half of data scientists (49 percent) said they&#8217;re finding it more difficult to fit their data into relational database tables.\u201d<\/p>\n<p>So it looks like Big Data is innocent when compared to Data Variety. This presents a major challenge for business leaders, data scientists, and data companies to overcome. Especially considering the resources spent\u00a0to collect all of this data, one would be leaving money on the table if all of it was not utilized.<\/p>\n<p>Is big data variety more complicated than big data volume? Please let me know what you are experiencing.<\/p>\n<p><a href=\"https:\/\/www.eweek.com\/small-business\/data-storage-demands-complicated-by-data-variety.html\">Click here<\/a> to read the entire eWeek article written by Nathan Eddy.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>It seems as though IT people and business people alike are running around searching for solutions as big data and all of its fears are on the horizon.\u00a0 And this behavior in my opinion is justified as big data does present numerous challenges especially\u00a0if handled incorrectly. But when I\u00a0think about Big Data, the image that [&hellip;]<\/p>\n","protected":false},"author":23,"featured_media":616,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[1],"tags":[],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Big Data is Innocent, Data Variety is the Culprit &#187; Best Data Integration Vendors, News &amp; Reviews for Big Data, Applications, ETL and Hadoop<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Tim King\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/\"},\"author\":{\"name\":\"Tim King\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c\"},\"headline\":\"Big Data is Innocent, Data Variety is the Culprit\",\"datePublished\":\"2014-07-25T15:18:29+00:00\",\"dateModified\":\"2014-07-29T14:13:17+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/\"},\"wordCount\":388,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#organization\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2014\/07\/Big-Data-is-Innocent-Data-Variety-is-the-Culprit.jpg\",\"articleSection\":[\"Best Practices\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/\",\"name\":\"Big Data is Innocent, Data Variety is the Culprit &#187; Best Data Integration Vendors, News &amp; Reviews for Big Data, Applications, ETL and Hadoop\",\"isPartOf\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2014\/07\/Big-Data-is-Innocent-Data-Variety-is-the-Culprit.jpg\",\"datePublished\":\"2014-07-25T15:18:29+00:00\",\"dateModified\":\"2014-07-29T14:13:17+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/#primaryimage\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2014\/07\/Big-Data-is-Innocent-Data-Variety-is-the-Culprit.jpg\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2014\/07\/Big-Data-is-Innocent-Data-Variety-is-the-Culprit.jpg\",\"width\":600,\"height\":281,\"caption\":\"Big Data is Innocent Data Variety is the Culprit\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/solutionsreview.com\/data-integration\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Big Data is Innocent, Data Variety is the Culprit\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#website\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/\",\"name\":\"Best Data Integration Vendors, News &amp; Reviews for Big Data, Applications, ETL and Hadoop\",\"description\":\"Data Integration Buyers Guide and Best Practices\",\"publisher\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/solutionsreview.com\/data-integration\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#organization\",\"name\":\"Solutions Review\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png\",\"width\":225,\"height\":90,\"caption\":\"Solutions Review\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c\",\"name\":\"Tim King\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2023\/12\/tk.jpg\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2023\/12\/tk.jpg\",\"caption\":\"Tim King\"},\"description\":\"Tim is Solutions Review's Executive Editor covering the human impact of AI on the future of work and learning. He is also the Media Strategist behind Insight Jam (1M+ on YouTube) events and programming. A 2017 and 2018 Most Influential Business Journalist and 2021 \\\"Who's Who\\\" in multiple categories, Tim is a recognized thought leader in enterprise tech and AI.\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/author\/timking\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Big Data is Innocent, Data Variety is the Culprit &#187; Best Data Integration Vendors, News &amp; Reviews for Big Data, Applications, ETL and Hadoop","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/","twitter_misc":{"Written by":"Tim King","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/#article","isPartOf":{"@id":"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/"},"author":{"name":"Tim King","@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c"},"headline":"Big Data is Innocent, Data Variety is the Culprit","datePublished":"2014-07-25T15:18:29+00:00","dateModified":"2014-07-29T14:13:17+00:00","mainEntityOfPage":{"@id":"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/"},"wordCount":388,"commentCount":0,"publisher":{"@id":"https:\/\/solutionsreview.com\/data-integration\/#organization"},"image":{"@id":"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/#primaryimage"},"thumbnailUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2014\/07\/Big-Data-is-Innocent-Data-Variety-is-the-Culprit.jpg","articleSection":["Best Practices"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/","url":"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/","name":"Big Data is Innocent, Data Variety is the Culprit &#187; Best Data Integration Vendors, News &amp; Reviews for Big Data, Applications, ETL and Hadoop","isPartOf":{"@id":"https:\/\/solutionsreview.com\/data-integration\/#website"},"primaryImageOfPage":{"@id":"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/#primaryimage"},"image":{"@id":"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/#primaryimage"},"thumbnailUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2014\/07\/Big-Data-is-Innocent-Data-Variety-is-the-Culprit.jpg","datePublished":"2014-07-25T15:18:29+00:00","dateModified":"2014-07-29T14:13:17+00:00","breadcrumb":{"@id":"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/#primaryimage","url":"https:\/\/solutionsreview.com\/data-integration\/files\/2014\/07\/Big-Data-is-Innocent-Data-Variety-is-the-Culprit.jpg","contentUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2014\/07\/Big-Data-is-Innocent-Data-Variety-is-the-Culprit.jpg","width":600,"height":281,"caption":"Big Data is Innocent Data Variety is the Culprit"},{"@type":"BreadcrumbList","@id":"https:\/\/solutionsreview.com\/data-integration\/big-data-is-innocent-data-variety-is-the-culprit\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/solutionsreview.com\/data-integration\/"},{"@type":"ListItem","position":2,"name":"Big Data is Innocent, Data Variety is the Culprit"}]},{"@type":"WebSite","@id":"https:\/\/solutionsreview.com\/data-integration\/#website","url":"https:\/\/solutionsreview.com\/data-integration\/","name":"Best Data Integration Vendors, News &amp; Reviews for Big Data, Applications, ETL and Hadoop","description":"Data Integration Buyers Guide and Best Practices","publisher":{"@id":"https:\/\/solutionsreview.com\/data-integration\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/solutionsreview.com\/data-integration\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/solutionsreview.com\/data-integration\/#organization","name":"Solutions Review","url":"https:\/\/solutionsreview.com\/data-integration\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/logo\/image\/","url":"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png","contentUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png","width":225,"height":90,"caption":"Solutions Review"},"image":{"@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c","name":"Tim King","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/image\/","url":"https:\/\/solutionsreview.com\/data-integration\/files\/2023\/12\/tk.jpg","contentUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2023\/12\/tk.jpg","caption":"Tim King"},"description":"Tim is Solutions Review's Executive Editor covering the human impact of AI on the future of work and learning. He is also the Media Strategist behind Insight Jam (1M+ on YouTube) events and programming. A 2017 and 2018 Most Influential Business Journalist and 2021 \"Who's Who\" in multiple categories, Tim is a recognized thought leader in enterprise tech and AI.","url":"https:\/\/solutionsreview.com\/data-integration\/author\/timking\/"}]}},"_links":{"self":[{"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/posts\/615"}],"collection":[{"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/users\/23"}],"replies":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/comments?post=615"}],"version-history":[{"count":0,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/posts\/615\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/media\/616"}],"wp:attachment":[{"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/media?parent=615"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/categories?post=615"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/tags?post=615"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}