{"id":1638,"date":"2018-02-16T03:00:10","date_gmt":"2018-02-16T08:00:10","guid":{"rendered":"https:\/\/solutionsreview.com\/data-integration\/?p=1638"},"modified":"2018-03-21T09:25:05","modified_gmt":"2018-03-21T13:25:05","slug":"3-common-data-integration-pitfalls-to-avoid","status":"publish","type":"post","link":"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/","title":{"rendered":"3 Common Data Integration Pitfalls to Avoid"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-2640\" src=\"https:\/\/solutionsreview.com\/data-integration\/files\/2017\/08\/oie_fZtPHsGDpeob.jpg\" alt=\"3 Common Data Integration Pitfalls to Avoid\" width=\"800\" height=\"400\" srcset=\"https:\/\/solutionsreview.com\/data-integration\/files\/2017\/08\/oie_fZtPHsGDpeob.jpg 800w, https:\/\/solutionsreview.com\/data-integration\/files\/2017\/08\/oie_fZtPHsGDpeob-300x150.jpg 300w, https:\/\/solutionsreview.com\/data-integration\/files\/2017\/08\/oie_fZtPHsGDpeob-768x384.jpg 768w, https:\/\/solutionsreview.com\/data-integration\/files\/2017\/08\/oie_fZtPHsGDpeob-540x270.jpg 540w, https:\/\/solutionsreview.com\/data-integration\/files\/2017\/08\/oie_fZtPHsGDpeob-162x81.jpg 162w, https:\/\/solutionsreview.com\/data-integration\/files\/2017\/08\/oie_fZtPHsGDpeob-360x180.jpg 360w, https:\/\/solutionsreview.com\/data-integration\/files\/2017\/08\/oie_fZtPHsGDpeob-630x315.jpg 630w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/><\/p>\n<p style=\"text-align: justify\">Data Integration is the stop data makes before its loaded into a business intelligence tool for analysis. The process of integrating data from internal and external sources has grown more complicated in recent years. This has come as a result of \u00a0increasingly large and fast volumes of data, which are now being thrown all over as new data sources continue to emerge.<\/p>\n<div class=\"widget\"><div class=\"aside-card\">\t\t\t<div class=\"textwidget\"><p><a class=\"vms-speedbump\" title=\"Download link to Data Integration Vendor Map\" href=\"https:\/\/solutionsreview.com\/data-integration\/data-integration-vendor-map-a-guide-to-the-best-integration-solutions\/\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" class=\"alignleft size-full wp-image-1682\" src=\"https:\/\/solutionsreview.com\/data-integration\/files\/2020\/02\/DI_VM_SB_800.jpg\" alt=\"Download Link to Data Integration Vendor Map\" width=\"800\" height=\"100\" \/><\/a><\/p>\n<\/div>\n\t\t<\/div><\/div>\n<p style=\"text-align: justify\">Inside the new big data paradigm, no longer is data migration the only way to organize data in a way that will help companies generate insight. Considering the increasing types of data that are now utilized in the enterprise, many processes must be taken before the movement of data ever actually takes place. Avoid the three common data integration pitfalls:<\/p>\n<p><strong>Poor Data Quality<\/strong><\/p>\n<p style=\"text-align: justify\">In a <a href=\"https:\/\/solutionsreview.com\/business-intelligence\/kpmg-study-just-one-third-of-ceos-trust-data-analytics\/\" target=\"_blank\" rel=\"noopener\">recent KPMG survey<\/a> in which 400 chief executives were polled, 77 percent of respondents admitted that they had concerns about internal data quality. It&#8217;s no secret that this remains one of the biggest challenges in the data-driven organization, with the vast majority of organizations dealing with this problem daily.\u00a0With quickly expanding\u00a0data volumes, properly qualifying data has become an increasingly important job.<\/p>\n<p style=\"text-align: justify\">Source and legacy data systems suffer from poor data quality, and any integration job can become compromised from the get-go if &#8220;unclean data&#8221; is spread cross-company.\u00a0As repositories continue to be inundated with all kinds of new, unstructured data, expect data quality techniques will grow even more\u00a0tightly governed.<\/p>\n<p><strong>Underestimating Data Velocity<\/strong><\/p>\n<p style=\"text-align: justify\">Data is never static. It may have been semi-static in the past when data warehousing was the only kind of repository used in the enterprise and companies could wait for IT to load their data into a legacy reporting tool. No more, however, as a changing landscape filled with all kinds of new data sources that deliver data in near real-time dominate enterprise data architectures. In this way, companies can ill afford to underestimate the frameworks they need to have in place to appropriately capture and migrate increasingly fast data. Data Integration is not a one-time process, it is ongoing.<\/p>\n<p style=\"text-align: justify\"><strong>Time-Consuming Data Preparation<\/strong><\/p>\n<p style=\"text-align: justify\">According to Blue Hill Research, data analysts spend <a href=\"https:\/\/solutionsreview.com\/data-integration\/report-data-analysts-use-28-of-time-on-data-preparation\/\" target=\"_blank\" rel=\"noopener\">nearly one-third<\/a> of their time on data preparation. As data volumes increasingly grow in size and speed, organizations are having to find the time, resources, and manpower to deal with data preparation challenges. As a result, many companies are investing in new technologies to assist them with data preparation as it becomes vital to driving insights.<\/p>\n<p style=\"text-align: justify\">Data preparation has become a burden to organizations who are looking to make the most of their data. In addition, it has forced companies to invest a great portion of resources into human capital even though it is not generally considered to be a direct value-adding activity. Data prep is a necessary process for those looking to gain insights from data. The move to self-service is <a href=\"https:\/\/solutionsreview.com\/data-integration\/gartner-self-service-data-prep-revenue-to-reach-1bn-by-2019\/\" target=\"_blank\" rel=\"noopener\">upon us<\/a>, and the enterprise is jumping with joy.<\/p>\n<div class=\"hr hr\"><\/div>\n<br \/>Widget not in any sidebars<br \/>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Data Integration is the stop data makes before its loaded into a business intelligence tool for analysis. The process of integrating data from internal and external sources has grown more complicated in recent years. This has come as a result of \u00a0increasingly large and fast volumes of data, which are now being thrown all over [&hellip;]<\/p>\n","protected":false},"author":23,"featured_media":2640,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[1],"tags":[19,343,291],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>3 Common Data Integration Pitfalls to Avoid<\/title>\n<meta name=\"description\" content=\"Modern Data Integration is plagued by three avoidable pitfalls.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Tim King\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/\"},\"author\":{\"name\":\"Tim King\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c\"},\"headline\":\"3 Common Data Integration Pitfalls to Avoid\",\"datePublished\":\"2018-02-16T08:00:10+00:00\",\"dateModified\":\"2018-03-21T13:25:05+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/\"},\"wordCount\":501,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#organization\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2017\/08\/oie_fZtPHsGDpeob.jpg\",\"keywords\":[\"Big Data\",\"Data Preparation\",\"Data Quality\"],\"articleSection\":[\"Best Practices\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/\",\"name\":\"3 Common Data Integration Pitfalls to Avoid\",\"isPartOf\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2017\/08\/oie_fZtPHsGDpeob.jpg\",\"datePublished\":\"2018-02-16T08:00:10+00:00\",\"dateModified\":\"2018-03-21T13:25:05+00:00\",\"description\":\"Modern Data Integration is plagued by three avoidable pitfalls.\",\"breadcrumb\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/#primaryimage\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2017\/08\/oie_fZtPHsGDpeob.jpg\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2017\/08\/oie_fZtPHsGDpeob.jpg\",\"width\":800,\"height\":400,\"caption\":\"3 Common Data Integration Pitfalls to Avoid\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/solutionsreview.com\/data-integration\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"3 Common Data Integration Pitfalls to Avoid\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#website\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/\",\"name\":\"Data Integration Tools &amp; ETL Software | Solutions Review\",\"description\":\"Evaluating Enterprise ETL Tools, Cloud iPaaS &amp; Real-Time Data Streaming Platforms.\",\"publisher\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/solutionsreview.com\/data-integration\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#organization\",\"name\":\"Solutions Review\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png\",\"width\":225,\"height\":90,\"caption\":\"Solutions Review\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c\",\"name\":\"Tim King\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2023\/12\/tk.jpg\",\"contentUrl\":\"https:\/\/solutionsreview.com\/data-integration\/files\/2023\/12\/tk.jpg\",\"caption\":\"Tim King\"},\"description\":\"Tim is Solutions Review's Executive Editor covering the human impact of AI on the future of work and learning. He is also the Media Strategist behind Insight Jam (1M+ on YouTube) events and programming. A 2017 and 2018 Most Influential Business Journalist and 2021 \\\"Who's Who\\\" in multiple categories, Tim is a recognized thought leader in enterprise tech and AI.\",\"url\":\"https:\/\/solutionsreview.com\/data-integration\/author\/timking\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"3 Common Data Integration Pitfalls to Avoid","description":"Modern Data Integration is plagued by three avoidable pitfalls.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/","twitter_misc":{"Written by":"Tim King","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/#article","isPartOf":{"@id":"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/"},"author":{"name":"Tim King","@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c"},"headline":"3 Common Data Integration Pitfalls to Avoid","datePublished":"2018-02-16T08:00:10+00:00","dateModified":"2018-03-21T13:25:05+00:00","mainEntityOfPage":{"@id":"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/"},"wordCount":501,"commentCount":0,"publisher":{"@id":"https:\/\/solutionsreview.com\/data-integration\/#organization"},"image":{"@id":"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/#primaryimage"},"thumbnailUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2017\/08\/oie_fZtPHsGDpeob.jpg","keywords":["Big Data","Data Preparation","Data Quality"],"articleSection":["Best Practices"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/","url":"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/","name":"3 Common Data Integration Pitfalls to Avoid","isPartOf":{"@id":"https:\/\/solutionsreview.com\/data-integration\/#website"},"primaryImageOfPage":{"@id":"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/#primaryimage"},"image":{"@id":"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/#primaryimage"},"thumbnailUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2017\/08\/oie_fZtPHsGDpeob.jpg","datePublished":"2018-02-16T08:00:10+00:00","dateModified":"2018-03-21T13:25:05+00:00","description":"Modern Data Integration is plagued by three avoidable pitfalls.","breadcrumb":{"@id":"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/#primaryimage","url":"https:\/\/solutionsreview.com\/data-integration\/files\/2017\/08\/oie_fZtPHsGDpeob.jpg","contentUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2017\/08\/oie_fZtPHsGDpeob.jpg","width":800,"height":400,"caption":"3 Common Data Integration Pitfalls to Avoid"},{"@type":"BreadcrumbList","@id":"https:\/\/solutionsreview.com\/data-integration\/3-common-data-integration-pitfalls-to-avoid\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/solutionsreview.com\/data-integration\/"},{"@type":"ListItem","position":2,"name":"3 Common Data Integration Pitfalls to Avoid"}]},{"@type":"WebSite","@id":"https:\/\/solutionsreview.com\/data-integration\/#website","url":"https:\/\/solutionsreview.com\/data-integration\/","name":"Data Integration Tools &amp; ETL Software | Solutions Review","description":"Evaluating Enterprise ETL Tools, Cloud iPaaS &amp; Real-Time Data Streaming Platforms.","publisher":{"@id":"https:\/\/solutionsreview.com\/data-integration\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/solutionsreview.com\/data-integration\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/solutionsreview.com\/data-integration\/#organization","name":"Solutions Review","url":"https:\/\/solutionsreview.com\/data-integration\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/logo\/image\/","url":"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png","contentUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png","width":225,"height":90,"caption":"Solutions Review"},"image":{"@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c","name":"Tim King","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/data-integration\/#\/schema\/person\/image\/","url":"https:\/\/solutionsreview.com\/data-integration\/files\/2023\/12\/tk.jpg","contentUrl":"https:\/\/solutionsreview.com\/data-integration\/files\/2023\/12\/tk.jpg","caption":"Tim King"},"description":"Tim is Solutions Review's Executive Editor covering the human impact of AI on the future of work and learning. He is also the Media Strategist behind Insight Jam (1M+ on YouTube) events and programming. A 2017 and 2018 Most Influential Business Journalist and 2021 \"Who's Who\" in multiple categories, Tim is a recognized thought leader in enterprise tech and AI.","url":"https:\/\/solutionsreview.com\/data-integration\/author\/timking\/"}]}},"_links":{"self":[{"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/posts\/1638"}],"collection":[{"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/users\/23"}],"replies":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/comments?post=1638"}],"version-history":[{"count":0,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/posts\/1638\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/media\/2640"}],"wp:attachment":[{"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/media?parent=1638"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/categories?post=1638"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/solutionsreview.com\/data-integration\/wp-json\/wp\/v2\/tags?post=1638"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}