More than 50 percent of organizations claim data governance is their top cloud data management challenge, according to new research commissioned by Talend and TDWI. The study, which is entitled Cloud Data Warehouse Trends for 2019 and took place in September and October of 2018, features feedback from more than 200 data architects and senior IT and analytics professionals. The study’s aim was to uncover key challenges with cloud data warehousing.
The overall theme was that cloud data warehousing enabled users to achieve improved performance and position them to better take advantage of new cloud technologies. However, implementation troubles remain prevalent among those that don’t utilize all the best practices at their disposal. Complexity too remains a major issue, as more than 35 percent of those polled expressed the need for in-memory processing to support both structured and unstructured data. There’s also a growing need for better integration with third-party analytics and BI software.
Data access is the other major pain point for data and analytics leaders. Respondents complained that integrating data across multiple sources and “getting into the data warehouse” were also atop their list of frustrations. These needs can often be mitigated by deploying data integration middleware, but also bring to light the fact that cloud data warehouses must accommodate a variety of data types and serve a range of use cases.
All of the professionals polled by Talend and TDWI had interest in data quality, metadata management, and processing and transforming data before and after loading into a cloud data warehouse. The survey correctly points out that CDW technologies cannot be solely responsible for these tasks, however, and some caution is warranted. The best approach is hybrid in nature, and data and analytics leaders should deploy solutions that complement their existing environments.
We reached out to Talend for a statement surrounding the report, and the company’s COO and CTO Laurent Bride said: “The rise of new cloud data warehouse (CDW) technologies brings a lot of new opportunities, promises, and challenges all at the same time. What we often see with customers is that a cloud data warehouse alone isn’t enough for use cases like machine learning and advanced analytics. CDWs need to be a part of a bigger data management strategy to make a truly data-driven organization and enable teams with comprehensive capabilities.”
We encourage you to read the complete report.
- The Coolest Data Management and Big Data CEOs of 2021 - September 17, 2021
- New Alation Data Governance App Touts Automated Policy Control - September 15, 2021
- Teradata Launches Bring Your Own Predictive Model (BYOM) Support - September 9, 2021