In the ages of mobile, the internet of things, and globalization, data integration has grown dramatically in complexity as data centers have become distributed across the earth. Trying to integrate this data becomes a major challenge especially for specific enterprises with large subscription lists who must oversee sensitive data such as insurance companies, banks, healthcare organizations, and online gaming. In an article Data Center Knowledge article called “Data Integration for the Mobile Age,” Frank Huerta, CEO of TransLattice, tackles some of these issues.
“Certain kinds of data, such as Personally Identifiable Information (PII) that include critical details such as Social Security numbers, credit card information, dates of birth and names and addresses are all part of subscription management and can be especially challenging to handle. Failure to handle it well can lead to a loss of revenue, increased business risk, and angry customers – all of which are bad for business,” said Huerta.
+ Check out this Free 2014 Data Integration Tools and Software Buyers Guide
The Global Storage Dilemna
Before the Big Data wave hit the shores of businesses, one data location was enough for most companies. A single location made data much easier to manage and control. Today, many large organizations have data centers all over the globe. A byproduct of this is that data regulations must be changed world-wide. This means that policies must be created and enforced to ensure that data is stored in compliance of these regulations, which is a challenge of its own.
Problem is that companies may choose to store data where it is most convenient for them, often putting the data at risk, breaking regulations. In the bullets below, Frank Huerta expresses that there are two options and neither is ideal and each have their own challenges.
- Storing data in a manner that is not compliant with local regulations, though more convenient, carries serious legal and regulatory implications.
- Storing data in distinct locations in a way that maintains compliance with data location regulations keeps organizations safe but forces them to continually consolidate and synchronize their data. Depending on the needs of the organization, this can happen several times a day, once a day, weekly or even monthly. Regardless of the frequency of the consolidation, immediate access to data in real time is not possible.
In the rest of the article Frank Huerta, goes on and describes how integrated policy management comes to the rescue and an infrastructure change to help with the global storage issue.
To read the entire article in full, click here.
- Data Pipeline Automated Testing Best Practices for Beginners - March 20, 2023
- What to Expect at Safe Software’s FME:23 Event on April 13 - March 13, 2023
- The Essential Big Data Engineer Requirements to Know - March 9, 2023