{"id":6729,"date":"2024-10-25T08:39:38","date_gmt":"2024-10-25T12:39:38","guid":{"rendered":"https:\/\/solutionsreview.com\/data-management\/?p=6729"},"modified":"2024-10-25T09:01:10","modified_gmt":"2024-10-25T13:01:10","slug":"the-last-mile-problem-why-your-ai-models-stumble-before-the-finish-line","status":"publish","type":"post","link":"https:\/\/solutionsreview.com\/data-management\/the-last-mile-problem-why-your-ai-models-stumble-before-the-finish-line\/","title":{"rendered":"The Last Mile Problem: Why Your AI Models Stumble Before the Finish Line"},"content":{"rendered":"

\"\"<\/p>\n

Encord’s Ulrik Stig Hansen offers insights on the last mile problem and why your AI models stumble before the finish line. <\/strong><\/em>This article originally appeared on Solutions Review’s Insight Jam<\/a>, an enterprise IT community enabling the human conversation on AI.<\/strong><\/em><\/p>\n

In 2023, AI was the buzzword of the year. Enterprises across industries invested heavily in AI proof of concepts (POCs), eager to explore the technology\u2019s potential. Fast-forward to 2024, companies face a new challenge: moving AI initiatives from prototype to production.<\/p>\n

According to\u00a0Gartner<\/a>, by 2025, at least 30 percent of GenAI projects will be abandoned after the POC stage. The reasons? Poor data quality, governance gaps, and the absence of clear business value. Companies are now realizing that the primary challenge isn\u2019t simply building models\u2014it\u2019s ensuring the quality of the data feeding those models. As companies aim to move from prototype to production of models, they\u2019re realizing that the biggest roadblock is curating the right data.<\/p>\n

The Data Dilemma: Why More Isn\u2019t Always Better<\/strong><\/h3>\n

In the early days of AI development, the prevailing belief was that more data leads to better results. However, as AI systems have become more sophisticated, the importance of data quality has surpassed that of quantity. There are several reasons for this shift. Firstly, large datasets are often riddled with errors, inconsistencies, and biases that can unknowingly skew model outcomes. With an excess of data, it becomes difficult to control what the model learns, potentially leading it to fixate on the training set and reducing its effectiveness with new data. Secondly, the \u201cmajority concept\u201d within the dataset tends to dominate the training process, diluting insights from minority concepts and reducing model generalization. Thirdly, processing massive datasets can slow down iteration cycles, meaning that critical decisions take longer as data quantity increases. Finally, processing large datasets can be costly, especially for smaller organizations or startups.<\/p>\n

Organizations must strike a delicate balance between having enough data to train robust models and ensuring that it\u2019s the right data. This means moving beyond data accumulation and focusing on data quality. By investing in practices like cleaning, validation, and enrichment, companies can ensure that their AI models are not only built on a solid foundation of high-quality data but are also well-prepared to scale and perform effectively in real-world production environments.<\/p>\n

The Price of Bad Data: The Ripple Effects of Poor Data Quality on AI Innovation<\/strong><\/h3>\n

A\u00a0study by IBM<\/a>\u00a0found that poor data quality costs the United States economy around $3.1 trillion annually. Across industries, this issue is the root cause of AI initiatives stalling after proof of concept, draining resources, and blocking companies from achieving full production-scale AI.<\/p>\n

Beyond direct financial losses, failed AI projects incur significant indirect costs, including wasted time and computational resources. Most critically, these failures represent missed opportunities for a competitive advantage and can damage both internal and external reputations. Repeated failures can create a culture of risk aversion, stifling the very innovation that AI promises to deliver.<\/p>\n

What Makes AI Data High-Quality?<\/strong><\/h3>\n

Research indicates that data scientists spend approximately\u00a080 percent<\/a>\u00a0of their time preparing and organizing data before they can conduct any meaningful analysis.<\/p>\n

To overcome the root challenge of poor data quality, high-performance AI datasets must exhibit five key characteristics: accuracy in reflecting real-world scenarios, consistency in format and structure, diversity to enhance adaptability, relevance to specific objectives, and ethical considerations in data collection and labeling.<\/p>\n

To illustrate the importance of these characteristics, consider an example from Automotus, a company that automates payments for vehicle unloading and parking. The company faced challenges with poor data quality, including duplicate and corrupt images, which hindered their ability to convert vast amounts of image data into labeled training datasets for their AI models. To address these issues, the company utilized data quality tools to efficiently curate and reduce their dataset by removing the bad examples\u2014achieving a 20 percent improvement in mean Average Precision (mAP) for their object detection models. While the data reduction enhanced model accuracy, it further led to a 33 percent reduction in labeling costs, demonstrating that investing in data quality can yield both performance improvements and economic benefits.<\/p>\n

Unlocking Success: How to Achieve High-Quality Data<\/strong><\/p>\n

To navigate the challenges of AI development, organizations need to take the following concrete steps to enhance their data practices:<\/p>\n