{"id":2165,"date":"2025-05-20T18:47:26","date_gmt":"2025-05-20T18:47:26","guid":{"rendered":"https:\/\/solutionsreview.com\/thought-leaders\/?p=2165"},"modified":"2025-05-20T18:47:26","modified_gmt":"2025-05-20T18:47:26","slug":"ai-needs-to-be-supervised","status":"publish","type":"post","link":"https:\/\/solutionsreview.com\/thought-leaders\/ai-needs-to-be-supervised\/","title":{"rendered":"AI Needs to be Supervised"},"content":{"rendered":"

I\u2019ve been hearing a lot of discussion around whether AI has reached autonomy or not\u2026 let\u2019s talk about that.<\/p>\n

<\/a><\/p>\n

In\u00a0Kant\u2019s moral theory<\/a>, autonomy is a quality of rational agents that act and make choices based on their own reason.\u00a0Merriam-Webster<\/a>\u00a0defines autonomy as the quality or state of being self-governing, self-directing freedom, and especially moral independence. When it comes to artificial intelligence, the definition gets a little foggy. I\u2019ve seen autonomous AI defined as the ability of machines to act with limited human intervention. I\u2019ve also seen it referred to as the ability to operate independently of direct human intervention.<\/p>\n

There is one caveat to the latter, and that includes the fact that AI is working within defined constraints to achieve a specific goal; however, it does have the capacity to learn from its own experiences and make decisions. But, if AI can act and make decisions with full autonomy, who\u2019s accountable when things go wrong?<\/p>\n

To build trustworthy AI solutions, companies should be documenting things like: what the AI solution is being used for, how the AI solution is created, how the AI solution makes decisions, and how the AI solution is being monitored. To add to the monitoring documentation, companies should also be implementing specific guidance and direction for supervising AI decisions, outputs, and impacts. The supervision itself can be tricky, but can be done with a few different approaches.<\/p>\n

<\/a><\/p>\n

Audit Logs<\/strong><\/h4>\n

One approach to supervising AI is to enable detailed audit logs to capture things like data inputs, model parameters, model versions, and data outputs. These can be used to troubleshoot issues and evaluate model performance. However, since most models are complex and require very large data sets, monitoring of these logs will require an analytical approach. This isn\u2019t impossible, but there are tools out there that can do this more efficiently.<\/p>\n

AI Observability<\/strong><\/h4>\n

A modern approach to AI supervision would be to use tools to help with monitoring and analyzing AI systems, which is often referred to as AI Observability. There are tools out there that help with the collecting of the data inputs, model parameters, model versions, and data inputs as described above. Tools such as Dynatrace, New Relic, Datadog, and AppDynamics by Splunk can be used as a holistic and complete approach to drive insights on the availability, reliability, performance, and trustworthiness throughout the AI lifecycle. AI Observability can also work as a control to detect certain AI related threats.<\/p>\n

You can set up monitoring of the data pipeline to observe data inputs, which would help detect potential abuse like prompt injection attacks. You can analyze data quality which could expose potential data poisoning attempts or data drift. Monitoring of the infrastructure could identify heavy use of an AI system which could be a sign of a prompt injection attack. Also, general monitoring of model performance can even help catch things like data drift and model drift.<\/p>\n

These are all great tools and techniques, but you can\u2019t forget about human oversight.<\/p>\n

<\/a><\/p>\n

Human in the Loop<\/strong><\/h4>\n

When developing these AI solutions, it\u2019s critical to include a human in the loop for supervision of the decisions, outputs, and impacts as well as validating the quality and relevance of the data used for training the model. In some cases, there should even be a final decision-making role to approve the AI workflow. For instance, if you had an AI system developed to diagnose patients with a particular disease, a human doctor should be included in the loop as a secondary review and final decision-making role for that decision.<\/p>\n

Another reason to support human involvement is to mitigate the impacts that can occur with hallucinations, which is a common issue with GenAI. A hallucination is when the AI model makes a prediction that didn\u2019t come from the input data. This is exceptionally detrimental in high-risk or regulated situations where having inaccurate output can lead to legal repercussions, financial penalties, and reputational damage.<\/p>\n

<\/a><\/p>\n

To reduce hallucinations, companies can implement controls (or guardrails) on both input and output data by using templates to provide structure and ensure consistency. It\u2019s important to emphasize that these controls only help reduce the potential for hallucinations and the controls themselves should be monitored and adjusted often.<\/p>\n

It\u2019s hard to make the argument that AI can act entirely as an independent agent that makes decisions. There needs to be accountability for when things go wrong and therefore, robust supervision should be implemented to mitigate the potential risk posed by these AI solutions.<\/p>\n

\n

Do you think we have reached AI autonomy?<\/p>\n<\/blockquote>\n

\n

Originally published at\u00a0<\/em>www.medium.com<\/em><\/a>.<\/em><\/p>\n

I love working with Internal Audit teams to help them develop strategies to leverage analytics and AI to modernize their audit approach. If you’re interesting in leveling up you’re audits, \u00a0<\/em>let’s chat!<\/em><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

I\u2019ve been hearing a lot of discussion around whether AI has reached autonomy or not\u2026 let\u2019s talk about that. In\u00a0Kant\u2019s moral theory, autonomy is a quality of rational agents that act and make choices based on their own reason.\u00a0Merriam-Webster\u00a0defines autonomy as the quality or state of being self-governing, self-directing freedom, and especially moral independence. When […]<\/p>\n","protected":false},"author":1246,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[96],"tags":[],"acf":[],"yoast_head":"\nAI Needs to be Supervised<\/title>\n<meta name=\"robots\" content=\"noindex, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"AI Needs to be Supervised\" \/>\n<meta property=\"og:description\" content=\"I\u2019ve been hearing a lot of discussion around whether AI has reached autonomy or not\u2026 let\u2019s talk about that. In\u00a0Kant\u2019s moral theory, autonomy is a quality of rational agents that act and make choices based on their own reason.\u00a0Merriam-Webster\u00a0defines autonomy as the quality or state of being self-governing, self-directing freedom, and especially moral independence. When […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/solutionsreview.com\/thought-leaders\/ai-needs-to-be-supervised\/\" \/>\n<meta property=\"og:site_name\" content=\"Solutions Review Thought Leaders\" \/>\n<meta property=\"article:published_time\" content=\"2025-05-20T18:47:26+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/media1-production-mightynetworks.imgix.net\/asset\/22b454a0-1a83-4fa9-800e-37c10160d979\/1747682702297.png?ixlib=rails-4.2.0&fm=jpg&q=75&auto=format\" \/>\n<meta name=\"author\" content=\"Monica Kay Royal\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Monica Kay Royal\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/ai-needs-to-be-supervised\/\",\"url\":\"https:\/\/solutionsreview.com\/thought-leaders\/ai-needs-to-be-supervised\/\",\"name\":\"AI Needs to be Supervised\",\"isPartOf\":{\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/ai-needs-to-be-supervised\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/ai-needs-to-be-supervised\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/media1-production-mightynetworks.imgix.net\/asset\/22b454a0-1a83-4fa9-800e-37c10160d979\/1747682702297.png?ixlib=rails-4.2.0&fm=jpg&q=75&auto=format\",\"datePublished\":\"2025-05-20T18:47:26+00:00\",\"dateModified\":\"2025-05-20T18:47:26+00:00\",\"author\":{\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/#\/schema\/person\/ce8b8c83c77ed514a9950afdb71c526d\"},\"breadcrumb\":{\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/ai-needs-to-be-supervised\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/solutionsreview.com\/thought-leaders\/ai-needs-to-be-supervised\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/ai-needs-to-be-supervised\/#primaryimage\",\"url\":\"https:\/\/media1-production-mightynetworks.imgix.net\/asset\/22b454a0-1a83-4fa9-800e-37c10160d979\/1747682702297.png?ixlib=rails-4.2.0&fm=jpg&q=75&auto=format\",\"contentUrl\":\"https:\/\/media1-production-mightynetworks.imgix.net\/asset\/22b454a0-1a83-4fa9-800e-37c10160d979\/1747682702297.png?ixlib=rails-4.2.0&fm=jpg&q=75&auto=format\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/ai-needs-to-be-supervised\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/solutionsreview.com\/thought-leaders\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"AI Needs to be Supervised\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/#website\",\"url\":\"https:\/\/solutionsreview.com\/thought-leaders\/\",\"name\":\"Solutions Review Thought Leaders\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/solutionsreview.com\/thought-leaders\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/#\/schema\/person\/ce8b8c83c77ed514a9950afdb71c526d\",\"name\":\"Monica Kay Royal\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/solutionsreview.com\/thought-leaders\/files\/2025\/03\/Expert-MKR_Ink_300-1.png\",\"contentUrl\":\"https:\/\/solutionsreview.com\/thought-leaders\/files\/2025\/03\/Expert-MKR_Ink_300-1.png\",\"caption\":\"Monica Kay Royal\"},\"description\":\"Monica is an auditor, turned data professional, turned instructor, who has a mission to help others in the data community learn and grow. Professionals from all walks of life work with her to find ways to leverage data analytics to make their lives easier.\",\"url\":\"https:\/\/solutionsreview.com\/thought-leaders\/author\/mkroyal\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"AI Needs to be Supervised","robots":{"index":"noindex","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"og_locale":"en_US","og_type":"article","og_title":"AI Needs to be Supervised","og_description":"I\u2019ve been hearing a lot of discussion around whether AI has reached autonomy or not\u2026 let\u2019s talk about that. In\u00a0Kant\u2019s moral theory, autonomy is a quality of rational agents that act and make choices based on their own reason.\u00a0Merriam-Webster\u00a0defines autonomy as the quality or state of being self-governing, self-directing freedom, and especially moral independence. When […]","og_url":"https:\/\/solutionsreview.com\/thought-leaders\/ai-needs-to-be-supervised\/","og_site_name":"Solutions Review Thought Leaders","article_published_time":"2025-05-20T18:47:26+00:00","og_image":[{"url":"https:\/\/media1-production-mightynetworks.imgix.net\/asset\/22b454a0-1a83-4fa9-800e-37c10160d979\/1747682702297.png?ixlib=rails-4.2.0&fm=jpg&q=75&auto=format"}],"author":"Monica Kay Royal","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Monica Kay Royal","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/solutionsreview.com\/thought-leaders\/ai-needs-to-be-supervised\/","url":"https:\/\/solutionsreview.com\/thought-leaders\/ai-needs-to-be-supervised\/","name":"AI Needs to be Supervised","isPartOf":{"@id":"https:\/\/solutionsreview.com\/thought-leaders\/#website"},"primaryImageOfPage":{"@id":"https:\/\/solutionsreview.com\/thought-leaders\/ai-needs-to-be-supervised\/#primaryimage"},"image":{"@id":"https:\/\/solutionsreview.com\/thought-leaders\/ai-needs-to-be-supervised\/#primaryimage"},"thumbnailUrl":"https:\/\/media1-production-mightynetworks.imgix.net\/asset\/22b454a0-1a83-4fa9-800e-37c10160d979\/1747682702297.png?ixlib=rails-4.2.0&fm=jpg&q=75&auto=format","datePublished":"2025-05-20T18:47:26+00:00","dateModified":"2025-05-20T18:47:26+00:00","author":{"@id":"https:\/\/solutionsreview.com\/thought-leaders\/#\/schema\/person\/ce8b8c83c77ed514a9950afdb71c526d"},"breadcrumb":{"@id":"https:\/\/solutionsreview.com\/thought-leaders\/ai-needs-to-be-supervised\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/solutionsreview.com\/thought-leaders\/ai-needs-to-be-supervised\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/thought-leaders\/ai-needs-to-be-supervised\/#primaryimage","url":"https:\/\/media1-production-mightynetworks.imgix.net\/asset\/22b454a0-1a83-4fa9-800e-37c10160d979\/1747682702297.png?ixlib=rails-4.2.0&fm=jpg&q=75&auto=format","contentUrl":"https:\/\/media1-production-mightynetworks.imgix.net\/asset\/22b454a0-1a83-4fa9-800e-37c10160d979\/1747682702297.png?ixlib=rails-4.2.0&fm=jpg&q=75&auto=format"},{"@type":"BreadcrumbList","@id":"https:\/\/solutionsreview.com\/thought-leaders\/ai-needs-to-be-supervised\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/solutionsreview.com\/thought-leaders\/"},{"@type":"ListItem","position":2,"name":"AI Needs to be Supervised"}]},{"@type":"WebSite","@id":"https:\/\/solutionsreview.com\/thought-leaders\/#website","url":"https:\/\/solutionsreview.com\/thought-leaders\/","name":"Solutions Review Thought Leaders","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/solutionsreview.com\/thought-leaders\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/solutionsreview.com\/thought-leaders\/#\/schema\/person\/ce8b8c83c77ed514a9950afdb71c526d","name":"Monica Kay Royal","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/thought-leaders\/#\/schema\/person\/image\/","url":"https:\/\/solutionsreview.com\/thought-leaders\/files\/2025\/03\/Expert-MKR_Ink_300-1.png","contentUrl":"https:\/\/solutionsreview.com\/thought-leaders\/files\/2025\/03\/Expert-MKR_Ink_300-1.png","caption":"Monica Kay Royal"},"description":"Monica is an auditor, turned data professional, turned instructor, who has a mission to help others in the data community learn and grow. Professionals from all walks of life work with her to find ways to leverage data analytics to make their lives easier.","url":"https:\/\/solutionsreview.com\/thought-leaders\/author\/mkroyal\/"}]}},"_links":{"self":[{"href":"https:\/\/solutionsreview.com\/thought-leaders\/wp-json\/wp\/v2\/posts\/2165"}],"collection":[{"href":"https:\/\/solutionsreview.com\/thought-leaders\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/solutionsreview.com\/thought-leaders\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/thought-leaders\/wp-json\/wp\/v2\/users\/1246"}],"replies":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/thought-leaders\/wp-json\/wp\/v2\/comments?post=2165"}],"version-history":[{"count":0,"href":"https:\/\/solutionsreview.com\/thought-leaders\/wp-json\/wp\/v2\/posts\/2165\/revisions"}],"wp:attachment":[{"href":"https:\/\/solutionsreview.com\/thought-leaders\/wp-json\/wp\/v2\/media?parent=2165"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/solutionsreview.com\/thought-leaders\/wp-json\/wp\/v2\/categories?post=2165"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/solutionsreview.com\/thought-leaders\/wp-json\/wp\/v2\/tags?post=2165"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}