{"id":504,"date":"2024-01-01T18:24:45","date_gmt":"2024-01-01T18:24:45","guid":{"rendered":"https:\/\/solutionsreview.com\/expert\/?p=504"},"modified":"2024-02-02T14:17:50","modified_gmt":"2024-02-02T14:17:50","slug":"data-architecture-as-a-service-how-to-evaluate-products","status":"publish","type":"post","link":"https:\/\/solutionsreview.com\/thought-leaders\/data-architecture-as-a-service-how-to-evaluate-products\/","title":{"rendered":"Data Architecture as a Service: How to Evaluate Products"},"content":{"rendered":"

Products that support data architecture-as-a-service are emerging. This article describes what to look for in a commercial DAaaS-based product.<\/p>\n

Data architecture as a service or DAaaS is a timeless concept wrapped within some new commercial data pipeline products. The goal of DAaaS is to inject architectural standards and SQL guardrails into no-code data development tools so business users can develop their own data pipelines without IT assistance and without creating data silos. By abstracting architecture within a no-code environment, DAaaS-based tools align data pipelines and repositories with enterprise data standards. (See \u201cData Architecture-as-a-Service: Liberation for Data Users<\/a>.\u201d<\/p>\n

From a developer perspective, DAaaS fosters reuse, accelerates development, and eliminates costly errors that arise when inexperienced developers try to create complex SQL. It\u2019s a metadata-driven approach that uses configurable templates within commercial data pipeline products that automatically generate SQL code. DAaaS enables data analysts, data scientists and new data developers to leverage the work of experienced architects and engineers without having to learn the intricacies of SQL coding and data pipeline design and development.<\/p>\n

The Market for DAaaS Products<\/strong><\/h4>\n

One of the first vendors to introduce a DAaaS product is\u00a0Coalesce<\/a>, which offers a low-code\/no-code data transformation product that enables data architects to build guardrails into GUI-based development environments via templates so that business analysts can build architecturally compliant data repositories and pipelines.<\/p>\n

We expect many other vendors to introduce DAaaS-based products in the next two or three years. Every vendor wants to help business accelerate, if not automate, the development of data pipelines to feed analytical and operational requirements. DAaaS promises to remove the last remaining bottleneck between business users and data. As such, DAaaS represents the culmination of self-service in the analytics field.<\/p>\n

DAaaS promises to remove the last remaining bottleneck between business users and data.<\/em><\/p>\n

Evaluation Criteria\u00a0<\/strong><\/h4>\n

To prepare for the deluge of user-friendly data development products, we\u2019ve prepared a checklist of features and functions that we think every DAaaS-compliant product should support. Although every vendor will take a different approach to abstracting architecture, we think there are core principles that characterize a DAaaS product. As in any emerging discipline, this list is bound to evolve as customers implement these products in production environments.<\/p>\n

Here are criteria for evaluating DAaaS products:<\/p>\n

    \n
  1. \n

    Configurable.<\/strong>\u00a0Can architects or data engineers configure the product using templates, blocks, or other constructs to simplify the development of data pipelines?<\/p>\n<\/li>\n

  2. \n

    Multi-code.<\/strong>\u00a0Does the product support no-code, low-code, and all-code development so that it can be used by all types of users?<\/p>\n<\/li>\n

  3. \n

    Metadata-driven.<\/strong>\u00a0Does the product automatically generate SQL code that developers can view and modify if desired?<\/p>\n<\/li>\n

  4. \n

    Universal updates.<\/strong>\u00a0Can developers update a template in one place and ripple changes automatically to all solutions that leverage the code?<\/p>\n<\/li>\n

  5. \n

    Platform agnostic.<\/strong>\u00a0Does the product run on multiple data platforms, adjusting SQL output as needed? Can users migrate platforms without rewriting code?<\/p>\n<\/li>\n

  6. \n

    Connectors.<\/strong>\u00a0Does the tool connect to multiple source systems and load it into multiple targets?<\/p>\n<\/li>\n

  7. \n

    Orchestration.<\/strong>\u00a0Can the product execute transformations and tasks according to a workflow designed within a directed acyclic graph?<\/p>\n<\/li>\n

  8. \n

    Data lineage.<\/strong>\u00a0Does the tool track lineage of data elements from source to target?<\/p>\n<\/li>\n

  9. \n

    Data catalog.<\/strong>\u00a0Can users search and reuse existing data pipelines or data assets \u00a0 \u00a0 \u00a0to speed development and promote reuse?<\/p>\n<\/li>\n

  10. \n

    Documentation.<\/strong>\u00a0Does the tool automatically generate documentation to speed onboarding of new developers and provide to auditors?<\/p>\n<\/li>\n<\/ol>\n

    Next Generation DWA.\u00a0<\/strong>The features above align with a prior generation of products that automated the generation of data warehousing structures. Like data warehouse automation (DWA) products, DAaaS products rely on metadata to automatically generate SQL code, simplify changes, eliminate errors, and auto-generate documentation, including lineage. The main difference is that DAaaS products are low-code, no-code environments geared to both business users and IT developers, not just IT developers. And DAaaS products are designed to run in the cloud as easy-to-use SaaS products.<\/p>\n

    Summary\u00a0<\/strong><\/h4>\n

    DAaaS is not a new concept. Architects and engineers have long created development templates to foster reuse, speed development, and improve accuracy and efficiency. But DAaaS commercializes this approach, baking templates and automation into low code\/no code data pipeline products geared to business users. The ten criteria above represent base-level functionality that we believe all DAaaS products should support.<\/p>\n","protected":false},"excerpt":{"rendered":"

    Products that support data architecture-as-a-service are emerging. This article describes what to look for in a commercial DAaaS-based product. Data architecture as a service or DAaaS is a timeless concept wrapped within some new commercial data pipeline products. The goal of DAaaS is to inject architectural standards and SQL guardrails into no-code data development tools […]<\/p>\n","protected":false},"author":299,"featured_media":637,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[11],"tags":[],"acf":[],"yoast_head":"\nData Architecture as a Service: How to Evaluate Products<\/title>\n<meta name=\"description\" content=\"Products that support data architecture-as-a-service are emerging. This article describes what to look for in a commercial tools.\" \/>\n<meta name=\"robots\" content=\"noindex, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Data Architecture as a Service: How to Evaluate Products\" \/>\n<meta property=\"og:description\" content=\"Products that support data architecture-as-a-service are emerging. This article describes what to look for in a commercial tools.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/solutionsreview.com\/thought-leaders\/data-architecture-as-a-service-how-to-evaluate-products\/\" \/>\n<meta property=\"og:site_name\" content=\"Solutions Review Thought Leaders\" \/>\n<meta property=\"article:published_time\" content=\"2024-01-01T18:24:45+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-02-02T14:17:50+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/solutionsreview.com\/thought-leaders\/files\/2022\/12\/DaaS-Products.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"800\" \/>\n\t<meta property=\"og:image:height\" content=\"350\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Wayne Eckerson\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@https:\/\/twitter.com\/weckerson\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Wayne Eckerson\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/data-architecture-as-a-service-how-to-evaluate-products\/\",\"url\":\"https:\/\/solutionsreview.com\/thought-leaders\/data-architecture-as-a-service-how-to-evaluate-products\/\",\"name\":\"Data Architecture as a Service: How to Evaluate Products\",\"isPartOf\":{\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/data-architecture-as-a-service-how-to-evaluate-products\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/data-architecture-as-a-service-how-to-evaluate-products\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/solutionsreview.com\/thought-leaders\/files\/2022\/12\/DaaS-Products.jpg\",\"datePublished\":\"2024-01-01T18:24:45+00:00\",\"dateModified\":\"2024-02-02T14:17:50+00:00\",\"author\":{\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/#\/schema\/person\/d75007acd275fc4e2eb0f514050d1ca8\"},\"description\":\"Products that support data architecture-as-a-service are emerging. This article describes what to look for in a commercial tools.\",\"breadcrumb\":{\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/data-architecture-as-a-service-how-to-evaluate-products\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/solutionsreview.com\/thought-leaders\/data-architecture-as-a-service-how-to-evaluate-products\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/data-architecture-as-a-service-how-to-evaluate-products\/#primaryimage\",\"url\":\"https:\/\/solutionsreview.com\/thought-leaders\/files\/2022\/12\/DaaS-Products.jpg\",\"contentUrl\":\"https:\/\/solutionsreview.com\/thought-leaders\/files\/2022\/12\/DaaS-Products.jpg\",\"width\":800,\"height\":350,\"caption\":\"Data Architecture as a Service: How to Evaluate Products\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/data-architecture-as-a-service-how-to-evaluate-products\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/solutionsreview.com\/thought-leaders\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Data Architecture as a Service: How to Evaluate Products\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/#website\",\"url\":\"https:\/\/solutionsreview.com\/thought-leaders\/\",\"name\":\"Solutions Review Thought Leaders\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/solutionsreview.com\/thought-leaders\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/#\/schema\/person\/d75007acd275fc4e2eb0f514050d1ca8\",\"name\":\"Wayne Eckerson\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/thought-leaders\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/ea1e94439e0be8b4ecd527de5dcbb3c1?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/ea1e94439e0be8b4ecd527de5dcbb3c1?s=96&d=mm&r=g\",\"caption\":\"Wayne Eckerson\"},\"description\":\"Wayne Eckerson is an international thought leader in the data and analytics field since the early 1990s. He is a noted speaker, sought-after consultant, and widely read author. Eckerson has conducted groundbreaking research studies, chaired numerous conferences, and consulted with organizations around the world during his 25 years in the field. In 2014, Eckerson formed Eckerson Group to help organizations get more value from their data. His goal was to provide organizations with expert guidance during every stage of their data and analytics journey. As an industry analyst, Wayne thinks critically, writes clearly, and presents persuasively about complex topics. As a consultant, Wayne listens carefully, synthesizes accurately, and delivers highly tailored advice based on local context and personal experience. As an educator, Wayne creates vibrant communities of practice that encourage people to exchange ideas and share lessons learned.\",\"sameAs\":[\"https:\/\/www.eckerson.com\/\",\"https:\/\/www.linkedin.com\/in\/weckerson\/\",\"https:\/\/x.com\/https:\/\/twitter.com\/weckerson\"],\"url\":\"https:\/\/solutionsreview.com\/thought-leaders\/author\/wayne-eckerson\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Data Architecture as a Service: How to Evaluate Products","description":"Products that support data architecture-as-a-service are emerging. This article describes what to look for in a commercial tools.","robots":{"index":"noindex","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"og_locale":"en_US","og_type":"article","og_title":"Data Architecture as a Service: How to Evaluate Products","og_description":"Products that support data architecture-as-a-service are emerging. This article describes what to look for in a commercial tools.","og_url":"https:\/\/solutionsreview.com\/thought-leaders\/data-architecture-as-a-service-how-to-evaluate-products\/","og_site_name":"Solutions Review Thought Leaders","article_published_time":"2024-01-01T18:24:45+00:00","article_modified_time":"2024-02-02T14:17:50+00:00","og_image":[{"width":800,"height":350,"url":"https:\/\/solutionsreview.com\/thought-leaders\/files\/2022\/12\/DaaS-Products.jpg","type":"image\/png"}],"author":"Wayne Eckerson","twitter_card":"summary_large_image","twitter_creator":"@https:\/\/twitter.com\/weckerson","twitter_misc":{"Written by":"Wayne Eckerson","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/solutionsreview.com\/thought-leaders\/data-architecture-as-a-service-how-to-evaluate-products\/","url":"https:\/\/solutionsreview.com\/thought-leaders\/data-architecture-as-a-service-how-to-evaluate-products\/","name":"Data Architecture as a Service: How to Evaluate Products","isPartOf":{"@id":"https:\/\/solutionsreview.com\/thought-leaders\/#website"},"primaryImageOfPage":{"@id":"https:\/\/solutionsreview.com\/thought-leaders\/data-architecture-as-a-service-how-to-evaluate-products\/#primaryimage"},"image":{"@id":"https:\/\/solutionsreview.com\/thought-leaders\/data-architecture-as-a-service-how-to-evaluate-products\/#primaryimage"},"thumbnailUrl":"https:\/\/solutionsreview.com\/thought-leaders\/files\/2022\/12\/DaaS-Products.jpg","datePublished":"2024-01-01T18:24:45+00:00","dateModified":"2024-02-02T14:17:50+00:00","author":{"@id":"https:\/\/solutionsreview.com\/thought-leaders\/#\/schema\/person\/d75007acd275fc4e2eb0f514050d1ca8"},"description":"Products that support data architecture-as-a-service are emerging. This article describes what to look for in a commercial tools.","breadcrumb":{"@id":"https:\/\/solutionsreview.com\/thought-leaders\/data-architecture-as-a-service-how-to-evaluate-products\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/solutionsreview.com\/thought-leaders\/data-architecture-as-a-service-how-to-evaluate-products\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/thought-leaders\/data-architecture-as-a-service-how-to-evaluate-products\/#primaryimage","url":"https:\/\/solutionsreview.com\/thought-leaders\/files\/2022\/12\/DaaS-Products.jpg","contentUrl":"https:\/\/solutionsreview.com\/thought-leaders\/files\/2022\/12\/DaaS-Products.jpg","width":800,"height":350,"caption":"Data Architecture as a Service: How to Evaluate Products"},{"@type":"BreadcrumbList","@id":"https:\/\/solutionsreview.com\/thought-leaders\/data-architecture-as-a-service-how-to-evaluate-products\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/solutionsreview.com\/thought-leaders\/"},{"@type":"ListItem","position":2,"name":"Data Architecture as a Service: How to Evaluate Products"}]},{"@type":"WebSite","@id":"https:\/\/solutionsreview.com\/thought-leaders\/#website","url":"https:\/\/solutionsreview.com\/thought-leaders\/","name":"Solutions Review Thought Leaders","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/solutionsreview.com\/thought-leaders\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/solutionsreview.com\/thought-leaders\/#\/schema\/person\/d75007acd275fc4e2eb0f514050d1ca8","name":"Wayne Eckerson","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/thought-leaders\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/ea1e94439e0be8b4ecd527de5dcbb3c1?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/ea1e94439e0be8b4ecd527de5dcbb3c1?s=96&d=mm&r=g","caption":"Wayne Eckerson"},"description":"Wayne Eckerson is an international thought leader in the data and analytics field since the early 1990s. He is a noted speaker, sought-after consultant, and widely read author. Eckerson has conducted groundbreaking research studies, chaired numerous conferences, and consulted with organizations around the world during his 25 years in the field. In 2014, Eckerson formed Eckerson Group to help organizations get more value from their data. His goal was to provide organizations with expert guidance during every stage of their data and analytics journey. As an industry analyst, Wayne thinks critically, writes clearly, and presents persuasively about complex topics. As a consultant, Wayne listens carefully, synthesizes accurately, and delivers highly tailored advice based on local context and personal experience. As an educator, Wayne creates vibrant communities of practice that encourage people to exchange ideas and share lessons learned.","sameAs":["https:\/\/www.eckerson.com\/","https:\/\/www.linkedin.com\/in\/weckerson\/","https:\/\/x.com\/https:\/\/twitter.com\/weckerson"],"url":"https:\/\/solutionsreview.com\/thought-leaders\/author\/wayne-eckerson\/"}]}},"_links":{"self":[{"href":"https:\/\/solutionsreview.com\/thought-leaders\/wp-json\/wp\/v2\/posts\/504"}],"collection":[{"href":"https:\/\/solutionsreview.com\/thought-leaders\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/solutionsreview.com\/thought-leaders\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/thought-leaders\/wp-json\/wp\/v2\/users\/299"}],"replies":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/thought-leaders\/wp-json\/wp\/v2\/comments?post=504"}],"version-history":[{"count":0,"href":"https:\/\/solutionsreview.com\/thought-leaders\/wp-json\/wp\/v2\/posts\/504\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/thought-leaders\/wp-json\/wp\/v2\/media\/637"}],"wp:attachment":[{"href":"https:\/\/solutionsreview.com\/thought-leaders\/wp-json\/wp\/v2\/media?parent=504"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/solutionsreview.com\/thought-leaders\/wp-json\/wp\/v2\/categories?post=504"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/solutionsreview.com\/thought-leaders\/wp-json\/wp\/v2\/tags?post=504"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}