{"id":31196,"date":"2023-10-18T11:36:32","date_gmt":"2023-10-18T09:36:32","guid":{"rendered":"https:\/\/device-insight.com\/?p=31196"},"modified":"2024-01-03T13:25:45","modified_gmt":"2024-01-03T12:25:45","slug":"databricks-unity-catalog-setting-the-new-standard-for-effective-data-governance","status":"publish","type":"post","link":"https:\/\/device-insight.com\/en\/databricks-unity-catalog-setting-the-new-standard-for-effective-data-governance\/","title":{"rendered":"Databricks Unity Catalog: Setting The New Standard for Effective Data Governance"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"31196\" class=\"elementor elementor-31196 elementor-31195\" data-elementor-settings=\"{&quot;ha_cmc_init_switcher&quot;:&quot;no&quot;}\" data-elementor-post-type=\"post\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-d0d092a elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"d0d092a\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;_ha_eqh_enable&quot;:false}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-c46e876 blog_col\" data-id=\"c46e876\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-783644d elementor-widget elementor-widget-theme-post-title elementor-page-title elementor-widget-heading\" data-id=\"783644d\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"theme-post-title.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h1 class=\"elementor-heading-title elementor-size-default\">Databricks Unity Catalog: Setting The New Standard for Effective Data Governance<\/h1>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-4d38aa9 elementor-widget elementor-widget-post-info\" data-id=\"4d38aa9\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"post-info.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<ul class=\"elementor-inline-items elementor-icon-list-items elementor-post-info\">\n\t\t\t\t\t\t\t\t<li class=\"elementor-icon-list-item elementor-repeater-item-b86a0c7 elementor-inline-item\" itemprop=\"datePublished\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t<span class=\"elementor-icon-list-text elementor-post-info__item elementor-post-info__item--type-date\">\n\t\t\t\t\t\t\t\t\t\t<time>2023\/10\/18<\/time>\t\t\t\t\t<\/span>\n\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t<li class=\"elementor-icon-list-item elementor-repeater-item-808e92e elementor-inline-item\" itemprop=\"about\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t<span class=\"elementor-icon-list-text elementor-post-info__item elementor-post-info__item--type-terms\">\n\t\t\t\t\t\t\t\t\t\t<span class=\"elementor-post-info__terms-list\">\n\t\t\t\t<a href=\"https:\/\/device-insight.com\/category\/news\/\" class=\"elementor-post-info__terms-list-item\">News<\/a>\t\t\t\t<\/span>\n\t\t\t\t\t<\/span>\n\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t<\/ul>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-34dbdea elementor-widget elementor-widget-text-editor\" data-id=\"34dbdea\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>In our last blog post focused on Industrial Analytics, we discussed <a href=\"https:\/\/device-insight.com\/en\/2023\/09\/28\/eu-data-act\/\" rel=\"noopener\">the influence of legal frameworks on data strategies and platforms<\/a>. Now, we shift our focus to another pivotal topic: Data Governance. In essence, Data Governance refers to the comprehensive strategy for managing and controlling data resources, ensuring they are reliable, consistent, secure, and valuable to businesses. In the context of a <a href=\"https:\/\/device-insight.com\/en\/2023\/08\/24\/analytics-blog-data-lakehouse\/\" rel=\"noopener\">Data Lakehouse architecture<\/a>, there&#8217;s only one encompassing solution that aligns modern governance of data with artificial intelligence (AI): <a href=\"https:\/\/www.databricks.com\/product\/unity-catalog\" target=\"_blank\" rel=\"noopener\">the Databricks Unity Catalog<\/a>.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-363348a elementor-section-full_width elementor-section-height-min-height elementor-section-height-default elementor-section-items-middle\" data-id=\"363348a\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;_ha_eqh_enable&quot;:false}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-1854b6c\" data-id=\"1854b6c\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-e1ef762 elementor-widget elementor-widget-image\" data-id=\"e1ef762\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" src=\"https:\/\/device-insight.com\/wp-content\/uploads\/2019\/06\/IoT-Plattform-e1643810047621.jpg\" title=\"IoT platform\" alt=\"IoT platform\" loading=\"lazy\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-196b39f elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"196b39f\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;_ha_eqh_enable&quot;:false}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-4058497 blog_col\" data-id=\"4058497\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-ac75eb8 elementor-widget elementor-widget-text-editor\" data-id=\"ac75eb8\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Especially for companies that employ or consider using modern Lakehouse architecture and aim to implement AI-driven use cases, this feature of the Databricks platform stands out. Unity Catalog facilitates seamless management of both structured and unstructured data and AI resources, machine learning models, Jupyter notebooks, dashboards, and files, which can be hosted across various clouds or platforms. Such versatility makes it easier for companies to organize and manage information in their <a href=\"https:\/\/device-insight.com\/en\/2023\/08\/24\/analytics-blog-data-lakehouse\/\">Data Lakehouse<\/a>. Plus, data from platforms like MySQL, PostgreSQL, Amazon Redshift, Snowflake, Azure SQL, Azure Synapse, and Google&#8217;s BigQuery can be consolidated in one place.<\/p><p>A critical note for decision-makers is that the Unity Catalog integrates with your existing data catalogs, storage systems, and governance solutions. Thus, users can continue leveraging their current investments and build a future-proof governance model <a href=\"https:\/\/device-insight.com\/en\/landing-page\/expert-paper-iot-platform-migration\/\">without incurring hefty migration costs<\/a>.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3385951 elementor-widget elementor-widget-heading\" data-id=\"3385951\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Unity Catalog: Your key to efficient data management and compliance <\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-ec54233 elementor-widget elementor-widget-text-editor\" data-id=\"ec54233\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>For data scientists, data analysts, and engineers, Databricks&#8217; Unity Catalog is a precious tool to break down data silos. It acts as a central hub to securely search, access, and collaborate on trusted data and resources. This enhances team interactions and knowledge sharing, boosting work efficiency. By securely searching, understanding, and drawing insights from your data and utilizing AI through natural language, productivity is further amplified.<\/p><p>The Unity Catalog also assists businesses in optimizing their <a href=\"https:\/\/device-insight.com\/en\/2023\/08\/24\/analytics-blog-data-lakehouse\/\">Lakehouse data architecture.<\/a> Through better management of data and resources, they can fully realize the potential of this environment. The unified governance approach of Unity Catalog also accelerates data-driven processes and AI initiatives, ensuring compliance with legal regulations. This fosters trust and security in managing company data and AI resources \u2013 a vital precondition for harnessing these technologies to develop digital business models<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-866fb44 elementor-widget elementor-widget-heading\" data-id=\"866fb44\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Data Governance with Unity Catalog: Diverse application possibilities<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3c8e896 elementor-widget elementor-widget-text-editor\" data-id=\"3c8e896\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>One example of using the Unity Catalog is simplifying access management. It reduces the complexity brought about by <a href=\"https:\/\/www.microsoft.com\/de-de\/security\/business\/security-101\/what-is-identity-access-management-iam\" target=\"_blank\" rel=\"noopener\">IAM Policies<\/a> and other data control platforms, allowing users to focus on business-relevant use cases.<\/p><p>Other applications include utilizing AI tools to automate process monitoring, diagnose errors, and maintain the quality of data and ML models. Companies benefit from proactive alerts that automatically detect personal data, track model deviations, and effectively address issues in their data and AI pipelines, ensuring accuracy and integrity. It&#8217;s also possible to establish comprehensive Lakehouse monitoring of data and AI with operational intelligence using integrated system tables for billing, auditing, lineage, and more.<\/p><p class=\"MsoNormal\">To sum up: The Unity Catalog simplifies processes through centralized data management and modern functionalities, ensuring high data quality. It paves the way for a data-driven enterprise.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-4111dff elementor-widget elementor-widget-heading\" data-id=\"4111dff\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Industrial Analytics Blog Series Part 4: Spot on IIoT use cases <\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-eeea0d2 elementor-widget elementor-widget-text-editor\" data-id=\"eeea0d2\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>In part 4 of our Analytics Blog Series, we&#8217;ll explore the IoT use cases achievable with data analytics and machine learning, with a special focus on manufacturing. So, stay tuned!  <\/p>\n<p>+++ With our IoT expertise, we at Device Insight actively implement the advantages of the Lakehouse concept for our customers. We integrate machine data with Databricks services to realize use cases in advanced analytics, AI and machine learning. +++<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-30f11999 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"30f11999\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;_ha_eqh_enable&quot;:false}\">\n\t\t\t\t\t\t\t<div class=\"elementor-background-overlay\"><\/div>\n\t\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-753f4c01\" data-id=\"753f4c01\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-592c2816 elementor-widget elementor-widget-heading\" data-id=\"592c2816\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Recommended posts<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-4d9a52af elementor-widget elementor-widget-shortcode\" data-id=\"4d9a52af\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"shortcode.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<div class=\"elementor-shortcode\"><div class=\"teasers teasers-single-post\"><div class=\"teasers__container\"><div class=\"teasers__single-teaser\"><a class=\"thumbnail-link\" href=\"https:\/\/device-insight.com\/en\/predictive-maintenance-with-ml-ai\/\"><img decoding=\"async\" src=\"https:\/\/device-insight.com\/wp-content\/uploads\/2025\/04\/Blog-Header-11-1024x427.jpg\" alt=\"Image\"><\/a><div class=\"teasers__content\"><div class=\"date__box\"><div class=\"date__box-date\">2025\/04\/25<\/div><a href=\"https:\/\/device-insight.com\/category\/whitepaper\/\" class=\"date__box-button\">Whitepaper<\/a><\/div><h2 class=\"headline\"><a href=\"https:\/\/device-insight.com\/en\/predictive-maintenance-with-ml-ai\/\">Data-Driven Maintenance: Let your machines tell you what they need<\/a><\/h2><div class=\"description\">How Predictive Maintenance Improves OEE in the Data-Driven Factory.<\/div><\/div><\/div><div class=\"teasers__single-teaser\"><a class=\"thumbnail-link\" href=\"https:\/\/device-insight.com\/en\/data-driven-production\/\"><img decoding=\"async\" src=\"https:\/\/device-insight.com\/wp-content\/uploads\/2025\/01\/Blog-Header-8-1024x427.jpg\" alt=\"Image\"><\/a><div class=\"teasers__content\"><div class=\"date__box\"><div class=\"date__box-date\">2025\/03\/06<\/div><a href=\"https:\/\/device-insight.com\/category\/whitepaper\/\" class=\"date__box-button\">Whitepaper<\/a><\/div><h2 class=\"headline\"><a href=\"https:\/\/device-insight.com\/en\/data-driven-production\/\">Why data-driven production is the key to competitiveness<\/a><\/h2><div class=\"description\">How companies benefit from the Data-Driven Factory approach.<\/div><\/div><\/div><div class=\"teasers__single-teaser\"><a class=\"thumbnail-link\" href=\"https:\/\/device-insight.com\/en\/gerolsteiner-data-driven-factory\/\"><img decoding=\"async\" src=\"https:\/\/device-insight.com\/wp-content\/uploads\/2024\/10\/Gerolsteiner_Data-Driven-Factory_Featured.jpg\" alt=\"Image\"><\/a><div class=\"teasers__content\"><div class=\"date__box\"><div class=\"date__box-date\">2024\/10\/30<\/div><a href=\"https:\/\/device-insight.com\/category\/case-studies\/\" class=\"date__box-button\">Case Studies<\/a><\/div><h2 class=\"headline\"><a href=\"https:\/\/device-insight.com\/en\/gerolsteiner-data-driven-factory\/\">Gerolsteiner: How to succeed on the path to the data-driven factory<\/a><\/h2><div class=\"description\">How Gerolsteiner is becoming faster and more flexible with the help of a Data Intelligence Platform.<\/div><\/div><\/div><\/div><\/div>\n<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Unlocking Modern Data Governance Excellence with the Databricks Unity Catalog.<\/p>\n","protected":false},"author":4,"featured_media":13968,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"elementor_header_footer","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[27],"tags":[165],"class_list":["post-31196","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news","tag-data-lakehouse-en"],"acf":[],"_links":{"self":[{"href":"https:\/\/device-insight.com\/en\/wp-json\/wp\/v2\/posts\/31196","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/device-insight.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/device-insight.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/device-insight.com\/en\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/device-insight.com\/en\/wp-json\/wp\/v2\/comments?post=31196"}],"version-history":[{"count":12,"href":"https:\/\/device-insight.com\/en\/wp-json\/wp\/v2\/posts\/31196\/revisions"}],"predecessor-version":[{"id":32423,"href":"https:\/\/device-insight.com\/en\/wp-json\/wp\/v2\/posts\/31196\/revisions\/32423"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/device-insight.com\/en\/wp-json\/wp\/v2\/media\/13968"}],"wp:attachment":[{"href":"https:\/\/device-insight.com\/en\/wp-json\/wp\/v2\/media?parent=31196"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/device-insight.com\/en\/wp-json\/wp\/v2\/categories?post=31196"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/device-insight.com\/en\/wp-json\/wp\/v2\/tags?post=31196"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}