Managing a Data Mesh with Dataplex

Managing a Data Mesh with DataplexMDMDGOGoogleGO-MDMD1.0<ul> <li>Identify the importance of a modern data platform</li><li>Configure and set up Dataplex</li><li>Secure data lakes, zones, and assets</li><li>Implement tagging for resources and use tags to search for assets</li><li>Process data using Dataplex tasks</li><li>Design, execute and report on data quality processes</li></ul>Completion of the <a class="fl-href-prod" href="/swisscom/en/course/google-mdldw"><svg role="img" aria-hidden="true" focusable="false" data-nosnippet class="cms-linkmark"><use xlink:href="/css/img/icnset-linkmarks.svg#linkmark"></use></svg>Modernizing Data Lakes and Data Warehouses with Google Cloud (MDLDW)</a> and <a class="fl-href-prod" href="/swisscom/en/course/google-bbdp"><svg role="img" aria-hidden="true" focusable="false" data-nosnippet class="cms-linkmark"><use xlink:href="/css/img/icnset-linkmarks.svg#linkmark"></use></svg>Building Batch Data Pipelines on Google Cloud (BBDP)</a> courses in the "Data Engineer" learning path or equivalent experience using Google Cloud.<h4>Module 1 - Introduction to Dataplex</h4> Topics: <ul> <li>Modern Data Platforms and Data-Oriented Design</li><li>Pillars of Data Governance</li><li>What is Dataplex?</li><li>Dataplex Capabilities</li><li>Dataplex compared with other products on Google Cloud</li></ul>Objectives: <ul> <li>Identify the importance of a modern data platform</li><li>Explain the role of Dataplex on Google Cloud</li></ul><h4>Module 2 - Creating a Data Mesh on Dataplex</h4> Topics: <ul> <li>What is a data mesh?</li><li>Dataplex concepts</li><li>Creating data lakes and zones</li><li>Assets in Dataplex</li></ul>Objectives: <ul> <li>Define key Dataplex concepts</li><li>Configure and set up Dataplex</li></ul>Activities: <ul> <li>Lab: Provision a Data Mesh using Dataplex</li></ul><h4>Module 3 - Processing Data on Dataplex</h4> Topics: <ul> <li>Processing data on Dataplex</li><li>Data preparation tasks</li><li>Ingestion jobs</li><li>Dataflow and Spark tasks</li></ul>Objectives: <ul> <li>Understand different data processing options in Dataplex</li><li>Configure and run data preparation tasks on Dataplex</li></ul>Activities: <ul> <li>Lab: Standardize Data using Dataplex Tasks</li></ul><h4>Module 4 - Managing Data Security through Dataplex</h4> Topics: <ul> <li>IAM permissions and roles</li><li>Securing your data lake</li><li>Policy management</li><li>Metadata security</li></ul>Objectives: <ul> <li>Secure data lakes, zones, and assets in Dataplex</li></ul>Activities: <ul> <li>Lab: Manage Data Security using Dataplex</li></ul><h4>Module 5 - Data Tagging and Data Catalog</h4> Topics: <ul> <li>Introduction to Data Catalog</li><li>Technical metadata vs. business metadata</li><li>Tags and tag templates</li><li>Entries and entry groups</li><li>Data lineage</li></ul>Objectives: <ul> <li>Implement tagging for resources and use tags to search for assets</li></ul>Activities: <ul> <li>Lab: Data Catalog and Data Lineage</li></ul><h4>Module 6 - Data Quality and Profiling</h4> Topics: <ul> <li>Data quality tasks and AutoDQ</li><li>Reporting on data quality</li><li>Data profiling</li></ul>Objectives: <ul> <li>Design, execute and report on data quality processes</li></ul>Activities: <ul> <li>Lab: Data Quality and Profiling your Data in BigQuery</li></ul><h4>Module 7 - Dataplex Best Practices</h4> Topics: <ul> <li>Best practices</li><li>End-to-end demo</li></ul>Objectives: <ul> <li>Implement best practices for Dataplex</li></ul>Activities: <ul> <li>Challenge Lab: Managing a Data Mesh with Dataplex</li></ul>- Identify the importance of a modern data platform - Configure and set up Dataplex - Secure data lakes, zones, and assets - Implement tagging for resources and use tags to search for assets - Process data using Dataplex tasks - Design, execute and report on data quality processesCompletion of the Modernizing Data Lakes and Data Warehouses with Google Cloud (MDLDW) and Building Batch Data Pipelines on Google Cloud (BBDP) courses in the "Data Engineer" learning path or equivalent experience using Google Cloud.Module 1 - Introduction to Dataplex Topics: - Modern Data Platforms and Data-Oriented Design - Pillars of Data Governance - What is Dataplex? - Dataplex Capabilities - Dataplex compared with other products on Google Cloud Objectives: - Identify the importance of a modern data platform - Explain the role of Dataplex on Google Cloud Module 2 - Creating a Data Mesh on Dataplex Topics: - What is a data mesh? - Dataplex concepts - Creating data lakes and zones - Assets in Dataplex Objectives: - Define key Dataplex concepts - Configure and set up Dataplex Activities: - Lab: Provision a Data Mesh using Dataplex Module 3 - Processing Data on Dataplex Topics: - Processing data on Dataplex - Data preparation tasks - Ingestion jobs - Dataflow and Spark tasks Objectives: - Understand different data processing options in Dataplex - Configure and run data preparation tasks on Dataplex Activities: - Lab: Standardize Data using Dataplex Tasks Module 4 - Managing Data Security through Dataplex Topics: - IAM permissions and roles - Securing your data lake - Policy management - Metadata security Objectives: - Secure data lakes, zones, and assets in Dataplex Activities: - Lab: Manage Data Security using Dataplex Module 5 - Data Tagging and Data Catalog Topics: - Introduction to Data Catalog - Technical metadata vs. business metadata - Tags and tag templates - Entries and entry groups - Data lineage Objectives: - Implement tagging for resources and use tags to search for assets Activities: - Lab: Data Catalog and Data Lineage Module 6 - Data Quality and Profiling Topics: - Data quality tasks and AutoDQ - Reporting on data quality - Data profiling Objectives: - Design, execute and report on data quality processes Activities: - Lab: Data Quality and Profiling your Data in BigQuery Module 7 - Dataplex Best Practices Topics: - Best practices - End-to-end demo Objectives: - Implement best practices for Dataplex Activities: - Challenge Lab: Managing a Data Mesh with Dataplex2 days1495.001300.001500.001320.001500.001500.002065.001550.001500.00