Data and Analytics

T03 Azure Data Lakes and Delta Lakes

05/16/2023

8:00am - 9:15am

Level: Introductory to Intermediate

Ken Muse

Senior DevOps Architect

GitHub

The data is coming, and it's coming fast! You've figured out how to receive the data, so now it's time to understand what to do with it. You need to define an architecture that can scale quickly, process high volumes of data, and organize the data for reporting as part of a Modern Data Warehouse. Whether it's gigabytes or petabytes, the foundation of this design pattern on Azure begins with Azure Data Lake Storage. In this session, we'll explore how to create and manage data at scale. We'll examine creating data lakes, the zone and medallion patterns, and when and how to use Delta Lakes to improve the experience.

You will learn:

  • A basic understanding of data lakes and how NoSQL data is organized
  • Data organization and partitioning with the Zone and Medallion patterns
  • What is a Delta Lake, and when and why to utilize that technology