DATA ENGINEERING WITH DATABRICKS COOKBOOK

• Verfasst von: Chadha, Pulkit [VerfasserIn]
• Titel: DATA ENGINEERING WITH DATABRICKS COOKBOOK
• Titelzusatz: build effective data and AI solutions using Apache Spark, Databricks, and Delta Lake
• Verf.angabe: Pulkit Chadha
• Ausgabe: 1st edition.
• Verlagsort: Birmingham, UK
• Verlag: Packt Publishing Ltd.
• Jahr: 2024
• Umfang: 1 online resource
• ISBN: 978-1-83763-206-0
• ISBN: 1-83763-206-5
• ISBN: 978-1-83763-335-7
• Datenträger: Online-Ressource
• Sprache: eng
• Bibliogr. Hinweis: Erscheint auch als : Druck-Ausgabe
• Sach-SW: Exploration de données (Informatique)
• K10plus-PPN: 1892761114
• K10plus-PPN:
  Universitätsbibliothek
• Lokale URL UB: Zum Volltext
• Lokale URL UB: Bibliothek der Medizinischen Fakultät Mannheim der Universität Heidelberg
• Bibliothek/Idn: UW / m454444991X
• Lokale URL Inst.: Zum Volltext

Abstract

Data Engineering with Databricks Cookbook will guide you through recipes to effectively use Apache Spark, Delta Lake, and Databricks for data engineering, beginning with an introduction to data ingestion and loading with Apache Spark. As you progress, you’ll be introduced to various data manipulation and data transformation solutions that can be applied to data. You'll find out how to manage and optimize Delta tables, as well as how to ingest and process streaming data. The book will also show you how to improve the performance problems of Apache Spark apps and Delta Lake. Later chapters will show you how to use Databricks to implement DataOps and DevOps practices and teach you how to orchestrate and schedule data pipelines using Databricks Workflows. Finally, you’ll understand how to set up and configure Unity Catalog for data governance. By the end of this book, you’ll be well-versed in building reliable and scalable data pipelines using modern data engineering technologies.