Data engineering with databricks cookbook

Rubriek: Textual/Printed/Reference Materials - Boek

Prijs: € 29.99

Rating: 0/5

☆

☆

☆

☆

☆

Verzending:
Direct beschikbaar

Work through 70 recipes for implementing reliable data pipelines with Apache Spark, optimally store and process structured and unstructured data in Delta Lake, and use Databricks to orchestrate and govern your data

Key Features Learn data ingestion, data transformation, and data management techniques using Apache Spark and Delta Lake Gain practical guidance on using Delta Lake tables and orchestrating data pipelines Implement reliable DataOps and DevOps practices, and enforce data governance policies on Databricks Purchase of the print or Kindle book includes a free PDF eBook Book DescriptionWritten by a Senior Solutions Architect at Databricks, Data Engineering with Databricks Cookbook will show you how to effectively use Apache Spark, Delta Lake, and Databricks for data engineering, starting with comprehensive introduction to data ingestion and loading with Apache Spark. What makes this book unique is its recipe-based approach, which will help you put your knowledge to use straight away and tackle common problems. You’ll be introduced to various data manipulation and data transformation solutions that can be applied to data, find out how to manage and optimize Delta tables, and get to grips with ingesting and processing streaming data. The book will also show you how to improve the performance problems of Apache Spark apps and Delta Lake. Advanced recipes later in the book will teach you how to use Databricks to implement DataOps and DevOps practices, as well as how to orchestrate and schedule data pipelines using Databricks Workflows. You’ll also go through the full process of setup and configuration of the Unity Catalog for data governance. By the end of this book, you’ll be well-versed in building reliable and scalable data pipelines using modern data engineering technologies. What you will learn Perform data loading, ingestion, and processing with Apache Spark Discover data transformation techniques and custom user-defined functions (UDFs) in Apache Spark Manage and optimize Delta tables with Apache Spark and Delta Lake APIs Use Spark Structured Streaming for real-time data processing Optimize Apache Spark application and Delta table query performance Implement DataOps and DevOps practices on Databricks Orchestrate data pipelines with Delta Live Tables and Databricks Workflows Implement data governance policies with Unity Catalog Who this book is for

This book is for data engineers, data scientists, and data practitioners who want to learn how to build efficient and scalable data pipelines using Apache Spark, Delta Lake, and Databricks. To get the most out of this book, you should have basic knowledge of data architecture, SQL, and Python programming.

• 1 Bekijk alle specificaties

Business Intelligence with Databricks SQL

Rating: 0 / 5 | Prijs: € 27.99

master critical skills needed to deploy and use databricks sql and elevate your bi from the warehouse to the lakehouse with confidence key features learn about business intelligence on the lakehouse with features and functions of databricks sql make the most of databricks sql by getting to Direct beschikbaar .. MEER INFO

Data Engineering with Databricks Cookbook: Build effective data and AI solutions using Apache Spark, Databricks, and Delta Lake

Rating: 0 / 5 | Prijs: € 41.41

2 - 3 weken .. MEER INFO

Azure Data Engineering Cookbook

Rating: 0 / 5 | Prijs: € 30.99

nearly 80 recipes to help you collect and transform data from multiple sources into a single data source making it way easier to perform analytics on the data key features build data pipelines from scratch and find solutions to common data engineering problems learn how to work with azure Direct beschikbaar .. MEER INFO

Taal: en

Bindwijze: E-book

Oorspronkelijke releasedatum: 31 mei 2024

Ebook Formaat: Adobe ePub

Hoofdauteur: Pulkit Chadha

Hoofduitgeverij: Packt Publishing

Lees dit ebook op: Desktop (Mac en Windows)

Lees dit ebook op: Kobo e-reader

Lees dit ebook op: Android (smartphone en tablet)

Lees dit ebook op: iOS (smartphone en tablet)

Lees dit ebook op: Windows (smartphone en tablet)

Studieboek: Nee

EAN: 9781837632060

---