From the course: Microsoft Fabric Analytics Engineer Associate (DP-600) Cert Prep by Microsoft Press

Unlock this course with a free trial

Join today to access over 25,400 courses taught by industry experts.

Data ingestion using Dataflow Gen2 and data pipeline

Data ingestion using Dataflow Gen2 and data pipeline

- [Instructor] Microsoft Fabric offers a comprehensive solution for data engineering, integration, and analytics requirements. A critical aspect of complete analytics process is data ingestion. With Dataflow, data is sourced, and transformed from various origins, and after cleaning it, it is directed to a designated destination. Data pipeline complement dataflow by providing a structured control flow for execution. While dataflow focuses on data transformation, data Pipeline allows you to organize, and manage these transformations. We can have one of multiple Dataflow inside a pipeline. Dataflow Gen 2 brings the new features, and the improved experience along with Power BI Dataflow, which is Gen 1. Now, let's talk about what is Dataflow Gen 2. It is a cloud-based ETL tool for building, and running data processing pipelines. Live Dataflow Gen 1, Gen 2 lets you transform the data, and store it in internal…

Contents