Lakehouse Solution using Microsoft FabricCreated a Lakehouse by ingesting sample data and also ingested additional data into the Lakehouse by using the copy data activity of the Data Factory pipeline to ingest the additional data from a blob storage. Transformed this data and prepared it for creating delta tables using Notebooks. Two approaches were implemented using Notebooks: (a)PySpark and (b)Spark SQL in order to join and aggregate the data for generating business aggregates. Connected to the Lakehouse using the TDS/SQL endpoint and created the relationship between the different tables. Lastly, created Power BI Reports to analyze the ingested data across different dimensions. NOTE: The below demo video is hosted on YouTube and incase you are unable to view this demo video then access has to be specifically provided.
|