What is Azure Databricks

Question

Does Azure Databricks provide complete functionality as that of Spark? What does it include? Is it different from datafactory?

Answer 1

Azure Databricks is an Apache Spark-based analytics platform optimized for the Microsoft Azure cloud services platform.

Azure Databricks is a fast, easy, and collaborative Apache Spark-based analytics service. 

For a big data pipeline, the data (raw or structured) is ingested into Azure through Azure Data Factory in batches or streamed near real-time using Kafka, Event Hub, or IoT Hub. This data lands in a data lake for long term persisted storage, in Azure Blob Storage or Azure Data Lake Storage. 

As part of your analytics workflow, use Azure Databricks to read data from multiple data sources such as Azure Blob Storage, Azure Data Lake Storage, Azure Cosmos DB, or Azure SQL Data Warehouse and turn it into breakthrough insights using Spark.

Hope this helps!!

If you need to know more about Azure, enroll with Microsoft Azure training course today.

Thank you!!