> For the complete documentation index, see [llms.txt](https://docs.arkannis.net/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.arkannis.net/cloud/azure/courses/az900-course/azure-core-solutions/big-data-solutions.md).

# Big Data Solutions

## Big Data and Analytics

* Azure Synapse Analytics (Formerly SQL Data Warehouse)
  * Is designed to pull massive amounts of data
  * Someone came with the idea to pull all reporting data to it's own database
  * Can be done over night or at other timeframes
  * Can be expanded to includ other datasources
  * Open Source version of this (Apache Hadoop - MSFT offeres managed services)
* HDInsight (Managed services of Open Source products)
  * Apache Storm
  * Apache Kafka
  * Apache Spark
  * Apache Hadoop
  * Apache HBase
  * Apache Interactive Query
* Azure Databricks
  * Open Source Project
  * Data Analytics Platform
  * All users working in one workspace to make sense of the Data (using Jupyter Notebooks)
  * Real time Reporting & Hand Made notes