Big Data Solutions

Big Data and Analytics

• Azure Synapse Analytics (Formerly SQL Data Warehouse)

  • Is designed to pull massive amounts of data

  • Someone came with the idea to pull all reporting data to it's own database

  • Can be done over night or at other timeframes

  • Can be expanded to includ other datasources

  • Open Source version of this (Apache Hadoop - MSFT offeres managed services)

• HDInsight (Managed services of Open Source products)

  • Apache Storm

  • Apache Kafka

  • Apache Spark

  • Apache Hadoop

  • Apache HBase

  • Apache Interactive Query

• Azure Databricks

  • Open Source Project

  • Data Analytics Platform

  • All users working in one workspace to make sense of the Data (using Jupyter Notebooks)

  • Real time Reporting & Hand Made notes