Name               :  Shekar

Experience        : 18+ Years of Industry

Trainee Details   :

** An ardent academician, trainer and consultant with proven proficiency in the fields of IT focusing on AI/Machine Learning, Data Science, Business Analytics and Cyber Security.
** Overseas experience in university-level post-graduate teaching and guidance.
** Working with pure play analytics vendors as AI/ Machine Learning, Data Science and Cyber Security Trainer and Consultant.
** Carried out a number of IT projects based on Machine Learning, Data Science, Cyber Security and Cloud Computing.

Course Timings  :

Course Duration :

work work

What you learn in Azure Data Engineering Course?

  • Introduction to Big Data
  • What is Haddop?
  • Hadoop Architecture
  • Working with HDFS COMMANDS
  • Working with Map Reduce
  • Introduction to Hive
  • Working with HQL QUERIES
  • Saving data to Serde,orc,rc,Avro,Parquet file format in Hive
  • Introduction to Spark
  • Local setup of Spark
  • Scala Programming Basics
  • Spark SQL- working on spark-shell
  • Working on IDE using Spark SQL
  • Saving data to mysql
  • Python Setup
  • Python Basics
  • Working with Pyspark
  • Introduction to Kafka
  • Kafka Basics
  • Introduction to Cassandra
  • Working with Cassandra Queries
  • Working with Spark Streaming
  • Introduction to MongoDb
  • MongoDb Basics
  • Working with mongo db atlas
  • What is Microsoft Azure?
  • Creating Microsoft Azure Account
  • What is HDInsights
  • Working with HDInsights with Hadoop Cluster
  • Working with HDInsights with Spark Cluster
  • Working with HDInsights with Interactive Query Cluster
  • What is Databricks?
  • Cluster setup
  • How to upload data/create table in databricks from csv
  • Azure Sql account creation
  • Create table from Azure Sql
  • Working with scala accessing data from azure sql
  • Working with scala saving data to azure sql
  • Creating notebooks in databricks
  • Creating Blob Storage
  • Working with scala accessing data from Blob Storage
  • Working with scala acessing data from Azure sql
  • Creating Azure Data Factory
  • Creating Azure Data Lake
  • Working with Azure Data Factory/Data Lake
  • Deploying jar file on databricks cluster
  • Creating visualization dashboard in databricks