Data Engineer Course

Name: Introduction To Data Engineer Course | Henry Harvin
Uploaded: 2024-02-26 04:15:43
Description: Master the most up-to-date practical skills and knowledge data engineers use in their daily roles | Build data architectures that can scale to accommodate growing data needs, guaranteeing smooth operations even in the face of significant data influx.

Module 1: Python
- Why python ?
- Python IDE
- Variables & Names
- String Basics
- List
- Tuple
- Dictionaries
- Conditional Statements
- For and While Loop , TRY AND EXCEPT
- Numbers and Math Functions
- Common Errors in Python
- FUNCTIONS , Lambda, Filters and Map
- Functions as Arguments
- List Comprehension
- Debugging in Python
- Class and Objects
- Inheritance , polymorphism , abstractions
- Linear and nonLinear Data structures
- Singly , doubly ,circular Linked list , Binary tree
- Bubble , insertion , merge ,quick , Heap sorting
- File Handling (Text , Json , csv )
- Iterators
- Pickling, Multi Threading
Module 2: SQL
- Joins
- SQL Outer Join
- SQL Left Join
- SQL Right Join
- SQL Full Join
- SQL Cross Join
- Integrating Python SQL
- Window functions(rank, dense_rank, row number, etc)
- Data Types, Variables, and Constants
- Conditional
- Structures(IF,CASE,GOTO, and NULL)
- Stored procedures and Function
- Sub queries
Module 3: RDBMS
- MYSQL
- SQL KEYS
- PRIMARY KEY
- FOREIGN KEY
- UNIQUE KEY
- composite key
- triggers
- indexes
- transaction
- views
Module 4: System Design
- Load balancer and High availability
- Horizontal vs Vertical Scaling
- Monolithic vs microservice
- Distributed messaging service and Aws SQS
- CDN (content delivery Network)
- Caching , scalability
- Aws API gateway
Module 5: MongoDB
- CAP Theorem
- structured and
- unstructured data
- OLTP vs OLAP
- Schema vs Schema less
- Dimensional modeling
- Cluster set and up
- Monitoring"
- Insert First Data
- CRUD Operations
- Insert Many
- Update and Update Many
- Delete and Delete Many
- Projection
- Intro to Embed Documents
- Embed Documents in Action
- Adding Arrays
- Fetching Data From
- Structured Data
- Schema Types
- Types of Data in MongoDB
- Relationship between data's
- Aggregation
- One to One using Embed Method
- One to One using Reference Many
- One to Many Embed
- One to ManyReference Method
Module 6: Git
- Introduction to Git
- Git commands
- cloning repository in vs code
- Working on cloning branches, commit, push, add, merge from vs code
Module 7: AWS Cloud
- Introduction to Cloud
- AWS Services overview
- Server vs serverless
- IAM ,roles , policies
- EC2 , VM’s
- S3
- RDS – MySQL Free tier database ,
- Integrating RDS to Local System and Integrating RDS to Python Environment
- Cloud data warehouse
- Cloud Data Lake
- Cloud database (DynamoDB)
- Lambda
- Cloud Watch,
- Integrated Rating All the Above
- Components and RDS
- Monitoring ETL pipeline with Step function
- Glue, Data crawler, Athena
- Monitoring ETL pipeline with step function
Module 8: Snowflake
- Introduction to snowflake
- Difference between Datalake,Data Warehouse,Data Lake,Database
- Dimension and Fact Tables
- Roles and users
- Data modeling , snowpipe
- MOLAP and ROLAP
- Partitioning and indexing
- Data mart and data cubes & caching
- Data masking
- Handling json files
- Data loading from S3 and transformation
Module 9: Big Data
- Installing Hive, Installing MYSQL Locally ,
- Running Hive Query to integrate Local and HDFS file system
- Installing Pig,
- Working with Pig script and integrating with local and HDFS file system
- Installing HBase working with HBase Query
- Installing Cassandra and working with Cassandra
- Installing Sqoop and flume and do the data Migration,
- Local RDBMS to HDFS,
- Local RDBMS to Hive,
- Local RDBMS to HBase,
- HDFS to local RDBMS
- Hive to RDBMS
Module 10: Data Engineer Capstone

By the end of the Data Engineering certification course, showcase your new Data Engineering skills with a hands-on, industry-relevant capstone project bringing everything you learned in the program together into one portfolio-worthy example. You can choose to work on projects in ecommerce, BFSI, or video sharing to make your practice more relevant.
Complementary Module 1: Soft Skills Development
- Business communication
- Preparation for the Interview
- Presentation Skills
Complimentary Module 2: Resume Writing

Resume Writing

Checkout Learner's Experiences on LinkedIn

Mohan
★ ★ ★ ★ ★

Ramaswamy
★ ★ ★ ★ ★

AMBATI
★ ★ ★ ★ ★

Vikram
★ ★ ★ ★ ★