PankajYadav.github.io

I have recently started learning Data Engineering and I’ve finished Week 1 of my course. These are the topics I’ve covered:

1. Overview of Distributed Systems
2. Hadoop Ecosystem Core Components (HDFS, MapReduce, YARN)
3. Hadoop Architecture
4. Hadoop Daemons
5. Hadoop Cluster Architecture
6. O/S vs U/S topic
7. Data Engineering Flow
8. HDFS Architecture: Data Node, Name Node, Replication Factor, Heartbeat, Secondary Name Node
9. ETL and ELT
10. Importance of Data Engineers – Why are they needed?