This solo project demonstrates a complete data engineering and BI pipeline using:
🔧 Tools: Python | Azure Data Factory | Azure Data Lake | Azure SQL | Power BI
- Extracted company data
- Cleaned data using Python (Google Colab)/Use Azure Data flows(Recommended)
- Stored raw data in Azure Data Lake
- Moved cleaned data to Azure SQL using Azure Data Factory
- Visualized insights using Power BI
- Top 10 companies by revenue
- Revenue by country (map view)
- Revenue by industry (pie chart)
- Average number of employees
- Slicers for filtering by rank, country, and industry
- Python (BeautifulSoup, Pandas)
- Azure Data Factory (ETL)
- Azure Data Lake (Storage)
- Azure SQL (Database)
- Power BI (Dashboard)
Pasindu Nimsara
LinkedIn Profile