Skip to content
View invictusaman's full-sized avatar
πŸ‘‹
Let's connect.
πŸ‘‹
Let's connect.

Block or report invictusaman

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don't include any personal information such as legal names or email addresses. Markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
invictusaman/README.md

Hi there

Thanks for visiting my profile! I'm a Senior Data Engineer with 6+ years of experience building scalable data platforms across agriculture, logistics, healthcare, and financial services.

πŸš€ What I Do

  • πŸ—οΈ Design and build cloud-native data platforms on Azure and AWS
  • ⚑ Develop high-performance ETL/ELT pipelines using Spark, Databricks, and Snowflake
  • 🎯 Implement modern data lakehouse architectures with Delta Lake and Medallion design
  • πŸ“Š Create dimensional data models and analytics solutions for business intelligence
  • πŸ”’ Build data governance frameworks with Unity Catalog and quality validation systems

πŸ”­ Current Focus

  • Building scalable data solutions at Bayer Canada using Azure Databricks and Delta Lake
  • Optimizing agricultural data pipelines for crop research and commercial analytics
  • Contributing to open-source data engineering projects
  • Sharing knowledge through technical blogs and tutorials

πŸ’» Tech Stack:


Cloud Platforms
Azure AWS Databricks

Big Data & Processing
Apache Spark Apache Hadoop Apache Hive Apache Airflow

Data Warehousing
Snowflake Azure Synapse Amazon Redshift

Programming Languages
Python Scala SQL

Data Engineering Tools
Pandas NumPy Delta Lake

Databases
PostgreSQL MySQL MicrosoftSQLServer

DevOps & Version Control
Git GitHub Jenkins Azure DevOps

Data Visualization
Tableau Power BI




πŸ“« Let's Connect!


πŸ’° You can help me by Donating

BuyMeACoffee PayPal

⭐️ Open to collaborating on data engineering projects and contributing to open-source!

Pinned Loading

  1. my-personal-portfolio my-personal-portfolio Public

    This repo is for my personal data portfolio website! This has been in the planning phase for a really long time so I am glad that I can have this space where I can contribute my data experience, pr…

    TypeScript 13

  2. Indeed-WebScraper Indeed-WebScraper Public

    I created a webscraper tool to fetch indeed data. It will return job title, company name, url of the job, salary(if present) and many more.

    Python 3 1

  3. coursera-content-downloader coursera-content-downloader Public

    Forked from csyezheng/coursera-helper

    A command line tool for downloading contents from different courses from coursera.

    Python 1 1

  4. Ecommerce-Data-Pipeline Ecommerce-Data-Pipeline Public

    This project demonstrates an end-to-end data engineering pipeline for e-commerce data. It simulates realistic sales, customer, and product data, transforms it, and loads it into an analytics-ready …

    Python 1

  5. Glassdoor-WebScraper Glassdoor-WebScraper Public

    I designed a scraping πŸ•ΈοΈ tool to extract job posting data from Glassdoor. This scraping tool will return job title, company name, job id, location, salary, language and skills and many more.

    Python 1

  6. Azure_End2End_Project Azure_End2End_Project Public

    Building something cool with Azure

    1