I'm a Computer Science graduate (2026) and Data Engineer who builds batch ETL/ELT pipelines with Python, SQL and Apache Airflow on AWS. I care about pipelines that are tested, monitored and automated, not just pipelines that run once.
- 🛠️ Data engineering internships at JBS and Zaitoon Ashraf IT Park (Saylani)
- 🌊 Built a pipeline that turns Pakistani disaster and weather reports into live dashboards
- 🚢 Adding CI/CD (Docker, Terraform, GitHub Actions) to data projects
- 🤖 Built a RAG system, so I can prepare data for AI applications
- 🔬 Research interests: time-series forecasting and machine learning for hydrological and disaster-risk data
| Project | What it does | Stack |
|---|---|---|
| 🌊 Pakistan Operational Risk Intelligence | Collects disaster, weather and river-level data from NDMA, PDMA and PMD reports, validates it, loads it into PostgreSQL and archives it in S3, then serves it through Streamlit dashboards | Python, Airflow, PostgreSQL, Docker, AWS S3, Streamlit |
| 🚢 CI/CD Pipeline | Runs tests, builds a Docker image and pushes it to a Terraform-provisioned AWS ECR repository only when the tests pass | Docker, Terraform, GitHub Actions, AWS ECR, Pytest |
| ☁️ Serverless Data Pipeline on AWS | Event-driven ingestion and transformation with monitoring, producing analytics-ready datasets | AWS Lambda, S3, Glue, Athena, CloudWatch |
Data Engineering
Cloud & DevOps
AI & Visualization
📚 Currently learning (click to expand)
- Snowflake / dbt: cloud data warehousing and analytics engineering
- Apache Kafka: real-time data streaming
- Apache Spark: large-scale data processing
- Time-series forecasting: models for river-level and rainfall data
I'm open to data engineering roles (remote, hybrid or relocation) and to research collaboration. Feel free to reach out on LinkedIn or at ashahryar200@gmail.com.