Building scalable data pipelines and analytics infrastructure on GCP & Azure
- π Currently working as an Analytics Engineer at New Engen, building data pipelines with GCP, BigQuery, and Databricks
- π Improved data processing speeds by 80-90% through pipeline optimization and database redesign
- π± Focused on Data Engineering, Cloud Infrastructure, and ETL/ELT workflows
- π οΈ Specialized in Python, SQL, PySpark, Airflow, and Terraform
- π― Open to collaborate on Data Pipelines, Analytics Platforms, and Cloud Data Solutions
- π Passionate about Data Reliability, Automation, and Analytics Enablement
- π¬ Ask me about SQL, Python, Data Modeling, BigQuery, Azure Data Factory, Databricks
- π« Reach me at [email protected]
-
π’ Analytics Engineer at New Engen (Oct 2023 - Present)
- Built scalable data pipelines using GCP, BigQuery, Adverity, and Datorama
- Reduced query times by 80-90% through database architecture redesign
- Implemented CI/CD pipelines with GitHub Actions, cutting deployment time by 50%
-
π» Data Engineer at Apptad Inc. (Sep 2021 - Apr 2022)
- Optimized ETL pipelines using Azure Data Factory and Azure SQL
- Reduced processing time by 50% and data-related errors by 20%
-
π Google Developer Student Club Lead (Data Science)
- Led a community of 600+ developers
- Organized data and ML workshops
AniSearch - Microservices Architecture
- Built scalable microservices with Spring Boot, PostgreSQL, and Jikan API
- Improved performance by 40% and enhanced user experience by 80%
βοΈ From Gaurav Singh





