Bachelor of Technology

Computer Science

<ul><li>Implemented and automated a high-performance attribution logic ETL pipeline using Hadoop, Spark, SQL, EMR, and Airflow, reducing costs by 70% while maintaining high accuracy (97%).</li><li>Created and orchestrated Spark jobs using Airflow DAGs for end-to-end pipeline execution.</li><li>Optimized Big Data pipelines by 70%, improving processing time by 60% through Spark SQL query optimization and performance tuning.</li><li>Utilized AWS CloudFormation to automate the deployment of data engineering resources like Lambda, SQS, ECS, Fargate machines on AWS, streamlining infrastructure provisioning resulting in a 30% reduction in deployment time.</li><li>Developed and implemented a scalable event-driven architecture for non mobile (credit card) data ingestion, leveraging AWS EventBridge, Lambda, Fargate, ECS, Kafka, Firehose, MySQL, PostgreSQL, and Athena.</li><li>Engineered and optimized a high-throughput geo-enrichment pipeline processing 4 billion geospatial records per hour. Utilized Apache Spark on EMR clusters and GeoSpark (Sedona) to perform efficient spatial operations.</li><li>Reduced processing time by 20% through optimized spatial query execution.</li></ul>

Associate Software Engineer

<ul><li>Got exposure to how Adtech works, involved in Batch Ingestion Pipelines, followed Agile methodology using Jira and Git for version control.</li><li>Migrated a critical ETL pipeline to serverless architecture on AWS ECS, resolving backlog issues and reducing daily operational costs by 30%.</li><li>Implemented Alerting and monitoring in different Data Ingestion pipelines using Cloudwatch, Grafana, Victor-ops.</li><li>Leveraged AWS CloudFormation and CDK to streamline CI/CD processes.</li></ul>

Software Engineer Intern

Sharda University, Greater Noida

India

Data Engineer with 1+ years of experience building and automating data pipelines using Python, Spark, Airflow, and AWS. Proven ability to optimize big data processing for performance and scalability. Experienced in developing serverless architectures on AWS.

Himanshu GoyalIndia

Social Accounts

Achievements

Experience

Associate Software Engineer

Software Engineer Intern

Education

Sharda University