Shashwat Shukla

Engineering Specialist

• Leading team of big data engineers across multiple projects

Senior Data Engineer

• Designed and developed Kubernetes hosted REST APIs using Python's Flask framework for supporting web application,
• Worked on improving AWS Aurora RDS performance by optimizing queries and configuring cost effective auto scaling policies.
• Experience with writing and optimizing Pyspark queries running on AWS EMR clusters for ETL processes.
• Worked on integrating APIs with authentication mechanisms like Ping, Okta and LDAP.
• Served as AWS admin for the big data expertise center, where primary responsibilities included defining IAM roles and policies, setting up EC2 machines, RDS, Lambda functions and automating deployments and infrastructure monitoring using AWS Cloudformation, boto APIs and Cloudwatch respectively.

Data Engineer

• Developed python based tech utilities to support file ingestion frameworks, along with respective pyunits.
• Developed Airflow based orchestrators for file ingestion frameworks, which use AWS Comprehend to search key entities in ingested files, and push results to Amazon Redshift.
• Developed data adapters to download data from multiple structured and unstructured data sources like third party APIs, websites and databases, using browser automation tools like Selenium and industry standard big data frameworks like Sqoop.
• Setup Jenkins based CI/CD framework, which scans the codes for vulnerabilities and code quality.

Summer Intern

• Developed windows application for visualising the core network components, using the JAVA Swing framework.

VIT University, Vellore

CGPA: 8.38