Vikhyat Kumar Srivastava

Vikhyat Kumar Srivastava

Lead Data Engineer · Solution Designer · Big Data

Greater Noida (West), Uttar Pradesh - India

Product developer Lead with 15 years of experience in Data Engineering and Software Development. I design and build data platforms across GCP and AWS — from Spark pipelines and Medallion architectures to cloud migrations and Databricks lakehouses. Equally at home leading cross-functional teams, mentoring engineers, and writing about the ideas that fascinate me.

Skills & Technologies

Apache SparkPySparkScalaPythonJavaDatabricksDBTBigQueryDataprocDataflowAWSGCPAzureHadoop / Big DataSQLHiveData ArchitectureETL / ELTMedallion ArchitectureCI/CDGitJIRAAgileTeam LeadershipNext.jsPhotographyGitHub CopilotClaude

Experience

AI Practitioner

· Greater Noida (W)

Feb 2026 – Current

Developed various projects leveraging advanced AI-assisted engineering workflows (GitHub Copilot & Claude) to accelerate the product development lifecycle. Designed and deployed complex, end-to-end architectures, including an IPL fantasy platform on Hetzner featuring manual-trigger ETL pipelines, a secure full-stack e-commerce solution, an Android test automation framework, and a Vercel-hosted professional portfolio. Currently engineering a custom VS Code extension to track, analyze, and optimize LLM token consumption and development costs

Lead Data Engineer

Thoughtworks Inc. · Barcelona

Aug 2025 – Jan 2026

Developed a data model for a German retail company. Built an ingestion pipeline based on Medallion architecture using AWS S3 and SageMaker AI. Explored data extraction from coloured graphs using linear expressions and pioneered an AI-first system delivery process.

Lead Product Developer

Gainwell Technologies · Bengaluru

Nov 2024 – Jun 2025

Integrated and implemented Databricks LakeFlow Connect to build data pipelines using PostgreSQL per Medallion architecture. Evolved an in-house ingestion framework to support legacy data pipelines feeding the new data design.

Lead Data Engineer · Solution Designer · SME

Tata Consultancy Services · Delhi NCR & London

Sep 2018 – Nov 2024

Designed reusable ETL frameworks in Python and DBT for Banking & Finance clients. Migrated legacy on-premises applications to GCP (Dataflow, BigQuery). Achieved a 40% reduction in Spark job execution time through targeted tuning. Led cross-functional teams across requirements gathering, data warehouse design, and BDD/TDD testing strategies.

Production Support Analyst

Tata Consultancy Services · Delhi NCR

May 2017 – Sep 2018

Automated manual production tasks, implemented seamless deployments, resolved complex escalated incidents, and created custom SQL/Tableau reports providing actionable insights.

Senior Production Support Analyst · SME

Tata Consultancy Services · Delhi NCR & London

Apr 2012 – Feb 2017

Managed vendor relationships, championed change-control best practices, performed root cause analysis on production incidents, and utilised Splunk for log analysis, monitoring, and capacity planning.

Developer

Tata Consultancy Services · Chennai

Feb 2011 – Dec 2011

Built dynamic web applications using HTML, CSS, JavaScript, and jQuery; collaborated cross-functionally to deliver projects on time.

Education

Bachelor of Technology — Computer Science & Engineering

Dr. A. P. J. Abdul Kalam Technical University, Lucknow

August 2006 - June 2010

Senior Secondary - Class 12

Dr. Rizvi Learners' Academy, Jaunpur

July 2003 - June 2005

Secondary - Class 10

Dr. Rizvi Learners' Academy, Jaunpur

April 2001 - June 2003

Certifications

Google Cloud Professional Data Engineer
Azure AZ-900 (Udemy)
AWS Certified Cloud Practitioner (Udemy)
Scala Applied, Part 1
R Level 1 — Data Analytics with R
ITIL Foundation
Data Science Foundations: Fundamentals
Introduction to Data Science
Generative AI Fundamentals

Let's Connect

Whether it's a data challenge, a creative project, or just a good conversation — I'm always up for it.