Chhayansh Purohit
Data engineer. Explorer.
Python
C / C++
SQL
API
Spark
Kafka
Hadoop
Airflow
Confluent
PostgreSQL
MySQL
DynamoDB
OpenSearch
Snowflake
AWS
GCP
Docker
Terraform
Hugging Face
LangChain
LangGraph
OpenAI
ChatGPT
Claude
Gemini
RAG
Vector DB
Prompt Eng.
Fine-tuning
Tableau
Matplotlib
Pandas
PySpark
Delta Lake
Iceberg
Parquet
Avro
Git
GitHub
CI/CD
Linux
Bash
Data Lineage
AWS DataZonePythonC / C++SQLAPISparkKafkaHadoopAirflowConfluentPostgreSQLMySQLDynamoDBOpenSearchSnowflakeAWSGCPDockerTerraformHugging FaceLangChainLangGraphOpenAIChatGPTClaudeGeminiRAGVector DBPrompt Eng.Fine-tuningTableauMatplotlibPandasPySparkDelta LakeIcebergParquetAvroGitGitHubCI/CDLinuxBashData LineageAWS DataZoneAbout
Data Engineer with 4+ years of experience architecting high-throughput data platforms and AI-driven solutions. At LPL Financial and Infosys, I've designed real-time streaming pipelines, built RAG-powered applications, and automated data workflows at scale using Spark, Kafka, and AWS. Currently deepening my expertise in Generative AI and machine learning through UT Austin's AI/ML program. Beyond the terminal, I'm an explorer and photographer - discovering new landscapes and cultures fuels the same curiosity I bring to engineering.
The Journey
UT Austin, McCombs School of Business
Post Graduate Program - AI/ML with GenAI Specialization
Austin, TX
·Feb 2026 - Dec 2026
LPL Financial
Austin, TX
·2023 - Present- ●Architecting and optimizing modern data engineering pipelines
- ●Engineered scalable AWS Glue ETL pipelines using PySpark for processing TBs of financial data daily
- ●Automated Lambda triggers for real-time event-driven data workflows, reducing manual intervention by 80%
- ●Optimized Redshift query performance through distribution keys and sort keys, achieving 40% faster analytics
- ●Architected data lake solutions on S3 with proper partitioning and lifecycle management
- ●Built automated data quality frameworks validating 50M+ records across pipelines
- ●Developed Python-based monitoring dashboards for tracking ETL job performance metrics
- ●Created reusable Terraform modules for provisioning AWS infrastructure (Glue, S3, RDS)
- ●Conducted SOX compliance audits for data access controls across financial systems
- ●Automated audit evidence collection using Python scripts, saving 20+ hours per audit cycle
University of Texas at Dallas
Master of Science - Information Technology & Management
Richardson, TX
·2022 - 2024
Infosys Limited
Data Engineer
Pune, India
·2021 - 2022- ●Designed and implemented Hadoop-based data processing pipelines using Hive, Pig, and Sqoop
- ●Ingested and processed 10K+ records daily from RDBMS to HDFS for analytics workloads
- ●Integrated HDFS with Tableau for real-time forecasting dashboards with 92% prediction accuracy
Worldsoft Technologies
Cloud Engineer Associate
Jabalpur, India
·2019 - 2021- ●Assisted in cloud migration of on-premise applications to AWS infrastructure
- ●Configured VPCs, security groups, and IAM policies for enterprise clients
Jabalpur Engineering College
Bachelor of Technology - Computer Science & Engineering
Jabalpur, India
·2017 - 2021Projects
End to End Data Engineering on AWS
Spearheaded a YouTube video analysis project, leveraging Python and AWS services (S3, Glue, Lambda) to extract, transform and load the data in Redshift warehouse empowering real-time analytics with 50% quicker responses using Athena.
View project
Truck Fleet Risk Analysis
Ingested 10000 records to HDFS with Sqoop and analyzed using Hive and Pig to find top 5 risky drivers and over-used trucks. Integrated HDFS with Tableau for forecasting vehicle maintenance and driver safety with 92% accuracy.
View project
Healthcare Rules Engine
Developed and implemented a Rules Engine for a leading healthcare company, resulting in 60% increase in efficiency for their Registry Quality Control Management System by capturing changed data and conducting logic rule checks using SQL.
View projectTestimonials
“I had the pleasure of working with Chhayansh Purohit during his internship as a Data Engineer. His dedication and enthusiasm were evident from day one. Chhayansh possesses a strong grasp of data engineering concepts and his ability to analyze complex data sets has been instrumental in driving successful projects within our team.”
VP, Data Services Engineer Manager at LPL Financial
“Chhayansh did a fantastic job during his time as an IT internal audit intern. He was able to quickly pickup concepts and put them into practice. Questions or concerns that were raised during the testing of controls were well thought out and showed an overall understanding of the purpose of the testing we were performing.”
Senior Internal Auditor - Enterprise Technology at Truist
“It was a pleasure to have Chhayansh intern with our IT Internal Audit team this Summer. He had a great work ethic, completing his testing ahead of schedule. He also knew when to raise questions to his Seniors and manage his workload with minimal oversight.”
VP, Technology, Cyber and Product Risk at LPL Financial
“I had the privilege of working with Chhayansh during an internship where we focused on Google Cloud solutions. Chhayansh demonstrated exceptional technical proficiency and a deep understanding of cloud computing technologies. He consistently brought fresh perspectives and innovative solutions to the table.”
Project Manager at Velocis Systems Private Limited
Photography
When I'm not building data pipelines, I'm capturing the world through my lens.
