Sumeet Pal

Data Platform Engineer

Data Platform Engineer with 7+ years in PySpark, AWS, and ML-driven data solutions.

ZS Associates

Chandigarh University

Gurgaon, Haryana, India

Since April 28, 2026

About

Data Engineer with 7 years building production data pipelines and analytical platforms in clinical trials. Primary stack: PySpark on EMR, Airflow/MWAA orchestration, PostgreSQL/Redshift, S3 data lake, Terraform-managed AWS infrastructure. Led an ML-driven site mastering initiative deduplicating 3.5M+ records via dedupe.io. Built and own a Poisson-Gamma/Bayesian enrollment forecasting engine with Monte Carlo simulation serving multi-cohort, multi-arm pharma trials. Operate at the intersection of data engineering reliability, statistical model correctness, and production Python-from schema design through API layer to client delivery.

Top Skills

PysparkHadoop

Skills

PysparkPandasPostgresqlOracleIamDockerGitHadoop

Education

Chandigarh University

B.E. · Computer Science Engineering

August 1, 2019 – Present

Experience

ZS Associates

Tech. Lead - Platform and Products

November 1, 2020 – Present

Gurgaon, Haryana, India

Cognizant

Programmer Analyst

February 1, 2019 – November 1, 2020

Pune, Maharashtra, India

Certifications

PySpark

Unknown

April 1, 2026 – Present

Big Data Fundamentals

Unknown

April 1, 2026 – Present

Key Strengths

Extensive experience (7 years) in data platform engineering, aligning well with the target role of Data Platform Engineer.
Deep expertise in building and maintaining complex data pipelines using PySpark, EMR, S3, Redshift, and Airflow (MWAA).
Proven ability in data modeling, schema design (PostgreSQL, Redshift), and implementing data quality measures.
Experience with advanced data processing techniques, including ML-based entity resolution (dedupe.io) and statistical forecasting models (Poisson-Gamma, Monte Carlo simulation).
Strong background in cloud infrastructure automation using Terraform, AWS Service Catalog, and EKS for robust platform provisioning.
Demonstrated problem-solving skills, including debugging critical model correctness issues, resolving race conditions, and optimizing performance (e.g., parallelization, EMR configuration).
Experience as a Tech Lead, indicating leadership, architectural design, and project ownership capabilities.

Cultural & Operational Fit

Cultural Fit Analysis

The psychometric test score of 0 raises significant concerns regarding the candidate's cultural fit, specifically in areas such as logical reasoning, work attitude, stress handling, and team collaboration. Without further assessment, it is difficult to ascertain suitability for team-oriented environments.

Soft Skills & Operational Fit

AI is analyzing your overall score…

Identifying your key strengths…

Evaluating your skill match against the job requirements…

Key Strengths

Extensive experience (7 years) in data platform engineering, aligning well with the target role of Data Platform Engineer.
Deep expertise in building and maintaining complex data pipelines using PySpark, EMR, S3, Redshift, and Airflow (MWAA).
Proven ability in data modeling, schema design (PostgreSQL, Redshift), and implementing data quality measures.
Experience with advanced data processing techniques, including ML-based entity resolution (dedupe.io) and statistical forecasting models (Poisson-Gamma, Monte Carlo simulation).
Strong background in cloud infrastructure automation using Terraform, AWS Service Catalog, and EKS for robust platform provisioning.
Demonstrated problem-solving skills, including debugging critical model correctness issues, resolving race conditions, and optimizing performance (e.g., parallelization, EMR configuration).
Experience as a Tech Lead, indicating leadership, architectural design, and project ownership capabilities.

Cultural & Operational Fit

Cultural Fit Analysis

Soft Skills & Operational Fit