Sonu Khobragade
SDET · Performance · Automation · AI Quality
I build the systems that test your systems.
I've spent twelve years on the parts of quality that don't fit a test case: work too repetitive for a human to keep doing, AI with no single correct answer, and traffic you only get one shot at.
- Experience
- 12 years
- Specialisms
- Performance engineering · AI quality · Automation
- Scale
- ~1M RPM validated · 25+ engineer org led
- Location
- Bengaluru — open to relocation
problems
- 01Manual test-case preparationAI generation with human review, 1.5d → 3.5h→
- 02Repeated AI-response inspectionLLM evaluation framework→
- 03Late performance discoveryPeak readiness engineering, ~1M RPM→
- 04Repeated backend validationAPI automation, 0 → ~1,000 tests
- 05Manual mobile regressionAppium platform, ~3 days → ~1 day
experience
12 years
AskMyGuru
09/2025 — Present
Bengaluru, India
Current
Senior SDET, Automation and Performance
Seed-stage AI startup
- Test design per feature
- 1–1.5d → 3–4h
- API coverage in 2 months
- 0 → ~1,000 tests
- Mobile regression
- ~3d → ~1d
- Built a Python and DeepEval evaluation framework for an AI chatbot, using Anthropic Claude as an LLM judge to validate factual accuracy, hallucinations, grounding, relevance and contextual consistency — surfacing grounding and factual-accuracy failures that functional testing did not catch.
- Built an internal test-case generation framework from PRD/Notion and Figma inputs, later extended with HLD/LLD context, reducing test-case preparation from ~1–1.5 days to ~3–4 hours including human review.
- Built a human-in-the-loop AI support agent using BM25 retrieval and the Anthropic Claude SDK over 890 historical support replies, grounding draft responses in SOPs before agent review.
- Built a Python, pytest and Appium mobile automation framework for critical payment, subscription and chat journeys, reducing regression time from ~3 days to ~1 day.
- Built API automation across backend services for P0/P1 and end-to-end business flows, scaling coverage from 0 to ~1,000 tests within 2 months.
- Owned performance testing across backend services, using Prometheus and Grafana to monitor latency, throughput, errors and service behaviour under load.
- Python
- DeepEval
- Anthropic Claude SDK
- pytest
- Appium
- Prometheus
- Grafana
Mobile Premier League
11/2018 — 09/2025
Bengaluru, India
Senior Manager, Automation and Performance
SDET Lead → SDET Manager → Performance SDE Manager → Senior Manager
- Peak Fantasy traffic validated
- ~1M RPM
- QA organisation led
- 25+ engineers
- Automated tests
- ~200 → ~2,000
- Led a 25+ member QA organisation across Automation, Performance Engineering, Games and Product QA.
- Owned Fantasy and Payments performance readiness for IPL and other peak events, validating up to ~1M RPM overall Fantasy traffic and up to ~60 payment TPS.
- Drove performance validation for the AWS-to-GCP migration, covering load testing and database latency investigations.
- Ran chaos testing on GKE using Chaos Mesh, covering pod kill/failure scenarios and HTTP latency/error injection.
- Scaled automation from ~200–250 to nearly 2,000 tests, helping shorten the release cycle from ~3 weeks to ~2.5 weeks.
- Performance-tested the SQS/SNS-to-Confluent Kafka migration, benchmarking broker/node behaviour and cluster capacity under load.
- Benchmarked G1GC vs ZGC on Java 8/17, comparing GC pauses, throughput and CPU/memory usage under load.
- Validated EC2-to-EKS/Kubernetes migration performance by benchmarking latency, CPU and memory utilisation under load.
- Developed backend automated tests using Java and RestAssured for REST APIs and gRPC service-to-service flows not exposed through client-facing APIs.
- Java
- Python
- Locust
- Kubernetes
- Chaos Mesh
- Kafka
- RestAssured
- Appium
- AWS
- GCP
Bookshare · RnR Datalex · BizSense Solutions
2014 — 2018
US contract / India
QA and Automation Engineer
- Built Selenium and Java regression tests for a US accessibility platform using Page Object Model, TestNG, Maven and Jenkins.
- Performed functional and automation testing across ERP, e-commerce, healthcare procurement and B2B trading products for US and Dubai clients.
- Selenium
- Java
- TestNG
- Maven
- Jenkins
stack
- MPL
- Mobile Premier League
- AMG
- AskMyGuru
- EARLY
- 2014—2018
Performance & Reliability
Peak-event readiness, capacity validation and failure injection for systems that cannot be rehearsed in production.
- LocustMPL— read the case study
- Load / stress / spike / soakMPL— read the case study
- Capacity planningMPL— read the case study
- Chaos MeshMPL— read the case study
- JVM & GC benchmarkingMPL
- Kafka / broker capacity benchmarkingMPL
- WireMock & service mockingMPL
AI / LLM Quality
Evaluating systems whose output is different every time, where a passing functional test proves very little.
Test Automation
Frameworks built to remove regression effort, not to inflate a test count.
- PythonAMG— read the case study
- pytestAMG
- AppiumMPL
- JavaMPL
- RestAssuredMPL
- REST / gRPCMPL
- SeleniumEARLY
- TestNGEARLY
- PlaywrightAMG
- AllureMPL
Cloud, Containers & CI/CD
Where the systems under test actually run, and what changes when they migrate.
- KubernetesMPL— read the case study
- AWS (EKS, EC2, S3, IAM)MPL
- GCP (GKE, Cloud DNS)MPL
- DockerMPL
- GitHub ActionsAMG
- JenkinsEARLY
Observability
Reading what a system is telling you under load, rather than guessing from a test report.
- PrometheusMPL— read the case study
- GrafanaMPL— read the case study
- DatadogMPL
- New RelicMPL
- OpenTelemetryMPL
- Loki / JaegerMPL
- Sentry / CrashlyticsMPL
Data, Messaging & Caching
The stateful parts that usually decide where a load test actually breaks.
- PostgreSQLMPL
- Confluent KafkaMPL
- SQS / SNSMPL
- Redis / ElastiCacheMPL
- ZookeeperMPL
- MetabaseMPL
case-studies
3 written
Each one is written as an engineering piece: the problem, the architecture, why each significant decision was made, and what changed, measured the same way before and after.
01 · AskMyGuru
Active
Can a system read a PRD and a Figma file and produce test cases a human would have written?
Turning repetitive test design into a generation pipeline with human review.
- Test design per feature, including human review
- 1–1.5 days→3–4 hours
- Python
- Anthropic Claude SDK
- Notion
- Figma
Read the case study →
02 · AskMyGuru
Active
How do you test a system when there isn't always one correct answer?
Measuring correctness in a system whose output is different every time.
- What the suite could detect
- Functional tests passing→Grounding failures surfaced
- Python
- DeepEval
- Anthropic Claude SDK
Read the case study →
03 · Mobile Premier League
How do you know a system survives a peak you can't rehearse?
Validating capacity for traffic peaks that only happen once a year.
- Fantasy traffic before a peak event
- Unverified peak capacity→~1M RPM validated
- Locust
- Kubernetes
- Prometheus
- Grafana
- Chaos Mesh
Read the case study →
relocation
Work authorisation
Open to relocation
Looking for roles in EU · UK · UAE · APAC · Canada
- Based in
- Bengaluru, India
- Languages
English — C2
Hindi — Native
Marathi — Native
- EU Blue Card
- Eligible on both routes — B.E. Computer Science and 12 years of professional experience, against a 5-year alternative threshold.
- Degree recognition
- Awarded by Rashtrasant Tukadoji Maharaj Nagpur University, listed in Germany's anabin database with institution status H+ (recognised higher education institution).
- Netherlands
- Highly Skilled Migrant route via a recognised sponsor employer.
- Denmark & Norway
- Outside the Blue Card scheme — national skilled-worker routes apply (Denmark opted out; Norway is not an EU member).