Harsh Khandelwal

ML research engineer in Erlangen, Germany. I work on retrieval systems, medical AI, and efficient ML deployment.

Now
Data Science Working Student, Siemens Energy, Nuremberg
Study
M.Sc. Autonomy Technologies, FAU Erlangen–Nürnberg, expected March 2027
Awards
3× first place and 1× second, VLM3D Challenge at MICCAI 2026
Areas
NLP, RAG, medical imaging, on-device inference
Painted portrait of Harsh: dark hair, glasses and beard, navy shirt, in front of a yellow wall and a teal door.

About

I’m finishing my Master’s in Autonomy Technologies at FAU Erlangen–Nürnberg. I just handed in my thesis, which asks how well today’s AI models can read a chest CT scan: spotting what’s wrong, showing where it is, and writing it up as a report.

I’m still early in my research career, and most of what I know I’ve learned working in teams with people I could learn a lot from. The part I enjoy most is checking whether something really works: running one more experiment, or finding out that a good score was good for the wrong reason.

Before my Master’s I spent two years building software at a company in India, and I still like making things people actually use, from tools at work to small apps I build for myself.

Based in
Erlangen, Germany
Languages
English C1, German A2
Focus
3D medical imaging, VLMs, retrieval

Work

  1. Oct 2025now

    Data Science Working Student

    Siemens Energy, Nuremberg

    Built a document knowledge base over 30,000+ documents for a multi-agent RAG system answering questions about historical offers. Automated offer generation and escalation, replacing a manual process that took several days, and built a Streamlit-in-Snowflake app that turned a multi-hour SAP data task into one click. Presenter in the company-wide AI/ML community.

  2. Feb 2025Sep 2025

    AI Intern

    National Instruments / Emerson, Dresden

    Inventor on a US patent application for Fast Signature Matching, plus two invention disclosures; presented the algorithms at NI Tech in Austin and received a performance bonus. Built a manufacturing debug assistant using similarity search over graphical data that reached 80% accuracy and secured funding for a pilot. Implemented ensemble drift detection against a digital-twin baseline.

  3. Jun 2024Dec 2024

    Student Assistant, ML / Radar

    Institute of Microwaves and Photonics, FAU

    Developed radar-based human pose estimation using ray-tracing-enhanced datasets, ran radar and OptiTrack motion-capture studies, and evaluated lightweight architectures to cut RNN inference time.

  4. May 2021Sep 2023

    Consultant → Associate Consultant

    Adnate IT Solutions, Jaipur

    Built software and process automation for a major Indian private-sector bank, and led a team delivering several projects.

Projects

Master’s thesis · FAU, AIBE / IDEA Lab · submitted November 2026

From Scan to Report: Detecting, Segmenting and Reporting Findings in Chest CT

Reading a chest CT means three things: detecting the abnormalities, locating them, and writing them up in a report. The thesis takes each step in turn and measures where the current state of the art actually stands, on CT-RATE and ReXGroundingCT. Across all three, task design and the choice of metric change how pretrained encoders should be used, and judging clinical accuracy still needs unseen data and expert review.

  1. Detecting8 frozen CT encoders compared; attention over FlexiCT tokens reaches 0.8695 AUROC
  2. Segmentingadapting VoxTell’s text-to-mask head raises Dice by 37.8%
  3. ReportingCRG can’t tell whether a report reflects the scan; GREEN and CRIMSON can

Supervised by Prof. Dr. Bernhard Kainz and Dr. Johanna Müller.

Most of this is collaborative research, and several repositories are private. Links are given where code or models are public.

3× 1st

plus a 2nd, VLM3D at MICCAI 2026

VLM3D: 3D CT and MR classification and report generation

Collaborative research, FAU · PyTorch, Slurm, MIL, VLMs

Part of the FAU teams that won CT abnormality classification, CT report generation and MR report generation, and placed second in MR abnormality classification (certificates). I built a benchmarking framework comparing 10 3D image-encoder families on 50,183 chest CT volumes, cutting storage from a projected 13 TB to 260 GB. For reports, I showed that end-to-end generators were barely grounded in the scan, and that a classify-then-assemble pipeline beat the baseline by +0.165 CRG.

1st

of 37 teams, CLEF CheckThat! 2026

Claim2Source

Collaborative research, TU Dresden · RAG, reranking, LLM verification

Multilingual retrieval of the scientific paper behind a claim made on social media. I implemented the LLM-based evidence verification that delivered the decisive score gain; the final system reached MRR@5 = 0.7628 across English, German and French and improved on the baseline by 75%. Co-authored two CLEF papers.

11/53

teams, ReXGroundingCT challenge

Text-conditioned 3D grounding in chest CT

Collaborative research, FAU · VoxTell, DDP, HPC

Locating findings from a radiology report inside the 3D scan. Freezing the VoxTell backbone and training only the grounding head lifted leaderboard Dice from 0.280 to 0.332. Analysis showed missed lesions, not mask quality, were the bottleneck. Distributed training with NVMe staging raised GPU utilisation from 10% to 95%, a 7× speedup.

45%

reports corrupted by the top-BLEU system

Clinical safety in radiology translation

Research project · NLP, MT evaluation, clinical metrics

Benchmarked 13 translation systems on 296 German–English radiology reports. Fluent output can still flip a negation or drop a measurement: BLEU mis-ranks clinical safety, while claim-entailment and GREEN checks catch factual corruption far better (AUC 0.84–0.92).

956

clinical CT scans, University Hospital Erlangen

Medical VLMs on real German CT reports

University Hospital Erlangen & FAU · VLMs, quantization, evaluation

Evaluated four state-of-the-art medical vision-language models (MedM-VL, MedGemma-27B, CT-CHAT, COLIPRI) on 956 thoracic CT volumes with German free-text reports. Models built specifically for thoracic CT clearly beat broader medical VLMs, but scores stayed low overall. Presented at BAIOSPHERE MEDICAL 2026 (poster).

3D

life-size AI patient, browser and Apple Vision Pro

PsyTrain

Hackathon, OTH Amberg-Weiden · made for Apple Vision Pro · three.js, WebXR, ElevenLabs, Claude on Bedrock

A virtual psychiatric patient for practising history-taking. Students build a case in three clicks, talk to the patient out loud in a 3D consultation room, and get turn-by-turn feedback afterwards. The patient can drift off topic or get angry, and its body language follows the conversation.

Models and tools from the thesis

Other builds

Recognition

Awards

VLM3D Challenge 2026 (Vision-Language Modeling in 3D Medical Imaging), held at MICCAI 2026. Team awards with colleagues at FAU Erlangen–Nürnberg.

  • VLM3D Challenge 2026 certificate: 1st place, CT abnormality classification, presented to Harsh Khandelwal.

    1st CT abnormality classification

  • VLM3D Challenge 2026 certificate: 1st place, CT report generation, presented to Harsh Khandelwal.

    1st CT report generation

  • VLM3D Challenge 2026 certificate: 1st place, MR report generation, presented to Harsh Khandelwal.

    1st MR report generation

  • VLM3D Challenge 2026 certificate: 2nd place, MR abnormality classification, presented to Harsh Khandelwal.

    2nd MR abnormality classification

1st of 37 teams, CLEF CheckThat! 2026, Task 1: source retrieval for scientific web claims.

Papers and posters

  1. CLEF 2026 Working Notes (CEUR-WS)

    Claim2Source at CheckThat! 2026: Improving Multilingual Scientific Claim-Source Retrieval with Verification-based Re-Ranking

    T. Schreieder, H. Khandelwal, Y.-L. Zhong, M. Färber

  2. Best of CLEF 2025 Labs, Springer LNCS 17087

    Scientific Claim-Source Retrieval Revisited: A Comparative Study of Style Transfer and Re-Ranking

    T. Schreieder, H. Khandelwal, Y.-L. Zhong, M. Färber

  3. Poster, BAIOSPHERE MEDICAL 2026, Erlangen

    Evaluation of Medical Vision-Language Models for Automated Thoracic CT Report Generation on a German Clinical Dataset

    H. Khandelwal*, F. Weber*, L. Buess, N. Bayerl, S. Arndt, A. Iancu, A. Maier, M. S. May, B. Kainz, N. A. Lackner, J. P. Müller · *equal contribution

The BAIOSPHERE MEDICAL 2026 poster: workflow diagram, results table comparing four VLMs, and qualitative COLIPRI examples. Open the full poster ↗
⇄ Try the scanner view