CV

Contact Information

Name Shailza Jolly
Email shailzajolly@gmail.com
Phone +49 176 67279750

Experience

  • 2025 - present

    Berlin, Germany

    Applied AI & LLM Systems
    Independent
    • Built and open-sourced Sift: grounded question-answering over technical PDF corpora. Docling chunking, hybrid BM25 and dense (Chroma) retrieval, cross-encoder reranking, served over MCP to an agent that answers only from retrieved passages, with a source and page citation on every claim.
    • Built an agentic tutoring system in daily use: an LLM agent orchestrating retrieval over a structured knowledge base, persistent memory of errors and progress, adaptive lesson selection that targets weak areas, and voice I/O (faster-whisper ASR, edge-tts TTS).
    • Published technical writing on LLM internals and systems: attention mechanisms, data quality for LLM training, and the shift from generative to agentic AI.
    • Deepened modern LLM architecture and inference-efficiency internals through Stanford coursework: KV-cache, speculative decoding, FlashAttention.
  • 2025 - 2025

    Berlin, Germany

    Senior AI Engineer
    Flinn.ai
    • Led development of LLM-powered product features for a platform serving medical device manufacturers, including data extraction from medical research papers and multilingual complaint monitoring.
    • Partnered with product and backend teams to scope problems, define success metrics, and deliver features end to end.
    • Navigated cost-performance tradeoffs under production constraints.
  • 2023 - 2024

    Berlin, Germany

    Career break
    Parental Leave
  • 2022 - 2023

    Berlin, Germany

    Research Scientist
    Amazon AI
    • Led development of a scalable noise-removal/data-quality pipeline processing billions of tokens to improve training data for LLMs.
    • Presented findings and recommendations to senior science and engineering leadership; mentored Master’s and Ph.D. interns on research deliverables.
  • 2019 - 2022

    Berlin, Germany

    Machine Learning Scientist
    German Research Center for Artificial Intelligence (DFKI)
    • Implemented transformer-based ML systems end-to-end (GPU training, Docker, production-level code) within BMBF-funded projects; published results at AAAI, NAACL, and EMNLP.
    • Collaborated with academic and industry partners internationally; supervised interns and BSc/MSc students.
  • 2021 - 2021

    Santa Clara, US

    Machine Learning Scientist Intern
    NVIDIA Research
    • Built a document understanding pipeline combining table/cell detection, tabular structure retrieval, and OCR for financial documents.
  • 2019 - 2019

    Aachen, Germany

    Applied Scientist Intern
    Amazon Alexa
    • Developed a method for generating diverse synthetic training data to improve intent classification and slot labeling for task-oriented NLU.
  • 2018 - 2019

    Berlin, Germany

    Research Intern / Master's Thesis
    SAP AI Research
    • Designed and implemented an evaluation metric for Visual Question Answering (VQA) models.

Summary

  • ML Scientist / AI Engineer with a Ph.D. in Computer Science and 6+ years across industry research and product, focused on making LLM systems accurate and auditable enough to trust. Led a data-quality pipeline over billions of tokens of LLM training data at Amazon AI; built LLM-powered product features for a platform serving medical device manufacturers at Flinn.ai; open-sourced Sift, a hybrid BM25 and dense retrieval system whose agent answers only from retrieved passages, with a source and page citation on every claim. Working depth in modern LLM internals and inference efficiency (KV-cache, speculative decoding, FlashAttention) and in agentic system design (MCP, persistent memory, tool orchestration). Publications at AAAI, NAACL, and EMNLP.

Skills

ML/GenAI: LLMs, NLU/NLG, multimodal learning, synthetic data, model evaluation, model training and fine-tuning (T5, BERT)
LLM Systems: Agentic workflows (MCP, LangGraph/LangSmith), Retrieval-Augmented Generation (RAG), grounding and citations, persistent agent memory, experiment design, offline evaluation
Search & Retrieval: Hybrid retrieval (BM25 + dense), cross-encoder reranking, vector search (Chroma, Pinecone), Sentence Transformers, Docling
LLM Internals & Efficiency: KV-cache, speculative decoding, FlashAttention
Frameworks & Libraries: Python, PyTorch, Hugging Face (Transformers, Datasets), PySpark, Weights & Biases
Infrastructure & Deployment: AWS, Docker, FastAPI, Git

Education

  • 2019 - 2022

    Kaiserslautern, Germany

    Ph.D.
    TU Kaiserslautern
    Computer Science
    • Grade: Sehr Gut 1.0 (highest on 1.0–5.0 scale)
    • Thesis: Building Natural Language Generation and Understanding Systems in Data-Constrained Settings
  • 2021 - 2021

    Copenhagen, Denmark

    Visiting Researcher
    University of Copenhagen
    Natural Language Processing
    • Developed an unsupervised post-editing algorithm to generate fluent fact-checking explanations
  • 2016 - 2018

    Kaiserslautern, Germany

    M.Sc.
    TU Kaiserslautern
    Computer Science — Minor in Economics
    • Grade: Sehr Gut 1.5
  • 2017 - 2018

    Fukuoka, Japan

    Semester Abroad
    Kyushu University
    Computer Science
    • Explainable AI to analyze behavior of deep CNN architectures for image recognition
  • 2012 - 2016

    India

    B.Tech
    Guru Nanak Dev Engineering College
    Computer Science & Engineering
    • Grade: First Division with Distinction

Awards

  • 2022
    AAAI-22 Scholarship by Hitachi
  • 2021
    AI Newcomer 2021 Award
    • Recognized by the German Informatics Society and BMBF, Germany.
  • 2020
    EU-Cost STSM Grant
    • Awarded by EU-Cost Action to work on the Multi3generation project at CopeNLU, University of Copenhagen.
  • 2018
    Best Student Paper Award
    • Awarded by the International Conference on Pattern Recognition (ICPR) for “How Do Convolutional Neural Networks Learn Design?”

Media Coverage

  • Radio interview for Antenne Kaiserslautern, Germany.

Languages

English: Fluent
German: A2 (actively learning)
Hindi: Native speaker