Welcome! Let's know Shailza Jolly

Hi! My name is Shailza Jolly, a 3rd year Ph.D. student at TU Kaiserslautern . My Ph.D. advisor is Prof. Andreas Dengel , the scientific director of German Research Center of Artificial Intelligence, where I also work as a research assistant. I am primarily interested in developing machine learning methods for building low-resource natural language generation and understanding systems. My other research interests include vision and language systems, interpretability, and conversational AI.

I completed my master's in computer science from TU Kaiserslautern and spent a semester abroad at Kyushu University in Japan, where my work "How do Convolutional Neural Networks Learn Design?" won the best student paper award at ICPR 2018. I have done my bachelors from GNDEC in India.

During my studies, I have done internships at Karlsruhe Institute of Technology, Germany , SAP AI Research , Amazon Alexa and NVIDIA Research .

I have been a visiting researcher in the labs of Prof. Seiichi Uchida , Prof. Lili Mou and Prof. Isabelle Augenstein .

Possessing a hard-working nature, I am always looking for opportunities where I can work on my growth areas. I believe that learning is a continuous process, and knowledge sharing is one of the best ways to boost one's learning graph. With a lot of advances happening in AI especially towards the fusion of different modalities, I believe that a smaller contribution added today can lead to great offerings for tomorrow. So, if you are working in areas similar to my interests, and are interested to contribute towards an exciting future, let's start working for it together.

Email  /  CV  /  Google Scholar  /  LinkedIn  /  Github  /  Twitter

NEWS

[June 2021] Attending NAACL 2021 to present my work titled EaSe: A Diagnostic Tool for VQA based on Answer Diversity.

[May 2021] Selected as a volunteer at NAACL 2021 .

[May 2021] Started an internship at NVIDIA Research to work in the Learning and Perception Research Team .

[April 2021] Extremely honoured to win AI Newcomer 2021 award by German Informatics Society and the Federal Ministry of Education and Research (BMBF) , Germany. More information here .

[March 2021] One paper got accepted at NAACL 2021. Its a joint work with Sandro Pezzelle and Moin Nabi.

[January 2021] I have been selected as the top finalist in AI Newcomer 2021 . AI Newcomer is a transdisciplinary research convention on the subject of AI. It is co-organized by the Federal Ministry of Education and Research in Germany to bring together brilliant scientists under the age of 35 and renowned researchers. To win the award I need votes on my profile . I really appreciate your votes!

[November 2020] I will be starting my stay at CopeNLU in January 2021. I will be working with Prof. Isabelle Augenstein in the area of natural language generation.

[November 2020] I will be presenting our accepted EMNLP Findings paper: Can Pre-training help VQA with Lexical Variations? at The Second Workshop Beyond Vision and LANguage:inTEgrating Real-world kNowledge.

[October 2020] One paper got accepted at COLING 2020 in industry track with Oral Presentation. The work was done during internship at Amazon Alexa, Aachen Germany [Acceptance Rate: 22.9%].

[October 2020] One paper got accepted at The Second Workshop Beyond Vision and LANguage: inTEgrating Real-world kNowledge (LANTERN) at COLING 2020.

[September 2020] One paper accepted at EMNLP Findings 2020 [Acceptance Rate: 15.4%].

[June 2020] One paper accepted (in the first round) at ICPR 2020 [Acceptance Rate: 36%].

[July 2019] I will start a 5-month long internship at Amazon Alexa, Aachen Germany. I will work in the area of natural language generation in the context of paraphrasing.

[April 2019] Participated in ICDAR Scene Text VQA challenge and our team won 3rd position in one of the tasks.

[March 2019] Started Ph.D. at Technical University Kaiserslautern, Germany in the area of understanding vision and language.

[Feb 2019] Graduated with a masters degree in Computer Science from Technical University Kaiserslautern, Germany with "Sehr Gut" Grade.

AWARDS

[April 2021] Received AI Newcomer Award by German Informatics Society and the Federal Ministry of Education and Research (BMBF) , Germany.

[December 2020] Received EU-Cost STSM Grant to work on Multi3generation project at CopeNLU.

[August 2019] Awarded a travel grant to attend Amazon AI Research Colloquium at Cambridge UK.

[April 2019] Awarded a 3rd position in TextVQA challenge at ICDAR, 2019.

[February 2019] Awarded Ph.D. Research Fellowship by TU Kaiserslautern, Germany.

[January 2019] Awarded a travel grant to attend Pre-Doctoral School at Max Planck Institute for Intelligent Systems, Tuebingen, Germany.

[August 2018] Awarded Best Student Paper Award at ICPR 2018 along with a prize money of 500 USD. Work was done in the lab of Prof. Uchida from Kyushu University, Japan.

[November 2017] Awarded a travel grant to work at Kyushu University, Japan.

[July 2017] Awarded a travel grant to attend Deep Learning Summer School, Bilbao (2017).

[2010] Awarded academic scholarship worth INR 10000 in All India Secondary School Exam.

[2010] Among top 0.1% students for National level Class 10 Maths Exam (A1 Grade).

TEACHING ACTIVITIES

[April 2020] Supervised a masters project (8 ECTS credit): Unsupervised methods for Natural language Generation.

[April 2020] Supervised a bachelors seminar (4 ECTS redits): A survey of pretrained models in Vision and Language.

[October 2019] Supervised a masters seminar (4 ECTS redits): Controlled Natural Language Generation using Deep Learning.

MEDIA COVERAGE

[May 2021] Interview featured in the Rheinfalz newspaper.

[May 2021] Radio interview for Antenne Kaiserslautern, Germany.

[April 2021] Mentions in some online portals like one , two and three .

INVITED TALKS / PRESENTATIONS

[June 2021] Oral & Poster presentations at NAACL,2021.

[March 2021] Invited talk at the CopeNLU, Denmark. Invitation from Prof. Isabelle Augenstein.

[January 2021] Oral & Poster presentations at ICPR,2020.

[January 2021] Invited talk at the Intel Labs. Invitation from Dr. Ramesh Manuvinakurike.

[October 2020] Invited talk at the Language Technology Lab, Saarland Germany . Invitation from Prof. Guenter Neumann.

[October 2020] Oral presentation at COLING,2020.

[October 2020] Oral presentation at LANTERN, COLING,2020.

[October 2020] Invited talk at the University of Alberta, Canada . Invitation from Prof. Lili Mou.

[August 2019] Poster Presentation at Amazon AI Research Colloquium, Cambridge UK.

[September 2018] Poster Presentation at Workshop on Shortcomings in Vision and Language (SiVL), ECCV, 2018.

[August 2018] Oral Presentation at ICPR, 2018.

SERVICE ROLES and ACADEMIC ACTIVITIES

[May 2021] Selected as a volunteer at NAACL 2021 .

[March 2021] Served in the program committee of ALVR at NAACL 2021.

[January 2020] Organizing GEM workshop at ACL 2021

[November 2020] Selected as a volunteer at EMNLP 2020 .

[June 2020] Selected as a volunteer at ICML 2020 .

[March 2020] Served in the program committee of First Workshop on Advances in Language and Vision Research (ALVR) at ACL 2020.

PUBLICATIONS

EaSe: A Diagnostic Tool for VQA Based on Answer Diversity
S. Jolly, S.Pezzelle, M. Nabi
NAACL, 2021  
PDF / code

Data-Efficient Paraphrase Generation to Bootstrap Intent Classification and Slot Labeling for New Features in Task-Oriented Dialog Systems
S. Jolly, T.Falke, C.Tirkaz, D.Sorokin
COLING, 2020  
PDF

Can Pre-training help VQA with Lexical Variations?
S. Jolly, S.Kapoor
EMNLP Findings, 2020  
PDF

Leveraging Visual Question Answering to Improve Text-to-Image Synthesis
S. Frolov, S.Jolly , J.Hees, A.Dengel
LANTERN, COLING 2020  
PDF

P ≈ NP, at least in Visual Question Answering
S. Jolly*, S.Palacio, J.Folz, F.Raue, J.Hees, A.Dengel
International Conference on Pattern Recognition (ICPR), 2020  
PDF / code

The Wisdom of MaSSeS: Majority, Subjectivity, and Semantic Similarity in the Evaluation of VQA
S. Jolly*, S.Pezzelle, T.Klein, A.Dengel, M.Nabi
arXiv, 2018  
PDF

How do Convolutional Neural Networks Learn Design?
S. Jolly*, B.Iwana , R.Kuroki, S.Uchida
International Conference on Pattern Recognition (ICPR), 2018
Best Student Paper Award  
PDF

Thanks Jon!