|
| 1 | +--- |
| 2 | +layout: default |
| 3 | +title: Dr. Rajkumar Ramamurthy |
| 4 | +description: false |
| 5 | +--- |
| 6 | + |
| 7 | +## About me |
| 8 | + |
| 9 | +{: style="float: right; margin: 0 0 1em 1em; max-width: 250px; border-radius: 4px;"} |
| 10 | + |
| 11 | +I am a Postdoctoral Researcher at the Applied Machine Learning Lab at the University of Bonn since July 2026. I earned my PhD in Computer Science from the University of Bonn in 2023, where my dissertation explored practical models for sequential decision-making in NLP and RL. I am a co-author of [RL4LMs](https://github.com/allenai/RL4LMs), one of the first open-source training frameworks for fine-tuning large language models with reinforcement learning ([paper](https://arxiv.org/abs/2210.01241)). |
| 12 | + |
| 13 | +After my PhD, I worked at several early-stage startups in the US and Germany, where I gained practical experience developing agentic workflows for document-heavy domains and fine-tuning small language models (SLMs). |
| 14 | + |
| 15 | +## Research Interests |
| 16 | + |
| 17 | +My current research interests include, but are not limited to: |
| 18 | + |
| 19 | +- **Agentic Systems:** Developing and benchmarking agentic systems, communication topologies, routing, and orchestration. |
| 20 | + |
| 21 | +- **Harness Optimization / Meta-Harnesses:** Automatically generating harnesses for models and optimizing them continuously from a small set of input-output examples through evolutionary or hill-climbing methods. |
| 22 | + |
| 23 | +- **Model Ensembles / Merging:** Combining multiple models to improve robustness, coverage, and reliability in complex language tasks. |
| 24 | + |
| 25 | +- **Continual Learning:** Enabling models to self-improve from production traces, with or without human feedback. |
| 26 | + |
| 27 | +I am also interested in post-training, benchmarking, and red-teaming. |
| 28 | + |
| 29 | +## Highlighted Publications |
| 30 | + |
| 31 | +[**Google Scholar**](https://scholar.google.de/citations?user=vVzcztcAAAAJ) |
| 32 | + |
| 33 | +* **Is Reinforcement Learning (Not) for Natural Language Processing: Benchmarks, Baselines, and Building Blocks for Natural Language Policy Optimization** |
| 34 | + *Rajkumar Ramamurthy, Prithviraj Ammanabrolu, Kianté Brantley, Jack Hessel, Rafet Sifa, Christian Bauckhage, Hannaneh Hajishirzi, Yejin Choi* |
| 35 | + *Proc. ICLR, 2023* |
| 36 | + [[Paper]](https://arxiv.org/abs/2210.01241) · [[Code]](https://github.com/allenai/RL4LMs) |
| 37 | + |
| 38 | +* **Cats Confuse Reasoning LLM: Query Agnostic Adversarial Triggers for Reasoning Models** |
| 39 | + *Meghana Arakkal Rajeev, Rajkumar Ramamurthy, Prapti Trivedi, Vikas Yadav, Oluwanifemi Bamgbose, Sathwik Tejaswi Madhusudhan, James Zou, Nazneen Rajani* |
| 40 | + *Proc. COLM, 2025* |
| 41 | + [[Paper]](https://arxiv.org/abs/2503.01781) |
| 42 | + |
| 43 | +## Contact Details |
| 44 | + |
| 45 | +If you want to get in contact, write an Email to rajkumarramamurthy[at]uni-bonn.de or ramamurthy[at]iai.uni-bonn.de. |
0 commit comments