Multimodal Reasoning and Agents

Multimodal Reasoning and Agents

Our research investigates how to elevate machine capabilities on complex tasks through advanced reasoning and environment interaction. We explore the fundamental mechanisms of artificial cognition, studying whether models reason most effectively through natural language, visual modalities across long time horizons, or external tool integration like code execution and search. Beyond internal deliberation, we focus on grounding these models to interact autonomously with physical systems like robotics and digital spaces like web navigation, bridging high-level reasoning with real-world execution.

Experts

  Name Working area(s) Contact
Nishad Singhi M.Sc.Modularity
S4/23 207
Hector Garcia Rodriguez M.Sc.Adaptability, Modularity
S4/23 207
Akshita Gupta M.Sc.Multimodal Reasoning and Generation
S4|23 217
Mark Rothermel M.Sc.Multimodal Fact-Checking
S4/23 207
Prof. Dr. Marcus RohrbachMultimodal Reliable AI
S4/23 204
Prof. Dr. Anna RohrbachMultimodal Grounded Learning
S4/23 205