Nobuaki Aoki
- E-mail: nobuaki.aoki@tum.de
Short Biography
- 10/2025 - present: PhD student at Chair of Information-Oriented Control (ITR), Technical University of Munich (TUM), Germany
- 03/2023 - 08/2025: Researcher at Research and Development Group at Hitachi Ltd., Tokyo, Japan
- 04/2021 - 03/2023: M.Sc. in Engineering, Keio University, Japan
- 04/2017 - 03/2021: Bachelor of Engineering, Keio University, Japan
- 10/2019 - 07/2020: Exchange at Technical University of Munich (TUM), Germany
Research Interests
I am interested in developing resilient autonomy for robots operating in uncertain, unstructured, and data-limited environments. My research focuses on combining machine learning, control theory, and information-driven decision-making to enable robots to learn, adapt, and act reliably in challenging domains such as rough terrain and underwater environments.
- Learning-Based Control – Integrating methods from machine learning and control theory to develop data-driven controllers for complex dynamical systems, with a focus on robustness, adaptation, and uncertainty-aware decision-making.
- Active Learning and Informative Planning for Dynamical Systems – Developing strategies that actively collect task-relevant data to identify system dynamics, reduce model uncertainty, and improve downstream control or navigation performance.
- Perception-Aware Planning and Control – Designing planning and control methods that explicitly account for perception quality, such as visibility, observability, object detection confidence, localization uncertainty, and information gain.
Seaclear2.0
- In the Seaclear2.0 project, we are developing an autonomous robotic system for seafloor litter collection. Building on Seaclear1.0, we aim to scale up to handle larger and heavier debris using a smart underwater grapple.
- Specifically, I am working mainly on visual servoing, where we compute control inputs of the vehicle based on the input camera images with object detection results.
Student Projects and Thesis
I am looking for motivated students interested in learning-based control, robot learning, and data-driven control. I particularly welcome inquiries for Forschungspraxis (FP) and Master’s theses (MA). Bachelor’s thesis (BA) or Ingenieurpraxis (IP) topics may occasionally be available when there is a suitable well-defined project.
Please include your preferred starting date as well as your CV and transcript of records in your e-mail. This helps me to select a topic matching your background.
Potential Topics
The following topics are possible starting points. The exact scope can be adjusted depending on the project type and the student's background.
- Task-Oriented and Value-Aware Learning for Robotic Control (FP/MA)
This topic studies how learning and data acquisition can be guided by their relevance to a downstream control task rather than by prediction accuracy alone. Possible directions include task-oriented active learning, value-aware model learning, reinforcement-learning-based formulations, and sensitivity- or value-of-information-based data selection. Applications may include navigation, autonomous vehicles, and robotic control under model uncertainty. - Online Residual Dynamics Learning for Robotic Systems (FP/MA)
This topic investigates online learning of unknown or residual robot dynamics using probabilistic and neural models, such as Gaussian processes, feed-forward neural networks, recurrent models, or neural differential equations. Research questions may include uncertainty calibration, heteroscedastic noise, online adaptation, multi-step prediction, computational efficiency, and robustness under changing operating conditions. Applications may include off-road, aerial, or underwater vehicles. - Differentiable Simulation and Policy Optimization (FP/MA)
- This topic investigates policy-learning methods that exploit gradients through differentiable robot dynamics and simulation. Possible directions include first-order policy optimization, residual policy learning, analysis of gradient quality and stability, robustness to model mismatch, and comparisons with model-free reinforcement learning. Applications may include legged robots, manipulation, and aerial robotics. Strong interest in reinforcement learning, optimization, and mathematical modeling is particularly useful.
- Perception-Aware Planning and Active Perception for Robotics (FP/MA)
This topic studies planning and control methods that explicitly account for the quality and task relevance of perception. Possible directions include active viewpoint selection, observability-aware planning, perception uncertainty, and task-oriented information gathering. Applications may include mobile robots, aerial robots, and underwater manipulation.
Desired Background
Useful background depending on the topic: control theory, numerical optimization, reinforcement learning, probabilistic machine learning, deep learning, Python/JAX/PyTorch, or robotics. You do not need to have experience in all of these areas.
Google Scholar
Journal
Reiya Takemura, Nobuaki Aoki and Genya Ishigami, "Energy-and-Perception-aware Planning and Navigation Framework for Unmanned Aerial Vehicles," Advances in Mechanical Engineering, 2023.
Nobuaki Aoki and Genya Ishigami, "Autonomous Tracking and Landing of Unmanned Aerial Vehicle on Ground Vehicle in Rough Terrain," Advanced Robotics, pp.344-355, 2023.
Nobuaki Aoki and Genya Ishigami, "Energy-Efficient Path Planning for UAV Using Spatiotemporal Wind Model," Journal of the Robotics Society of Japan, Vol. 40 No. 3 pp. 255-258 2022. (Japanese)
Conference
Nobuaki Aoki and Ryo Sakai, "Image Robotic Auto-Photographing System for Remote Visual Train Bogie Inspection: A Multi-Environment Gaze-Speed and 3D Clustering Approach," 2025 IEEE International Conference on Automation Science and Engineering (CASE2025), LA, USA, August 2025.
Nobuaki Aoki and Genya Ishigami, "Hardware-in-the-loop Simulation for Real-time Autonomous Tracking and Landing of an Unmanned Aerial Vehicle," 2023 IEEE/SICE International Symposium on System Integration (SII 2023), Atlanta, USA, pp132-137, January 2023.