Project Lab Human Activity Understanding
| Lecturer (assistant) | |
|---|---|
| Number | 0000001784 |
| Type | practical training |
| Duration | 5 SWS |
| Term | Sommersemester 2026 |
| Language of instruction | English |
| Position within curricula | See TUMonline |
| Dates | See TUMonline |
Admission information
Description
Sensor data collection and annotation
- Multi-sensor and multi-view data collection and processing, including color/depth/IMU
- Synthetic data generation for Human Actions
- Accelerated ground truth annotation using interactive instance segmentation and tracking
Semantic inference building blocks
- Object detection
- Human and Object pose estimation
Graph representation of spatial and temporal data
- 3D scene graphs
- semantic graphs
- Spatio-Temporal graphs
- Knowledge Bases (Ontologies)
Sequential deep learning models for Human Activity Recognition and Anticipation
- Recurrent Neural Networks
- Graph Networks
- Transformers
- Multi-sensor and multi-view data collection and processing, including color/depth/IMU
- Synthetic data generation for Human Actions
- Accelerated ground truth annotation using interactive instance segmentation and tracking
Semantic inference building blocks
- Object detection
- Human and Object pose estimation
Graph representation of spatial and temporal data
- 3D scene graphs
- semantic graphs
- Spatio-Temporal graphs
- Knowledge Bases (Ontologies)
Sequential deep learning models for Human Activity Recognition and Anticipation
- Recurrent Neural Networks
- Graph Networks
- Transformers
Teaching and learning methods
- Supervised weekly lab sessions with several introductory lectures by research assistants at the beginning of the
course, and supervised practical implementation based on the provided skeleton codes.
- Individual methods and solutions introduced by the student
- Lectures on theoretical basics of project planning, technical management. and tools for collaboration (SCRUM, Gitlab, Wiki, etc.)
- Final project: individual and group work with independent planning, execution and documentation
- Seminar: Presentation of intermediate and final results and discussion (reflection, feedback).
Media formats:
The following media forms will be used:
- Presentations
- Script and review articles from the technical literature
- Tutorials and software documentation
- Development Environment (virtual machines on server)
- Simulation environment
- Data collection setup
course, and supervised practical implementation based on the provided skeleton codes.
- Individual methods and solutions introduced by the student
- Lectures on theoretical basics of project planning, technical management. and tools for collaboration (SCRUM, Gitlab, Wiki, etc.)
- Final project: individual and group work with independent planning, execution and documentation
- Seminar: Presentation of intermediate and final results and discussion (reflection, feedback).
Media formats:
The following media forms will be used:
- Presentations
- Script and review articles from the technical literature
- Tutorials and software documentation
- Development Environment (virtual machines on server)
- Simulation environment
- Data collection setup
Links
Previous Lab Project Demos
Kick off meeting announcement
The lab kick-off meeting will be in-person on 17.10.2024 at the Seminar Room 0406 https://nav.tum.de/room/0504.EG.406 (from 15:00 to 16:30).