Publications

Everything we have published.

Every paper has its own page with the figure, the abstract, and links to the PDF, the publisher, the code and the dataset where they exist. Filter by keyword, person, year or type.

41papers

2026

  • Three-panel overview: human motion sequences retargeted into the CARLA simulator, a grid of simulated street-crossing scenes with a "HABIT Benchmark" gauge, and perception, prediction and planning examples next to a connected-car icon.
    WACV 2026

    HABIT: Human action benchmark for interactive traffic in CARLA

    M. Ramesh, M. Azer, F. B. Flohr

    pedestrianssimulationbenchmarkplanningmotion generation
  • Six panels: three urban street camera images from a bicycle with 2D skeletons and boxes on a signalling cyclist, a crossing pedestrian and a cyclist in a narrow lane, above the matching colour-coded LiDAR depth images.
    ICPR 2026

    bikeActions: An action classification dataset for cyclist behaviour

    M. A. Buettner, K. Mazumder, L. Koecher, M. Finkbeiner, S. Niebler, F. B. Flohr

    cyclistsvulnerable road usersdatasetbenchmarkintent
  • WorldVLM overview: a vision-language model turns front-camera images into a behaviour command, which conditions a world model that forecasts the ego trajectory
    IEEE ITSC

    WorldVLM: Combining world model forecasting and vision-language reasoning

    S. Englmeier, K. Winter, F. B. Flohr

    world modelslanguage modelsplanninggenerative modelsend-to-end driving
  • Pipeline diagram: a LiDAR point cloud passes through an encoder, BEV feature layers and a decoder to a predicted map of an intersection, while an offline-generated 2D intensity map feeds intensity-to-LiDAR distillation during training only.
    ITSC 2026

    LIE: LiDAR-only HD map construction with intensity enhancement

    K. Mazumder, F. B. Flohr

    hd mapslidarpoint cloudsknowledge distillationbev
  • Diagram in which a dark night-time camera crop and a LiDAR point cloud of a pedestrian pass through the LIF-Net CAFF module, which outputs a 3D SMPL body mesh overlaid on both the image and the point cloud.
    IEEE IV 2026

    LIF-Net: LiDAR–camera fusion for 3D human pose in urban scenes

    M. A. Buettner, E. Schuetz, F. B. Flohr

    3d posesensor fusionlidarcameravulnerable road users
  • MASAR core idea: from multi-frame camera images, past trajectory hypotheses of a detected car are refined and scored by the visual features along them; the winning hypothesis conditions the multi-modal future trajectory forecast
    IEEE ICRA

    MASAR: Motion-appearance synergy refinement for joint detection and trajectory forecasting

    M. A. Bencheikh Lehocine, J. Schmidt, F. Moosmann, D. Gupta, F. B. Flohr

    trajectory prediction3D object detectionend-to-end drivingtransformersnuScenes
  • Diagram comparing MapTR, which predicts lane polylines from multi-view camera images only, with SatMap, which also fuses a satellite map; the occluded regions are marked with red and purple dashed boxes next to the ground truth.
    ICPR 2026

    SatMap: Satellite maps as a prior for online HD map construction

    K. Mazumder, F. B. Flohr

    hd mapscamerasensor fusionsatellite imagerybev
  • Bird's-eye view of a simulated intersection: a surrounding car labelled "Goal: ??" has several dashed blue candidate trajectories, while the red ego car labelled "Goal: left turn" follows a single green left-turn path.
    2026

    PlanTRansformer: Unified prediction and planning with a goal-conditioned transformer

    C. Selzer, F. B. Flohr

    trajectory predictionplanningintenttransformer

2025

  • Diagram in which multi-view camera images and a LiDAR point cloud are fused into stacked BEV feature grids with positional encoding and passed to Llama-3, which outputs 3D grounding and 3D captioning text.
    2025

    BEV-LLM: Multimodal BEV maps for scene captioning

    F. Brandstätter, E. Schütz, K. Winter, F. B. Flohr

    language modelssensor fusionlidarcameradataset
  • Aerial view of a simulated intersection with overlays showing multi-view camera and LiDAR inputs fused into a BEV feature map, which together with the navigation instruction "Take a right turn" feeds an LLM that plans the vehicle's waypoints.
    IROS 2025

    BEVDriver: BEV maps in LLMs for robust closed-loop driving

    K. Winter, M. Azer, F. B. Flohr

    language modelsplanningsimulationsensor fusionlidar
  • Horizontal chevron diagram of the autonomous driving stack from sensors and raw sensor data through scene and scenario generation, trajectory prediction and motion planning to control, with small intersection sketches and an x-to-end band underneath.
    2025

    Generative AI for Autonomous Driving: A review

    K. Winter, A. Vivekanandan, R. Polley, Y. Shen, C. Schlauch, M. Bouzidi, B. Derajic, N. Grabowsky, A. Mariani, D. Rochau, G. Lucente, H. Yadav, F. Mualla, A. Molin, S. Bernhard, C. Wirth, Ö. S. Tas, N. Klein, F. B. Flohr, H. Gottschalk

    surveygenerative modelsworld modelsplanningsimulation
  • Framework diagram: a text query "A person walking on a crosswalk" and a combined video and 3D human motion embedding are mapped into a shared vector space, producing a ranked list of matching street scenes.
    2025

    ContextMotionCLIP: Open-vocabulary motion retrieval for driving scenes

    S. Englmeier, M. A. Büttner, K. Winter, F. B. Flohr

    retrievalvulnerable road users3d poselanguage modelsdataset

2024

  • Three linked panels: a drone aerial image of an urban street with detected road users, the derived scenario data with agent trajectories along a lane, and a zoomed view of predicted and planned trajectories.
    ITSC 2024

    DeepUrban: Interaction-aware trajectory prediction from aerial imagery

    C. Selzer, F. B. Flohr

    trajectory predictionplanningdatasetbenchmarkdrones
  • Framework diagram: a custom motion-capture suit produces the Walk-the-Talk dataset of text and pedestrian motion pairs, a VQ-VAE tokenizer turns them into motion and text tokens for a language model, and the generated motion is played back on a pedestrian in the CARLA simulator.
    IEEE IV 2024

    Walk-the-Talk: LLM-driven pedestrian motion generation

    M. Ramesh, F. B. Flohr

    pedestriansmotion generationlanguage modelssimulationdataset

2023

  • Diagram showing AV sensor information, a pedestrian camera crop with 2D keypoints and the corresponding sparse LiDAR scan, with an arrow to the estimated colour-coded 3D skeleton and a list of its benefits.
    IEEE IV

    Weakly Supervised Multi-Modal 3D Human Body Pose Estimation for Autonomous Driving

    P. Bauer, A. Bouazizi, U. Kressel, F. Flohr

    3d posepedestrianssensor fusionlidarcamera
  • Schematic top view of a four-way intersection with a car, pedestrian and cyclist, dashed arrows and ellipses showing their possible future trajectories, and speech bubbles indicating which road users and traffic lights each agent considers.
    Journal article

    A Review of Trajectory Prediction Methods for the Vulnerable Road User

    E. Schuetz, F. B. Flohr

    surveytrajectory predictionvulnerable road userspedestrianscyclists
  • System diagram with a Node-RED flow editor at the top, a CARLA simulator screenshot of a pedestrian and a van at the bottom left, an MQTT broker box in the middle, and boxes for ML models and electronic control units on the right connected by arrows.
    Conference paper

    Using Node-RED as a Low-Code Approach to Model Interaction Logic of Machine-Learning-Supported EHMIs for the Virtual Driving Simulator Carla

    S. Winkelmann, M. Büttner, D. Deivasihamani, A. Hoffmann, F. Flohr

    hmivulnerable road usersdetectionsimulationlow-code

2022

  • Grid of 25 generated chair and sofa point clouds arranged by conditioning height (vertical axis 0.36 to 0.84) and width (horizontal axis 0.36 to 0.84), with a dotted outline marking the training distribution.
    Conference paper

    Point Cloud Generation with Continuous Conditioning

    L. T. Triess, A. Bühler, D. Peter, F. B. Flohr, M. Zöllner

    point cloudsgenerative models3d shape generation

2021

  • Dash-cam view of a multi-lane urban road in Beijing with tall buildings and a pedestrian bridge, where a group of pedestrians on the right sidewalk are marked with blue bounding boxes and colored skeleton lines.
    IEEE IV

    UrbanPose: A New Benchmark for VRU Pose Estimation in Urban Traffic Scenes

    S. Wang, D. Yang, B. Wang, Z. Guo, R. K. Verma, J. Ramesh, C. Weinrich, U. Kressel, F. B. Flohr

    vulnerable road userspedestrianscyclistsbenchmarkdataset
  • IEEE IV

    Pose-Guided Person Image Synthesis for Data Augmentation in Pedestrian Detection

    R. Zhi, Z. Guo, W. Zhang, B. Wang, V. Kaiser, J. Wiederer, F. B. Flohr

    pedestriansdetectiongenerative modelsdatasetdata augmentation
  • Two street photos with estimated skeletons: two cyclists, one signalling with an outstretched arm, and a person raising a hand, each with pie charts over gesture classes no gesture, stop, forward, left turn and right turn.
    Conference paper

    VRU Pose-SSD: Multiperson Pose Estimation For Automated Driving

    C. Kumar, J. Ramesh, B. Chakraborty, R. Raman, C. Weinrich, A. Mundhada, A. Jain, F. B. Flohr

    vulnerable road userspedestriansdetectionbenchmarkpose estimation
  • Method overview: a Darknet53 detector with front and back prediction heads and pair NMS finds overlapping pedestrian pairs, a single crop per pair goes to a ResNet-101 with separate front and back pose heatmap branches, and the result shows two overlapping skeletons.
    IEEE IV

    Simple Pair Pose-Pairwise Human Pose Estimation in Dense Urban Traffic Scenes

    M. Braun, F. B. Flohr, S. Krebs, U. Kressel, D. M. Gavrila

    pedestriansvulnerable road usersdatasetbenchmarkpose estimation

2020

  • Pipeline diagram reading left to right: thumbnails of a raw dataset feed a generative model based data augmentation block that outputs synthetic person images, which are merged with the raw data and passed to a special person classification network shown with a bar chart of results.
    IEEE IV

    Generative Model Based Data Augmentation for Special Person Classification

    Z. Guo, R. Zhi, W. Zhang, B. Wang, Z. Fang, V. Kaiser, J. Wiederer, F. B. Flohr

    pedestriansgenerative modelsdetectiondata augmentationclassification
  • Eight black pictograms of a traffic police officer in two rows, each showing a different arm gesture such as stop, straight, left turn and slow down.
    IEEE IV

    Traffic Police Gesture Recognition by Pose Graph Convolutional Networks

    Z. Fang, W. Zhang, Z. Guo, R. Zhi, B. Wang, F. B. Flohr

    pedestriansintentdatasetgesture recognitiongraph neural networks

2019

  • Two in-car camera views: a pedestrian at the curb with bounding boxes and a head-orientation box, and a cyclist raising an arm before turning, each with predicted path markers.
    IJCV

    Context-based path prediction for targets with switching dynamics

    J. F. P. Kooij, F. B. Flohr, E. A. I. Pool, D. M. Gavrila

    pedestrianscyclistsvulnerable road userstrajectory predictionintent
  • Hazy street scene from a vehicle camera with several pedestrians and riders outlined in differently colored boxes, each with a track id label and a dotted colored line and arrow showing its predicted trajectory.
    IEEE IV

    Recurrent Neural Network Architectures for Vulnerable Road User Trajectory Prediction

    H. Xiong, F. B. Flohr, S. Wang, B. Wang, J. Wang, K. Li

    vulnerable road userstrajectory predictioncyclistspedestriansbenchmark
  • A map of Europe composed as a mosaic of small pedestrian image crops, with pins marking the cities where the dataset was recorded.
    IEEE TPAMI

    EuroCity persons: A novel benchmark for person detection in traffic scenes

    M. Braun, S. Krebs, F. B. Flohr, D. M. Gavrila

    pedestrianscyclistsdetectionbenchmarkdataset
  • A five-by-three grid of person crops labeled (a) to (e), where the first three columns show small, blurry pedestrians and riders from vehicle-mounted cameras and the last two columns show large, sharp people from general-purpose pose datasets.
    IEEE ITSC

    Leverage of Limb Detection in Pose Estimation for Vulnerable Road Users

    S. Wang, F. B. Flohr, H. Xiong, T. Wen, B. Wang, M. Yang, D. Yang

    vulnerable road userscyclistspedestriansdatasetpose estimation

2018

2017

  • Grayscale view through a car windshield of a city street with pedestrians highlighted by green and orange translucent boxes and blue ellipses on the road ahead of them marking predicted positions.
    IEEE ITSC

    A survey on leveraging deep neural networks for object tracking

    S. Krebs, B. Duraisamy, F. B. Flohr

    surveysensor fusiondetectionobject trackingdeep learning
  • A pie chart of European road traffic deaths by road user type, with car occupants 51 percent, pedestrians 26 percent, motorized two- and three-wheelers 9 percent, cyclists 4 percent and others 10 percent.
    ESV

    Advancing active safety towards the protection of vulnerable road users: the PROSPECT project

    A. Aparicio, L. Sanz, G. Burnett, H. Stoll, M. Arbitmann, M. Kunert, F. B. Flohr, P. Seiniger, D. M. Gavrila

    vulnerable road userspedestrianscyclistshmiactive safety
  • A collage of photos of Mercedes-Benz research vehicles, including sensor rigs, trunk-mounted computing hardware, and a car during a calibration session.
    ROSCon 2017

    Building a computer vision research vehicle with ROS

    A. Fregin, M. Roth, M. Braun, S. Krebs, F. B. Flohr

    sensor fusioncameracalibrationrosresearch vehicle

2016

  • A 3D rendering of a driver head with gaze cone inside a car, above a camera view combining the driver face with a street scene showing a detected pedestrian.
    IEEE IV

    Driver and pedestrian awareness-based collision risk analysis

    M. Roth, F. B. Flohr, D. M. Gavrila

    pedestrianstrajectory predictionintentvulnerable road userscollision risk
  • Pipeline diagram: an input street image with a pedestrian and a cyclist, upper-body detection, cropped candidate regions fed through a deep network, and the post-processed output detections.
    IEEE T-ITS

    A unified framework for concurrent pedestrian and cyclist detection

    X. Li, L. Li, F. B. Flohr, J. Wang, H. Xiong, M. Bernhard, S. Pan, D. M. Gavrila, K. Li

    pedestrianscyclistsdetectionvulnerable road usersdataset
  • Top: a lidar point cloud with clustered points enclosed in 3D boxes labeled vehicle and bike; bottom: the corresponding camera image of a residential street with parked cars and a cyclist outlined by white boxes.
    IEEE ITSC

    Pose-rcnn: Joint object detection and pose estimation using 3d object proposals

    M. Braun, Q. Rao, Y. Wang, F. B. Flohr

    detection3d posecyclistslidarcamera
  • A circular diagram of cyclist image samples arranged by viewing orientation from 0 to 315 degrees, with coloured sectors for the aspect-ratio classes.
    IEEE IV

    A new benchmark for vision-based cyclist detection

    X. Li, F. B. Flohr, Y. Yang, H. Xiong, M. Braun, S. Pan, K. Li, D. M. Gavrila

    cyclistsvulnerable road usersdetectionbenchmarkdataset

2015

  • Block diagram of the joint pedestrian head and body orientation estimation pipeline, with orientation-specific detectors, colour-coded orientation dials and a joint orientation tracker.
    IEEE T-ITS

    A probabilistic framework for joint pedestrian head and body orientation estimation

    F. B. Flohr, M. Dumitru-Guzu, J. F. P. Kooij, D. M. Gavrila

    pedestrians3d poseintentcamerahead orientation

2014

  • Block diagram of the pipeline from pedestrian detection and tracking to joint body and head orientation estimation, with colour-coded orientation dials and a pedestrian image.
    IEEE IV

    Joint probabilistic pedestrian head and body orientation estimation

    F. B. Flohr, M. Dumitru-Guzu, J. F. P. Kooij, D. M. Gavrila

    pedestrians3d poseintentcamerahead orientation
  • Left, a street scene with a pedestrian at the curb, bounding boxes, head crops and predicted paths; right, a dynamic Bayesian network graph unrolled over two time steps.
    ECCV

    Context-based pedestrian path prediction

    J. F. P. Kooij, N. Schneider, F. B. Flohr, D. M. Gavrila

    pedestrianstrajectory predictionintentvulnerable road usersdataset

2013

2012

  • Conference paper

    Evaluation of tracking methods for maritime surveillance

    Y. Fischer, M. Baum, F. B. Flohr, U. D. Hanebeck, J. Beyerer

    sensor fusionsimulationmulti-target trackingmaritime surveillance

Lab members are set in bold. Figures are taken from the papers. All entries as one BibTeX file.