29 May 2024

Hybrid event and 20 fps camera matches 5,000 fps latency in offline driving detection tests

Photonics and optical computingSensors, imaging and electronic skin
AI illustration · Illustrative scene, not a photograph of the specific device or experiment.

What was demonstrated

Gehrig and Scaramuzza pair a 20 fps RGB camera with an event camera in a detector called DAGr. The authors report that the combination matches the perceptual latency of a 5,000 fps camera while using bandwidth close to that of a 45 fps camera. The tests ran on recorded driving data, not on a vehicle in real time.

Why it matters

Frame cameras in driver assistance trade bandwidth against latency, so a low-rate frame camera supplemented by events may let a vehicle detect objects sooner without a higher data rate. The result is an offline benchmark on recorded driving data, so it suggests rather than shows that this would improve on-road reaction times.

Caveats

  • The evaluation used recorded data, so the latency figure does not measure delay through a full vehicle control loop.
  • The comparison figures are the authors' own, drawn from their dataset and hardware setup, and have not been independently reproduced in this record.
  • The detection tests cover pedestrians and cars, the classes in the authors' dataset, and do not establish performance for other road users or conditions.
  • The exact latency, bandwidth and accuracy values were not checked against the full paper text for this record, so they are left out until they can be verified.

Technology profiles

Sources

  1. peer reviewed paper
    Low-latency automotive vision with event cameras
    Daniel Gehrig, Davide Scaramuzza. Nature, 29 May 2024. DOI: 10.1038/s41586-024-07409-w.

Last reviewed 21 Oct 2026.