Daimler researchers are making major strides in developing camera-based systems that can automatically recognize and classify different categories of people, objects and driving situations.

Such “scene labeling” capabilities represent a breakthrough, aided in part by the UR:BAN initiative -- shorthand for the Urban Space: User-friendly Assistance Systems and Network Management project. At the project’s closing event, Daimler presented results from five different test vehicles.

“The tremendous increase in computing power in recent years has brought closer the day when vehicles will be able to see their surroundings in the same way as humans and also correctly understand complex situations in city traffic,” said Professor Ralf Guido Herrtwich, head of driver assistance and chassis systems for group research and advanced development at Daimler AG.

Scene labeling transforms the camera “from a mere measuring system into an interpretive system, as multifunctional as the interplay between eye and brain,” Daimler explained in a press release.

One Daimler test vehicle demonstrated scene labeling, while another showcased imaging radar systems and their potential in urban environments. Radar sensors can now resolve and visualize not just dynamic objects but also static environments. Additionally, properties of radar waves allow the system to function in fog and inclement weather. Environment models can be generated using data from radar and camera sensors.

The third test vehicle included a system for detecting, classifying and identifying the intent of pedestrians and cyclists. This system, for example, analyzed head posture, body position and curbside position to predict whether a pedestrian was likely to stay on the sidewalk or cross the road. “In dangerous situations, this allows an accident-preventing system response to be triggered up to one second earlier than with currently available systems,” Daimler said.

Another highlight was the demonstration of how radar- and camera-based systems can make lane changing in city traffic safer and less stressful. Following a command from the driver, this system provides assisted lane changing in a speed range of 18-37 mph. The driver at all times has the option of overruling the system by intervening with the steering, accelerator or brakes.

The fifth test vehicle showed the potential for predicting driver behavior in relation to planned lane changes or changes of direction.

“With regard to an imminent change of lane, for example, glances over the shoulder are linked with driving parameters that have already been sensed,” Daimler explained. “A likely change of direction can be predicted from the interplay between steering movement, reduction of speed and map information. In the demonstration, the direction indicator was then automatically activated to inform other road users as early as possible.”

To advance such technology, Daimler continues to conduct research with its partners.