ToF 3D image sensors for automotive
REAL3™ ToF sensors in cars bring added comfort and safety to automotive applications
Our REAL3™ automotive imager based on 3D time-of-flight (ToF) technology brings the most accurate and robust depth sensing capabilities to a wide range of automotive use cases both within and beyond the vehicle. As cars evolve to support a greater degree of automated driving and more intuitive ways for the driver and passengers to interact with the vehicle (HMI), designers are increasingly focusing on freedom, flexibility, comfort and – most importantly – safety.
Our REAL3™ 3D in-cabin sensing cameras capture and process the data needed to ensure a high standard of passive safety through use cases like driver monitoring, occupant detection and smart airbag systems offering an imager developed according ISO26262 ASIL-B standard. The 3D depth data also supports best anti-spoofing capabilities for secure face authentication in order to enable in-car payment or access to private data and cloud services, or even to open the car by face-ID. ToF cameras also support exterior sensing functions such as secure navigation and collision avoidance. In addition, comfort features such as gesture control and fully autonomous parking pave the way for maximum driver convenience. Here, high-resolution ToF cameras use 3D sensing to scan the area round the car down to the ground to detect curbs, walls or other obstacles – regardless of how bright or dark it is.
The REAL3™ product portfolio also comprises imagers for consumer applications and VCSEL driver ICs.
The consumer grade ToF imagers are only available as bare die and targeting high volume applications. If you are looking for a complete ToF camera module to directly use the 3D pointcloud in your application we have a partner network of modulemaker and camera designhouses established.
If you are interested to find the right partner or to learn more about the REAL3 product portfolio please contact our Support Center by providing us some basic information about your application requirements.
Meet us in Detroit and listen to our expert about "Sense the car like a human – trend to multiple sensor technologies increasing well-being, intuitive interaction, and occupant safety"
Whitepaper “Pioneering In-Cabin Monitoring“
Infineon contributes with its REAL3™ Time-of-Flight solution to the whitepaper from Fraunhofer IOSB “Pioneering In-Cabin Monitoring - Unmasking the Power of 2D and 3D Cameras”. The whitepaper provides insights from many automotive experts discussing current and future legislation on driver monitoring systems, current and future applications and functions of occupant monitoring, sensor comparisons, especially between 2D and 3D sensing, and more. Download the whitepaper here.
Please find here our strong partner network using REAL3™ image sensors.
As automated driving capabilities evolve, drivers are increasingly being relieved of regular driving tasks and almost become “passengers”. This means cars are being turned into “living spaces” with completely new interior concepts to meet entertainment, work and relaxation expectations.
A REAL3™ time-of-flight (ToF) camera is the best way to support growing demand for comfort and convenience while still delivering advanced levels of passive safety. Additionally, a ToF camera can reduce the BOM for other electronic systems such as seat mat and seat belt sensors.
Examples of enhanced comfort features enabled by REAL3™
- Gesture control
- Secure 3D face authentication (anti-spoofing) in combination with driver monitoring
- Intentional in-cabin lighting so only the area the driver or passenger is reaching for is illuminated (e.g. knobs close to a human hand)
- Automatic setting of pre-defined preferences
- Recommendations for optimized mirror or seat positions
- Dual display with customized content and features shown depending on driver or passenger
- Optimized audio depending on head position and available occupants
Enhanced occupant safety features enabled by REAL3™
- Driver monitoring with exact head position, eye-closure detection, gaze area segmentation
- Driver out of position, driver distraction, fatigue, hands on steering wheel detection
- Occupant detection and classification: exact size and weight estimations
- Child presence detection
- Smart airbag: adapt pressure or switch off depending on situation
- Head position to airbag (e.g. changing seat positions such as lean back position during autonomous driving modes)
- Rear-facing baby seat
- Object on seat or carried by passenger
- Fastened seat belt detection
Download our application brief: 3D in-cabin sensing, using the REAL3™ Time-of-Flight imager IRS2877A(S)
Autonomous and highly automated cars require a robust sensor cocoon around the car to sense and understand their environment. A combination of different technologies like radar, lidar and cameras are generally fused to create this effect. These sensors are very well suited to short- and long-range applications, but depending on the automated driving level (SAE level1-5), the requirements and the placement of the sensors, it may also be necessary to cover close-range blind spots down to the ground in order to complete the sensor cocoon. This calls for more detailed resolution and better performance than today’s ultra-sonic sensors can provide.
A time-of-flight camera (ToF) leveraging flash lidar technology is the best way to realize a very small solution without any moving parts at comparatively low cost. It provides the most robust 3D visualization of the environment in high resolution (horizontal and vertical) over a range of up to 10m. Besides highly accurate depth data at pixel level, ToF imagers also support sunlight-independent amplitude pictures so the car can recognize signs on the street for example.
This reliable stream of 3D ToF data can be used to support a wide range of use cases around the car:
Obstacle Avoidance
- Automated doors
- Autonomous parking
- Autonomous driving
- Covering close-range blind spots around the autonomous driving sensor cocoon
- Dynamic situational awareness during vehicle startup
- Secondary sensor data stream to support autonomous driving modes
Keyless entry
- Face recognition with secure 3D authentication
