In-cabin monitoring system (ICMS)

Infineon's comprehensive range of sensing solutions revolutionize in-cabin sensing systems by ensuring unparalleled safety and comfort

Overview

Infineon drives the future of mobility with advanced sensing technologies, reshaping vehicle interiors for safety and comfort. Our 60 GHz radar detects even the smallest movements, such as a child’s breathing, while 3D ToF cameras enable precise occupant detection and gesture recognition. Paired with saferty microcontrollers, and efficient PMICs, we deliver seamless, real-time in-cabin monitoring solutions, redefining the in-cabin experience.

Benefits

  • Safe: Life/child presence detection
  • Safe: Driver drowsiness detection
  • Safe: Driver distraction detection
  • Safe: Vital signs monitoring
  • Secure: Driver authentication
  • Secure: Intrusion & proximity alert
  • Secure: Anti-theft measures
  • Secure: Personal data protection
  • Smart: Gesture control
  • Smart: Personalized settings
  • Smart: Driver behavior analysis
  • Smart: Air quality monitoring

Block diagram

About

Explore the functionalities of our 60 GHz radar sensor for in-cabin monitoring systems below:

  • Robust Child Presence Detection (CPD) with >99% accuracy in the entire cabin
  • Accurate classification child vs. adult to reduce false alarms
  • Seat Occupancy Detection (SOD) enables features like Seat Belt Reminder (SBR) by locating passengers
  • Intrusion/proximity Alert (IPA) protects the contents of the cabin interior and monitors the area close to the exterior of the car
  • Vital sign sensing for heart and breathing rate measurements to indicate the driver's health
  • Gesture sensing enables intuitive interaction through simple "shortcut gestures"
  • Obstacle detection (ODS) for safely opening the door detecting static and moving targets next to the car
  • Smart Trunk Opener (STO) provides reliable kick detection for convenient trunk opening

Explore the functionalities of our radar module for in-cabin monitoring systems below:

  • Scalable solution enables cost-effective core designs, provides flexibility for adaption, and reduces development costs and time to market
  • Safety and high-performance microcontrollers with a dedicated processing unit optimized for radar signals
  • Full security protection provided by AURIX™ (HSM)
  • Low system power consumption enables battery-powered applications
  • Reduced system costs thanks to excellent thermal management (no heat sink needed)
  • Aesthetic design possible due to operation without line-of-sight and behind materials

Direct facing camera for Driver Monitoring System (DMS):

  • Secure 3D face authentication for seamless access to private data and services
  • Driver monitoring for optimized safety, such as head tracking, eye closure detection, gaze area segmentation, and emotion recognition
  • HUD and mirror positions optimized based on precise eye position measurements
  • Health monitoring (blood flow changes) and pulse rate detection (which can indicate impaired driving or sudden illness) are possible (ToF data can compensate for motion artifacts while driving)

Rear mirror or roof module area camera for Occupant Monitoring System (OMS):

  • Occupant detection and classification, e. g., for personalized audio and HVAC settings
  • Well-being features with spine detection recommends an optimized seat position or a massage option
  • Intuitive HMI enhances the user experience with natural and intuitive interaction through voice commands
  • Gestures and body language for personalized interaction
  • Enable smart airbags and restraints
  • Autonomous driving with flexible seat positions: Change seat positions while maintaining the highest possible level of occupant safety

Explore the functionalities of our 2D + 3D fusion solution for in-cabin monitoring systems below:

  • Combination of high resolution (5-8 megapixels) and 3D body model
  • Works in any lighting conditions
  • Meet increasing requirements towards ADAS/AD level 3 and Smart Airbags

Explore the functionalities of our sensor solutions for in-cabin monitoring systems below:

  • Adds all key sensing technologies together for the highest cabin monitoring coverage of all use cases
  • MEMS microphone provides voice control and an optimized, personalized audio experience. It also offers active and road noise cancellation, as well as occupant detection by microphones, which serves as a quality indicator.
  • Gas sensor optimizes ventilation, increases well-being, and reduces stress levels. It also detects HVAC refrigerant leaks to ensure occupant safety.

Explore the functionalities of our 60 GHz radar sensor for in-cabin monitoring systems below:

  • Robust Child Presence Detection (CPD) with >99% accuracy in the entire cabin
  • Accurate classification child vs. adult to reduce false alarms
  • Seat Occupancy Detection (SOD) enables features like Seat Belt Reminder (SBR) by locating passengers
  • Intrusion/proximity Alert (IPA) protects the contents of the cabin interior and monitors the area close to the exterior of the car
  • Vital sign sensing for heart and breathing rate measurements to indicate the driver's health
  • Gesture sensing enables intuitive interaction through simple "shortcut gestures"
  • Obstacle detection (ODS) for safely opening the door detecting static and moving targets next to the car
  • Smart Trunk Opener (STO) provides reliable kick detection for convenient trunk opening

Explore the functionalities of our radar module for in-cabin monitoring systems below:

  • Scalable solution enables cost-effective core designs, provides flexibility for adaption, and reduces development costs and time to market
  • Safety and high-performance microcontrollers with a dedicated processing unit optimized for radar signals
  • Full security protection provided by AURIX™ (HSM)
  • Low system power consumption enables battery-powered applications
  • Reduced system costs thanks to excellent thermal management (no heat sink needed)
  • Aesthetic design possible due to operation without line-of-sight and behind materials

Direct facing camera for Driver Monitoring System (DMS):

  • Secure 3D face authentication for seamless access to private data and services
  • Driver monitoring for optimized safety, such as head tracking, eye closure detection, gaze area segmentation, and emotion recognition
  • HUD and mirror positions optimized based on precise eye position measurements
  • Health monitoring (blood flow changes) and pulse rate detection (which can indicate impaired driving or sudden illness) are possible (ToF data can compensate for motion artifacts while driving)

Rear mirror or roof module area camera for Occupant Monitoring System (OMS):

  • Occupant detection and classification, e. g., for personalized audio and HVAC settings
  • Well-being features with spine detection recommends an optimized seat position or a massage option
  • Intuitive HMI enhances the user experience with natural and intuitive interaction through voice commands
  • Gestures and body language for personalized interaction
  • Enable smart airbags and restraints
  • Autonomous driving with flexible seat positions: Change seat positions while maintaining the highest possible level of occupant safety

Explore the functionalities of our 2D + 3D fusion solution for in-cabin monitoring systems below:

  • Combination of high resolution (5-8 megapixels) and 3D body model
  • Works in any lighting conditions
  • Meet increasing requirements towards ADAS/AD level 3 and Smart Airbags

Explore the functionalities of our sensor solutions for in-cabin monitoring systems below:

  • Adds all key sensing technologies together for the highest cabin monitoring coverage of all use cases
  • MEMS microphone provides voice control and an optimized, personalized audio experience. It also offers active and road noise cancellation, as well as occupant detection by microphones, which serves as a quality indicator.
  • Gas sensor optimizes ventilation, increases well-being, and reduces stress levels. It also detects HVAC refrigerant leaks to ensure occupant safety.

Documents

Design Resources

Developer community

{ "ctalist":[ { "link" : "https://community.infineon.com/t5/forums/postpage/choose-node/true", "label" : "Ask the community", "labelEn" : "Ask the community" }, { "link" : "https://community.infineon.com/t5/Forums/ct-p/products", "label" : "View all discussions", "labelEn" : "View all discussions" } ] }