ToF 3D image sensors

Our network of trusted REAL3™ ToF 3D image sensor partners are going to accelerate your product's time-to-market by minimizing your development time.

Overview

Infineon’s REAL3™ 3D image sensors use advanced Time-of-Flight (ToF) technology for accurate depth sensing and 3D imaging. Part of the XENSIV™ sensor portfolio, REAL3™ supports consumer, industrial, and automotive applications. Combined with Infineon’s VCSEL driver IC, the REAL3™ ToF module delivers high performance, low-latency operation, a compact footprint, and cost efficiency, enabling reliable next-generation 3D sensing solutions.

Key Features

  • Accurate & precise depth sensing
  • High resolution 3D point cloud
  • Simultaneous 2D grayscale image
  • Robust in all light conditions
  • Smallest form factor
  • On-chip integrated laser safety
  • Multi-camera interference robust
  • ISO 26262-compliant (ASIL B)
  • Variant in plastic BGA package

Products

About

Time-of-Flight (ToF) 3D image sensors

REAL3™ ToF imager solutions are the perfect fit for the smallest 3D vision camera modules, combining accurate depth measurement over the short and longer ranges with the lowest power consumption. The REAL3™ product portfolio comprises dedicated 3D single-chip image sensors with different pixel resolutions and are delivered as bare die or in an automotive qualified BGA package. The imagers are highly configurable to meet different application requirements, like supporting HDR modes and dual illuminations (for hybrid ToF use-cases). Thanks to its patented Suppression of Background Illumination (SBI) technology, they support camera deployments under all ambient light conditions. SBI and other embedded features are additionally supporting best-in-class robustness against multi-camera interference. Safety critical applications are addressed by an ISO26262 ASIL-B compliant variant. Together with the highly integrated driver ICs for VCSEL illumination, they form an optimized bundle for the smallest ToF camera module designs.

The BOM-optimized REAL3™ ToF hardware is complemented by a broad network of global design, software, and manufacturing partners providing optimal support, high innovation power, and fast time to market to all REAL3™ customers. Leverage Infineon’s partner network of module makers and camera design houses for complete ToF camera modules to directly use the 3D point cloud in your application.

Contact support center

How do REAL3™ Time-of-Flight 3D image sensors work?

REAL3™ ToF imagers are working according to the indirect Time-of-Flight (iToF) principle. Hereby, the ToF camera module projects modulated infrared light onto an object, user, or scene of interest. The reflected light is captured by the ToF imager, which measures the amplitude and phase difference for each pixel. This raw data is then processed by an external application processor, resulting in a highly reliable distance image, as well as a grayscale picture of the entire scene.

ToF 3D working principle infographic

REAL3™ ToF benefits for the application

Why Time-of-Flight:

  • Robust, measured 3D depth data with high resolution under all lighting conditions!
  • Depth data is measured, neither calculated nor estimated, as in 2D AI or 2D stereo camera solutions.
  • Works under all light conditions, from darkness to strong direct sunlight, night view including depth and gray value picture.
  • Depth data includes confidence data to guarantee data integrity.
  • Small form factor, mechanically stable solution, lifetime calibration, no risk of losing calibration over lifetime.
  • Low computational load on system processor.

Why REAL3™ ToF from Infineon:

  • Highly optimized, flexible, best-in-class performance, and volume-proven!
  • Comprehensive iToF product portfolio: from automotive-grade, ASIL-B level packaged VGA imager to HQVGA imager as bare die for consumer applications, and low-cost laser driver ICs for optimized camera module bills of materials (BOM).
  • Volume-proven in automotive, robotics, smartphone, XR, and other consumer and industrial applications.
  • High flexibility: integrated controller and freely programmable modulation frequencies and operation modes, such as HDR mode with multiple modulation frequencies, code-based modulation, control of multiple illumination sources, camera synchronization, and multi-camera operation.
  • Best sunlight robustness: patented Suppression of Backlight Illumination (SBI) circuitry in every pixel.
  • Fast time-to-market: a mutually complementary, fully integrated offering from Infineon and pmdtechnologies, coupled with a strong partner network spanning the entire design and production ecosystem.

Complementary VCSEL driver portfolio

REAL3™ image sensors with highly-optimized VCSEL laser driver ICs

The winning combo: High-resolution REAL3™ ToF 3D  imager and efficient VCSEL (Vertical Cavity Surface Emitting Laser) drivers to foster the world's smallest 3D camera modules.

The REAL3™ VCSEL driver ICs have been designed specifically with the Infineon REAL3™ imager portfolio in mind. Together, they enable high-performance 3D camera systems, facilitating ease of integration, a reduced BOM for optimized cost and form factor, and power efficiency gains while providing a fully integrated eye safety solution. Highlights include support for single-, dual-, and triple-junction VCSELs, fast switching behavior up to 250 MHz, and ultra-small packages.

Driver complementary VCSEL driver ICs

Main target applications of ToF 3D image sensors in consumer

The powerful data provided by a Time-of-Flight camera can be used in a variety of applications and use cases:

Personal electronics

Use 3D data for secure face authentication, augmented reality, high-resolution scanning, or optimizing photography and videos (autofocus, bokeh effects).

  • Smartphones and tablets
  • AR/VR headsets and glasses
  • Other wearables

Beam projectors

Use 3D data for keystone correction and autofocus optimization.

Home security, payment and monitoring systems

Use 3D data for secure face authentication and identification, as well as room monitoring.

  • Smart door locks and access control
  • Point of sale terminals (POS)
  • Area surveillance
  • People counting
  • Automated doors

Main target applications of ToF 3D image sensors in robotics

The powerful data provided by a Time-of-Flight camera can be used in a variety of applications and use cases:

Consumer & service robots

Use 3D data for navigation, Simultaneous Localization and Mapping (SLAM), advanced obstacle avoidance, and cliff detection.

  • Robot vacuum cleaner (RVC)
  • Lawn mower
  • Delivery and service robots
  • Social and entertainment robots, edutainment, and robot toys

Industrial robots

Use 3D data for advanced obstacle avoidance, cliff detection, navigation, safe human-robot interaction, grabbing control, and many more use cases in factory and logistics automation.

  • Humanoid robots
  • Collaborative robots (Cobots)
  • Autonomous mobile robots (AMR) and automated guided vehicles (AGV)
  • Automated fork lifter
  • Volumetric and gauging measurement

Infineon's REAL3™ ToF imager portfolio offers a reliable solution, with an ISO 26262 (ASIL-B) compliant variant that ensures functional safety requirements are met, even in industrial applications where machines and humans interact.

Main target applications of ToF 3D image sensors in automotive

The powerful data provided by a Time-of-Flight camera can be used in a variety of applications and use cases:

In-cabin sensing: Driver- and Occupant Monitoring Systems

With the advancement of automated driving capabilities, drivers are increasingly being relieved of regular driving tasks and almost become “passengers”. Cars turn into “living spaces” with new interior concepts for entertainment, work, and relaxation. 3D cameras based on REAL3™ ToF technology effectively support the growing demand for car comfort and convenience while delivering advanced levels of passive safety. In addition, a BOM reduction for other electronic systems such as seat and seat belt sensors can be achieved.

  • Comfort features enabled by REAL3™ include gesture control, secure 3D face authentication, intentional in-cabin lighting, automatic setting of preferences, optimized mirror/seat positions, dual display with customized content, and optimized audio. 
  • REAL3™ also enables enhanced occupant safety features like driver monitoring with head position, eye-closure detection, and driver distraction detection. It also enables occupant detection and classification, child presence detection, smart airbag adaptation, out of position detection, rear-facing baby seat detection, object detection on seat/passenger, and fastened seat belt detection.

Seamless vehicle access with secure 3D face authentication

Secure and convenient vehicle access. Leverage advanced 3D facial authentication for keyless entry and enable the vehicle to automatically prepare personalized settings before the driver enters.

Vehicle exterior applications

To ensure safe and reliable operation, autonomous and highly automated vehicles rely on a robust sensor cocoon around them. The sensor cocoon combines technologies such as radar and lidar. They enable the vehicle to sense its environment at short and long-range distances. Depending on the automated driving level (SAE level 1-5) and sensors’ placement, it may be also necessary to cover close-range blind spots near the ground. This calls for major resolution and performance that of ultrasonic sensors used today.

REAL3™ ToF 3D  sensors enable small-size and high-resolution solutions at optimized costs. They accurately sense the car's environment in 3D (horizontal and vertical) over a range of up to 10 m. The ToF sensor’s performance is unaffected by ambient light so that the car easily recognizes street signs. Use 3D data for advanced obstacle avoidance and situational awareness during vehicle startup.

  • Autonomous parking and driving
  • Automated doors

Time-of-Flight (ToF) 3D image sensors

REAL3™ ToF imager solutions are the perfect fit for the smallest 3D vision camera modules, combining accurate depth measurement over the short and longer ranges with the lowest power consumption. The REAL3™ product portfolio comprises dedicated 3D single-chip image sensors with different pixel resolutions and are delivered as bare die or in an automotive qualified BGA package. The imagers are highly configurable to meet different application requirements, like supporting HDR modes and dual illuminations (for hybrid ToF use-cases). Thanks to its patented Suppression of Background Illumination (SBI) technology, they support camera deployments under all ambient light conditions. SBI and other embedded features are additionally supporting best-in-class robustness against multi-camera interference. Safety critical applications are addressed by an ISO26262 ASIL-B compliant variant. Together with the highly integrated driver ICs for VCSEL illumination, they form an optimized bundle for the smallest ToF camera module designs.

The BOM-optimized REAL3™ ToF hardware is complemented by a broad network of global design, software, and manufacturing partners providing optimal support, high innovation power, and fast time to market to all REAL3™ customers. Leverage Infineon’s partner network of module makers and camera design houses for complete ToF camera modules to directly use the 3D point cloud in your application.

Contact support center

How do REAL3™ Time-of-Flight 3D image sensors work?

REAL3™ ToF imagers are working according to the indirect Time-of-Flight (iToF) principle. Hereby, the ToF camera module projects modulated infrared light onto an object, user, or scene of interest. The reflected light is captured by the ToF imager, which measures the amplitude and phase difference for each pixel. This raw data is then processed by an external application processor, resulting in a highly reliable distance image, as well as a grayscale picture of the entire scene.

ToF 3D working principle infographic

REAL3™ ToF benefits for the application

Why Time-of-Flight:

  • Robust, measured 3D depth data with high resolution under all lighting conditions!
  • Depth data is measured, neither calculated nor estimated, as in 2D AI or 2D stereo camera solutions.
  • Works under all light conditions, from darkness to strong direct sunlight, night view including depth and gray value picture.
  • Depth data includes confidence data to guarantee data integrity.
  • Small form factor, mechanically stable solution, lifetime calibration, no risk of losing calibration over lifetime.
  • Low computational load on system processor.

Why REAL3™ ToF from Infineon:

  • Highly optimized, flexible, best-in-class performance, and volume-proven!
  • Comprehensive iToF product portfolio: from automotive-grade, ASIL-B level packaged VGA imager to HQVGA imager as bare die for consumer applications, and low-cost laser driver ICs for optimized camera module bills of materials (BOM).
  • Volume-proven in automotive, robotics, smartphone, XR, and other consumer and industrial applications.
  • High flexibility: integrated controller and freely programmable modulation frequencies and operation modes, such as HDR mode with multiple modulation frequencies, code-based modulation, control of multiple illumination sources, camera synchronization, and multi-camera operation.
  • Best sunlight robustness: patented Suppression of Backlight Illumination (SBI) circuitry in every pixel.
  • Fast time-to-market: a mutually complementary, fully integrated offering from Infineon and pmdtechnologies, coupled with a strong partner network spanning the entire design and production ecosystem.

Complementary VCSEL driver portfolio

REAL3™ image sensors with highly-optimized VCSEL laser driver ICs

The winning combo: High-resolution REAL3™ ToF 3D  imager and efficient VCSEL (Vertical Cavity Surface Emitting Laser) drivers to foster the world's smallest 3D camera modules.

The REAL3™ VCSEL driver ICs have been designed specifically with the Infineon REAL3™ imager portfolio in mind. Together, they enable high-performance 3D camera systems, facilitating ease of integration, a reduced BOM for optimized cost and form factor, and power efficiency gains while providing a fully integrated eye safety solution. Highlights include support for single-, dual-, and triple-junction VCSELs, fast switching behavior up to 250 MHz, and ultra-small packages.

Driver complementary VCSEL driver ICs

Main target applications of ToF 3D image sensors in consumer

The powerful data provided by a Time-of-Flight camera can be used in a variety of applications and use cases:

Personal electronics

Use 3D data for secure face authentication, augmented reality, high-resolution scanning, or optimizing photography and videos (autofocus, bokeh effects).

  • Smartphones and tablets
  • AR/VR headsets and glasses
  • Other wearables

Beam projectors

Use 3D data for keystone correction and autofocus optimization.

Home security, payment and monitoring systems

Use 3D data for secure face authentication and identification, as well as room monitoring.

  • Smart door locks and access control
  • Point of sale terminals (POS)
  • Area surveillance
  • People counting
  • Automated doors

Main target applications of ToF 3D image sensors in robotics

The powerful data provided by a Time-of-Flight camera can be used in a variety of applications and use cases:

Consumer & service robots

Use 3D data for navigation, Simultaneous Localization and Mapping (SLAM), advanced obstacle avoidance, and cliff detection.

  • Robot vacuum cleaner (RVC)
  • Lawn mower
  • Delivery and service robots
  • Social and entertainment robots, edutainment, and robot toys

Industrial robots

Use 3D data for advanced obstacle avoidance, cliff detection, navigation, safe human-robot interaction, grabbing control, and many more use cases in factory and logistics automation.

  • Humanoid robots
  • Collaborative robots (Cobots)
  • Autonomous mobile robots (AMR) and automated guided vehicles (AGV)
  • Automated fork lifter
  • Volumetric and gauging measurement

Infineon's REAL3™ ToF imager portfolio offers a reliable solution, with an ISO 26262 (ASIL-B) compliant variant that ensures functional safety requirements are met, even in industrial applications where machines and humans interact.

Main target applications of ToF 3D image sensors in automotive

The powerful data provided by a Time-of-Flight camera can be used in a variety of applications and use cases:

In-cabin sensing: Driver- and Occupant Monitoring Systems

With the advancement of automated driving capabilities, drivers are increasingly being relieved of regular driving tasks and almost become “passengers”. Cars turn into “living spaces” with new interior concepts for entertainment, work, and relaxation. 3D cameras based on REAL3™ ToF technology effectively support the growing demand for car comfort and convenience while delivering advanced levels of passive safety. In addition, a BOM reduction for other electronic systems such as seat and seat belt sensors can be achieved.

  • Comfort features enabled by REAL3™ include gesture control, secure 3D face authentication, intentional in-cabin lighting, automatic setting of preferences, optimized mirror/seat positions, dual display with customized content, and optimized audio. 
  • REAL3™ also enables enhanced occupant safety features like driver monitoring with head position, eye-closure detection, and driver distraction detection. It also enables occupant detection and classification, child presence detection, smart airbag adaptation, out of position detection, rear-facing baby seat detection, object detection on seat/passenger, and fastened seat belt detection.

Seamless vehicle access with secure 3D face authentication

Secure and convenient vehicle access. Leverage advanced 3D facial authentication for keyless entry and enable the vehicle to automatically prepare personalized settings before the driver enters.

Vehicle exterior applications

To ensure safe and reliable operation, autonomous and highly automated vehicles rely on a robust sensor cocoon around them. The sensor cocoon combines technologies such as radar and lidar. They enable the vehicle to sense its environment at short and long-range distances. Depending on the automated driving level (SAE level 1-5) and sensors’ placement, it may be also necessary to cover close-range blind spots near the ground. This calls for major resolution and performance that of ultrasonic sensors used today.

REAL3™ ToF 3D  sensors enable small-size and high-resolution solutions at optimized costs. They accurately sense the car's environment in 3D (horizontal and vertical) over a range of up to 10 m. The ToF sensor’s performance is unaffected by ambient light so that the car easily recognizes street signs. Use 3D data for advanced obstacle avoidance and situational awareness during vehicle startup.

  • Autonomous parking and driving
  • Automated doors
Documents

Design resources

Developer community