ToF 3D image sensors

Our network of trusted REAL3™ ToF 3D image sensor partners are going to accelerate your product's time-to-market by minimizing your development time.

Overview

Infineon’s REAL3™ 3D image sensors use advanced Time-of-Flight (ToF) technology for accurate depth sensing and 3D imaging. Part of the XENSIV™ sensor portfolio, REAL3™ supports consumer, industrial, and automotive applications. Combined with Infineon’s VCSEL driver ICs, REAL3™ ToF modules deliver high performance, low latency, a compact footprint, and cost efficiency, enabling reliable next-generation 3D sensing sensing solutions.

Key Features

  • Accurate and precise depth sensing
  • High resolution 3D point cloud
  • Simultaneous 2D grayscale image
  • Robust in all light conditions
  • Smallest form factor
  • On-chip integrated laser safety
  • Multi-camera interference robust
  • Automotive qualified BGA package
  • Functional safety support

Products

About

REAL3™ Time-of-Flight (ToF) 3D image sensors & VCSEL drivers

REAL3™ ToF imager solutions are the perfect fit for the smallest 3D vision camera modules, combining accurate depth measurement over short and long ranges with the lowest power consumption. The REAL3™ product portfolio comprises dedicated 3D single-chip image sensors with different pixel resolutions and is delivered as bare die or in an automotive-qualified BGA package. The imagers are highly configurable to meet different application requirements, such as supporting HDR modes and dual illumination (for hybrid ToF use cases). Thanks to their patented Suppression of Background Illumination (SBI) technology, they support camera deployments under all ambient light conditions. SBI and other embedded features additionally provide best-in-class robustness against multi-camera interference. Safety-critical applications are addressed by an ISO 26262-compliant (ASIL B) variant. Together with highly integrated VCSEL (Vertical-Cavity Surface-Emitting Laser) driver ICs, they form an optimized bundle for the smallest ToF camera module designs.

Driver complementary VCSEL driver ICs

How REAL3™ Time-of-Flight enables best environmental perception

Why REAL3™ Time-of-Flight from Infineon:

Robust, measured high-resolution 3D depth data under all lighting conditions. Highly optimized, flexible, best-in-class, and volume-proven!

  • Depth data is measured, neither calculated nor estimated, as in 2D AI or 2D stereo camera solutions.
  • Works under all lighting conditions, from darkness to strong direct sunlight.
  • Depth data includes confidence data to guarantee data integrity.
  • Small form factor, mechanically stable solution without risk of losing calibration over lifetime.
  • Low computational load on system processor.
  • High flexibility: freely programmable modulation frequencies and operation modes, control of multiple illumination sources, and multi-camera operation.
  • Fast time-to-market and volume-proven in all markets thanks to a strong partner network spanning the entire design and production ecosystem.

How do REAL3™ ToF 3D image sensors work?

REAL3™ ToF imagers work according to the indirect Time-of-Flight (iToF) principle. The ToF camera module projects modulated infrared light onto the scene of interest. The reflected light is captured by the ToF imager, which measures the amplitude and phase difference for each pixel. This raw data is then processed by an external application processor, resulting in a highly reliable distance image, as well as a grayscale picture of the entire scene.

ToF 3D working principle infographic

Target applications of ToF 3D image sensors in consumer electronics

The powerful data provided by a Time-of-Flight camera can be used in a variety of applications and use cases:

Personal electronics

Use 3D data for secure face authentication, augmented reality, high-resolution scanning, or optimizing photography and videos (autofocus, bokeh effects).

  • Smartphones and tablets
  • AR/VR headsets and glasses
  • Other wearables

Beam projectors

  • Use 3D data for keystone correction and autofocus optimization.

Home security, payment and monitoring systems

  • Use 3D data for secure face authentication and identification, as well as room monitoring.
  • Smart door locks and access control
  • Point-of-sale (POS) terminals
  • Area surveillance
  • People counting
  • Automated doors

Target applications of ToF 3D image sensors in robotics

The powerful data provided by a Time-of-Flight camera can be used in a variety of applications and use cases:

Consumer & service robots

Use 3D data for navigation, self-localization, and mapping (SLAM), advanced obstacle avoidance, and cliff detection.

  • Robot vacuum cleaners (RVCs)
  • Lawn mowers
  • Delivery and service robots
  • Social and entertainment robots, edutainment, and robot toys

Industrial robots

Use 3D data for advanced obstacle avoidance, cliff detection, navigation, safe human-robot interaction, grabbing control, and many more use cases in factory and logistics automation.

  • Humanoid robots
  • Collaborative robots (cobots)
  • Autonomous mobile robots (AMRs) and automated guided vehicles (AGVs)
  • Automated forklifts
  • Volumetric and gauging measurement

Infineon's REAL3™ ToF imager portfolio offers a reliable solution, including an ISO 26262-compliant (ASIL B) variant that helps ensure functional safety requirements are met, even in industrial applications where humans and machines interact.

Target applications of ToF 3D image sensors in automotive

The powerful data provided by a Time-of-Flight camera can be used in a variety of applications and use cases:

In-cabin sensing: Driver- and occupant monitoring systems

With the advancement of automated driving capabilities, drivers are increasingly being relieved of regular driving tasks and almost become “passengers”. Cars turn into “living spaces” with new interior concepts for entertainment, work, and relaxation. 3D cameras based on REAL3™ ToF technology effectively support the growing demand for car comfort and convenience while delivering enhanced levels of passive safety. In addition, the need for other electronic systems, such as seat and seat belt sensors, can be reduced.

  • Comfort features enabled by REAL3™ include gesture control, secure 3D face authentication, personalized in-cabin lighting, automatic setting of preferences, optimized mirror and seat positions, dual displays with customized content, and optimized audio.
  • REAL3™ also enables enhanced occupant safety features such as driver monitoring with head-position tracking, eye-closure detection, and driver distraction detection. It also enables occupant detection and classification, child presence detection, smart airbag adaptation, out-of-position detection, rear-facing baby seat detection, object detection on seats and passengers, and fastened seat belt detection.

Seamless vehicle access with secure 3D face authentication

Secure and convenient vehicle access. Leverage advanced 3D facial authentication for keyless entry and enable the vehicle to automatically prepare personalized settings before the driver enters.

Vehicle exterior applications

To ensure safe and reliable operation, autonomous and highly automated vehicles rely on a robust sensor cocoon around them. The sensor cocoon combines technologies such as radar and lidar, enabling the vehicle to sense its environment over short and long ranges. Depending on the automated driving level (SAE Levels 1-5) and sensor placement, it may also be necessary to cover close-range blind spots near the ground. This calls for significantly higher resolution and performance than that of the ultrasonic sensors used today.

REAL3™ ToF 3D sensors enable compact, high-resolution solutions at optimized costs. They accurately sense the car's environment in 3D (horizontal and vertical) over a range of up to 10 m. The ToF sensor’s performance is unaffected by ambient light conditions, enabling reliable 3D sensing in outdoor environments. Use 3D data for advanced obstacle avoidance and situational awareness during vehicle startup.

  • Autonomous parking and driving
  • Automated doors

See our webinars about Time-of-Flight 3D sensing

In this section, you will find informative and engaging webinars about ToF sensors for consumer, robotics, and automotive applications.

From the fundamentals of ToF sensors to their practical implementation in real-world examples from partner companies, our online resources cover a wide range of topics to help you stay up to date with the latest advancements in this rapidly evolving field.

Humanoids: 2D and 3D ToF AI Fusion
Real-world examples: meerecompany's ToF camera
Smart robot interaction using ToF cameras
Two-in-One: Hybrid ToF for self-navigation and OA
In-cabin: ToF applications for the smart car
In-cabin: Coded modulation and 2D/3D camera fusion

News about REAL3™ Time-of-Flight

Using REAL3™ Time-of-Flight 3D imagers from Infineon enables machines to understand the world around them and make smart decisions. Explore the latest market news and press releases about REAL3™ Time-of-Flight technology.

ToF enables a 5-axis robot arm for cleaning robots
New automotive-grade laser driver IC
Roborock uses hybrid Time-of-Flight technology
Infineon presents hybrid Time-of-Flight (hToF)
New IRS2976C for optimal quantum efficiency & cost
World's first ISO 26262-compliant ToF 3D sensor

REAL3™ Time-of-Flight (ToF) 3D image sensors & VCSEL drivers

REAL3™ ToF imager solutions are the perfect fit for the smallest 3D vision camera modules, combining accurate depth measurement over short and long ranges with the lowest power consumption. The REAL3™ product portfolio comprises dedicated 3D single-chip image sensors with different pixel resolutions and is delivered as bare die or in an automotive-qualified BGA package. The imagers are highly configurable to meet different application requirements, such as supporting HDR modes and dual illumination (for hybrid ToF use cases). Thanks to their patented Suppression of Background Illumination (SBI) technology, they support camera deployments under all ambient light conditions. SBI and other embedded features additionally provide best-in-class robustness against multi-camera interference. Safety-critical applications are addressed by an ISO 26262-compliant (ASIL B) variant. Together with highly integrated VCSEL (Vertical-Cavity Surface-Emitting Laser) driver ICs, they form an optimized bundle for the smallest ToF camera module designs.

Driver complementary VCSEL driver ICs

How REAL3™ Time-of-Flight enables best environmental perception

Why REAL3™ Time-of-Flight from Infineon:

Robust, measured high-resolution 3D depth data under all lighting conditions. Highly optimized, flexible, best-in-class, and volume-proven!

  • Depth data is measured, neither calculated nor estimated, as in 2D AI or 2D stereo camera solutions.
  • Works under all lighting conditions, from darkness to strong direct sunlight.
  • Depth data includes confidence data to guarantee data integrity.
  • Small form factor, mechanically stable solution without risk of losing calibration over lifetime.
  • Low computational load on system processor.
  • High flexibility: freely programmable modulation frequencies and operation modes, control of multiple illumination sources, and multi-camera operation.
  • Fast time-to-market and volume-proven in all markets thanks to a strong partner network spanning the entire design and production ecosystem.

How do REAL3™ ToF 3D image sensors work?

REAL3™ ToF imagers work according to the indirect Time-of-Flight (iToF) principle. The ToF camera module projects modulated infrared light onto the scene of interest. The reflected light is captured by the ToF imager, which measures the amplitude and phase difference for each pixel. This raw data is then processed by an external application processor, resulting in a highly reliable distance image, as well as a grayscale picture of the entire scene.

ToF 3D working principle infographic

Target applications of ToF 3D image sensors in consumer electronics

The powerful data provided by a Time-of-Flight camera can be used in a variety of applications and use cases:

Personal electronics

Use 3D data for secure face authentication, augmented reality, high-resolution scanning, or optimizing photography and videos (autofocus, bokeh effects).

  • Smartphones and tablets
  • AR/VR headsets and glasses
  • Other wearables

Beam projectors

  • Use 3D data for keystone correction and autofocus optimization.

Home security, payment and monitoring systems

  • Use 3D data for secure face authentication and identification, as well as room monitoring.
  • Smart door locks and access control
  • Point-of-sale (POS) terminals
  • Area surveillance
  • People counting
  • Automated doors

Target applications of ToF 3D image sensors in robotics

The powerful data provided by a Time-of-Flight camera can be used in a variety of applications and use cases:

Consumer & service robots

Use 3D data for navigation, self-localization, and mapping (SLAM), advanced obstacle avoidance, and cliff detection.

  • Robot vacuum cleaners (RVCs)
  • Lawn mowers
  • Delivery and service robots
  • Social and entertainment robots, edutainment, and robot toys

Industrial robots

Use 3D data for advanced obstacle avoidance, cliff detection, navigation, safe human-robot interaction, grabbing control, and many more use cases in factory and logistics automation.

  • Humanoid robots
  • Collaborative robots (cobots)
  • Autonomous mobile robots (AMRs) and automated guided vehicles (AGVs)
  • Automated forklifts
  • Volumetric and gauging measurement

Infineon's REAL3™ ToF imager portfolio offers a reliable solution, including an ISO 26262-compliant (ASIL B) variant that helps ensure functional safety requirements are met, even in industrial applications where humans and machines interact.

Target applications of ToF 3D image sensors in automotive

The powerful data provided by a Time-of-Flight camera can be used in a variety of applications and use cases:

In-cabin sensing: Driver- and occupant monitoring systems

With the advancement of automated driving capabilities, drivers are increasingly being relieved of regular driving tasks and almost become “passengers”. Cars turn into “living spaces” with new interior concepts for entertainment, work, and relaxation. 3D cameras based on REAL3™ ToF technology effectively support the growing demand for car comfort and convenience while delivering enhanced levels of passive safety. In addition, the need for other electronic systems, such as seat and seat belt sensors, can be reduced.

  • Comfort features enabled by REAL3™ include gesture control, secure 3D face authentication, personalized in-cabin lighting, automatic setting of preferences, optimized mirror and seat positions, dual displays with customized content, and optimized audio.
  • REAL3™ also enables enhanced occupant safety features such as driver monitoring with head-position tracking, eye-closure detection, and driver distraction detection. It also enables occupant detection and classification, child presence detection, smart airbag adaptation, out-of-position detection, rear-facing baby seat detection, object detection on seats and passengers, and fastened seat belt detection.

Seamless vehicle access with secure 3D face authentication

Secure and convenient vehicle access. Leverage advanced 3D facial authentication for keyless entry and enable the vehicle to automatically prepare personalized settings before the driver enters.

Vehicle exterior applications

To ensure safe and reliable operation, autonomous and highly automated vehicles rely on a robust sensor cocoon around them. The sensor cocoon combines technologies such as radar and lidar, enabling the vehicle to sense its environment over short and long ranges. Depending on the automated driving level (SAE Levels 1-5) and sensor placement, it may also be necessary to cover close-range blind spots near the ground. This calls for significantly higher resolution and performance than that of the ultrasonic sensors used today.

REAL3™ ToF 3D sensors enable compact, high-resolution solutions at optimized costs. They accurately sense the car's environment in 3D (horizontal and vertical) over a range of up to 10 m. The ToF sensor’s performance is unaffected by ambient light conditions, enabling reliable 3D sensing in outdoor environments. Use 3D data for advanced obstacle avoidance and situational awareness during vehicle startup.

  • Autonomous parking and driving
  • Automated doors

See our webinars about Time-of-Flight 3D sensing

In this section, you will find informative and engaging webinars about ToF sensors for consumer, robotics, and automotive applications.

From the fundamentals of ToF sensors to their practical implementation in real-world examples from partner companies, our online resources cover a wide range of topics to help you stay up to date with the latest advancements in this rapidly evolving field.

Humanoids: 2D and 3D ToF AI Fusion
Real-world examples: meerecompany's ToF camera
Smart robot interaction using ToF cameras
Two-in-One: Hybrid ToF for self-navigation and OA
In-cabin: ToF applications for the smart car
In-cabin: Coded modulation and 2D/3D camera fusion

News about REAL3™ Time-of-Flight

Using REAL3™ Time-of-Flight 3D imagers from Infineon enables machines to understand the world around them and make smart decisions. Explore the latest market news and press releases about REAL3™ Time-of-Flight technology.

ToF enables a 5-axis robot arm for cleaning robots
New automotive-grade laser driver IC
Roborock uses hybrid Time-of-Flight technology
Infineon presents hybrid Time-of-Flight (hToF)
New IRS2976C for optimal quantum efficiency & cost
World's first ISO 26262-compliant ToF 3D sensor
Documents

Design resources

Developer community