AGILE3D: New System Helps Cars Detect Objects Better on Less Powerful Chips

This new AGILE3D system can make object detection 3-7% more accurate on weaker computer chips, which is a big step for self-driving cars and drones.
By Newsroom | Technology, Automotive |

A new framework, dubbed AGILE3D, offers a different approach to 3D object detection, aiming to make sense of complex data on less powerful, embedded computing hardware. Developed by researchers including Pengcheng Wang, Zhuoming Liu, Saurabh Bagchi, and Somali Chaterji, the system is designed to adapt its performance based on the data it's processing and the available hardware resources.

AGILE3D's core innovation lies in its ability to dynamically adjust its detection process. This means it can maintain a more consistent level of accuracy even when faced with varying amounts of data or when the computing hardware is under strain.

Balancing Act on Embedded GPUs

The system, presented at the 'ACM International Conference on Mobile Systems, Applications, and Services (MobiSys 2025)', is built around a "multi-branch execution framework" with five adaptable control points. This allows it to shift its focus and processing power as needed.

Read More: Tiny laser chip from Chalmers University promises home health tests

  • A key component is the "Contention- and Content-Aware RL-based (CARL) Controller." This uses reinforcement learning to learn how best to adapt, avoiding the need for manual tuning of rewards.

  • Tests on datasets like Waymo, nuScenes, and KITTI, run on NVIDIA Jetson embedded GPUs, show AGILE3D can achieve improvements in accuracy by 3-7% across different operating speeds.

  • It also demonstrates strong performance within latency budgets ranging from 100 to 500 milliseconds, a critical factor for real-time applications.

  • The framework has reportedly led the "Pareto frontier" – meaning it offers a superior balance of speed and accuracy – on NVIDIA Orin and Xavier GPUs.

Real-World Implications

The developers highlight the system's potential for various applications that rely on precise, real-time 3D understanding.

  • This includes 'autonomous vehicle perception', where accurate object detection is paramount for navigation and safety.

  • It's also seen as relevant for 'drone navigation systems', 'augmented reality (AR)', and 'virtual reality (VR)' environments.

  • The technology is positioned as 'energy-efficient and cost-effective', a significant consideration for devices with limited power and computational capacity.

Background: The Challenge of Data and Hardware

Processing vast amounts of data, especially from sensors like LiDAR used in 3D object detection, requires significant computing power. Traditionally, this has meant relying on powerful, often costly, desktop or server-grade hardware. However, the push for more mobile and integrated 'autonomous systems' necessitates solutions that can operate effectively on embedded GPUs. These GPUs, found in everything from self-driving cars to drones, have more constrained resources.

Existing methods often struggle when faced with fluctuating data loads or limited processing bandwidth. This can lead to either reduced accuracy or unacceptable delays. AGILE3D's adaptive nature directly addresses this gap, proposing a system that can flexibly manage its own performance to meet the demands of both the input data and the hardware it runs on. The research team has made the system available under a 'CC BY-NC-ND 4.0 license'.

Read More: Hyundai Builds Own AI While Car Software Fails Drivers in 2024

Frequently Asked Questions

Q: What is the new AGILE3D system and how does it help cars?
AGILE3D is a new system that helps computers on less powerful chips, like those in cars and drones, to detect 3D objects better. It changes how it works based on the data it sees and the chip's power to keep accuracy high.
Q: How does AGILE3D make object detection better on weaker computer chips?
AGILE3D uses a smart controller that learns how to best use the available power. This means it can be 3-7% more accurate than older systems when running on chips like NVIDIA Jetson, Orin, and Xavier GPUs.
Q: Why is AGILE3D important for self-driving cars and drones?
Self-driving cars and drones need to see objects very quickly and accurately to be safe. AGILE3D helps them do this even with smaller, less powerful computers, making these systems cheaper and more reliable for real-time use.
Q: Can AGILE3D work in different conditions with varying data?
Yes, AGILE3D is designed to adapt to different amounts of data and changing computer power. It can maintain good accuracy and speed, working well within time limits of 100 to 500 milliseconds.
Q: Where was the AGILE3D system presented and who made it?
The AGILE3D system was presented at the ACM International Conference on Mobile Systems, Applications, and Services (MobiSys 2025). It was developed by researchers including Pengcheng Wang, Zhuoming Liu, Saurabh Bagchi, and Somali Chaterji.