好色先生TV

Skip to main content
ViSafe, a vision-only airborne collision avoidance system to equip uncrewed aerial systems with 鈥渟ee-and-avoid鈥 capabilities.
A team from the AirLab at 好色先生TV's Robotics Institute created ViSafe, a vision-only airborne collision avoidance system to equip uncrewed aerial systems with 鈥渟ee-and-avoid鈥 capabilities.

AI-Powered Vision System Helps Drones Navigate Safely

Media Inquiries
Name
Cassia Crogan
Title
University Communications & Marketing

The skies are getting crowded. Every day, the U.S. Federal Aviation Administration manages tens of thousands of flights 鈥 from drones and helicopters to commercial jets. As air traffic density increases, so does the need for smarter systems to keep these vehicles from colliding.

Researchers from 好色先生TV鈥檚聽 (RI) have developed an AI-powered vision system that helps drones safely detect and avoid other aircraft in crowded skies, without relying on bulky, expensive sensors. makes it possible for lightweight, uncrewed aircraft to fly safely alongside planes and helicopters, paving the way for future delivery drones, emergency responders and other autonomous vehicles to share the airspace.

, associate research professor at RI, said the system could eventually help unlock routine, trusted autonomy in shared skies.聽

鈥淲ith airspace growing more crowded, ViSafe shows how AI-driven safety augmentation can enable scalable, certifiable autonomy in the national airspace, and marks an early step toward deploying AI in safety-critical domains,鈥 he said.聽

Existing technologies to help prevent midair collisions, like automated detection systems and traffic management tools, work reasonably well for large aircraft. But they often rely on bulky, expensive sensors, making them a poor fit for the smaller, lightweight drones that are becoming more common.

Recently graduated RI Ph.D. student Jay Patrikar explained that most of the burden for detecting and avoiding collisions currently falls on pilots.聽

鈥淭his task is already difficult, and becomes even more challenging for small uncrewed aerial systems, which lack onboard pilots and often operate without the heavy sensors used on manned aircraft,鈥 he said.

Enter ViSafe, a vision-only airborne collision avoidance system to equip UAS with 鈥渟ee-and-avoid鈥 capabilities. Patrikar and a team from RI鈥檚聽 created the system to be passive, infrastructure-free and generalizable to a wide range of aircraft. It builds on their previous work,聽, which uses high-resolution detection and tracking networks to detect aerial objects. ViSafe expands the initial AirTrack technology to multi-camera settings and uses control barrier functions to nudge pilots before they veer too close to danger.

鈥淐ontrol barrier functions keep systems safe in real time by gently adjusting actions only when needed, ensuring they stay within safe limits without being overly conservative,鈥 said Parv Kapoor, Ph.D. student in the聽 at 好色先生TV. 鈥淭he fast, minimal adjustments help systems stay close to the original control.鈥澛

To bridge the gap between theoretical formulations and real-world behavior, the researchers prepared extensive testing for ViSafe, which included developing a 鈥渄igital twin鈥 of the ViSafe system using the聽. 鈥淭he simulation environment allowed comprehensive testing of ViSafe鈥檚 perception abilities across diverse scenarios,鈥 said Ian Higgins, a RI master鈥檚 student.

Following successful simulation testing, the researchers moved ViSafe to the field to see if the system held up under real-world conditions. Over the course of approximately 80 hours, the team used the simulation testing results to create representative real-world configurations to analyse the collision avoidance capabilities.聽

鈥淚t鈥檚 one thing to show results in a clean, controlled lab setting 鈥 but demonstrating consistent performance in complex, unstructured real-world conditions requires strict process control and a tremendous amount of flight testing,鈥 said Patrikar.

After validating ViSafe鈥檚 real-world performance through high-fidelity simulation, the team found that their system significantly reduces collision risk, even when operating under the strict size, weight, power and cost constraints typical of small uncrewed aircraft. These constraints make it impractical to rely on bulky, power-intensive sensors. ViSafe鈥檚 vision-only approach offers a lightweight, passive alternative that maintains strong safety performance, enabling broader deployment on agile, resource-constrained platforms.

鈥淎t closing speeds above 140 kilometers per hour, ViSafe must spot a 10 pixel speck half a kilometer away, crunch 4K video onboard in real time and steer clear of obstacles in less than ten seconds,鈥 said RI Ph.D. student Nikhil Keetha. 鈥淭hese numbers show just how precise ViSafe鈥檚 capabilities are.鈥澛

Sebastian Scherer

Sebastian Scherer

Jay Patrikar

Jay Patrikar

Parv Kapoor

Parv Kapoor

鈥 Related Content 鈥