SkySentry ADS is a computer vision pipeline engineered for the real-time detection, classification, and tracking of small-profile aerial targets. The system is optimized for high-clutter environments where traditional video inference models may struggle.
The pipeline utilizes a YOLOv11-based architecture fine-tuned on a dataset of avian profiles to minimize false-positive triggers.
To maintain high precision in long-range detection, the system implements Slicing Aided Hyper Inference (SAHI). This allows for the detection of "small" objects by partitioning the input frame
The detection accuracy is evaluated via the Intersection over Union (IoU) metric,
where
| Metric | Target Specification | Implementation Logic |
|---|---|---|
| Detection Horizon | Small-profile targets ( |
Slicing Aided Hyper Inference (SAHI): Divides 1080p/4K streams into overlapping |
| Inference Latency |
|
Quantized YOLOv11n: Optimized for edge deployment (MPS/CUDA). |
| Compute Efficiency | Dynamic Load Balancing |
Motion-Vector Culling: Pre-processing step (cv2.absdiff) discards static sky/terrain tiles before GPU inference, reducing load by ~60% in stable environments. |
| Precision ( |
High-Recall Optimization | Non-Maximum Suppression (NMS): Custom intersection logic merges overlapping tile detections to prevent double-counting. |
-
Motion-Adaptive Inference: Implements a pre-processing motion vector check (cv2.absdiff) to cull static tiles (e.g., blue sky) prior to inference, significantly reducing GPU load on high-resolution streams.
-
Automatic Range Profiling: run-time configuration manager (RangeProfileManager) that adjusts confidence thresholds (
$0.05 - 0.95$ ) and SAHI tiling strategies based on target distance and environmental clutter. -
Hybrid Inference Modes: Supports automated switching between standard YOLOv11 full-frame inference (for close-range/large targets) and Batched SAHI (for long-range/small-profile targets) to optimize the latency-accuracy trade-off.
-
Edge-Compute Optimization: Pipeline architecture designed for low-SWaP (Size, Weight, and Power) deployment, utilizing batch processing to maximize throughput on MPS (Apple Silicon) and CUDA backends.
The full source code for SkySentry ADS is currently kept in a private repository for security and research integrity.