HilDA: Hierarchical Distillation with Diffusion for Advancing Self-Supervised LiDAR Pre-trainin
HilDA introduces a self-supervised pretraining framework for LiDAR systems in autonomous driving by combining hierarchical knowledge distillation from Vision Foundation Models with diffusion-based temporal consistency. The approach achieves state-of-the-art results on cross-modal distillation benchmarks and improves performance across 3D object detection, scene flow, and semantic occupancy prediction tasks.