CoDA_NeurIPS2023

:book: CoDA: Collaborative Novel Box Discovery and Cross-modal Alignment for Open-vocabulary 3D Object Detection (NeurIPS2023)

🔥Please star CoDA ⭐ and share it. Thanks🔥

[Paper]   [Project Page]

Yang Cao, Yihan Zeng, Hang Xu, Dan Xu

The Hong Kong University of Science and Technology

Huawei Noah's Ark Lab

:triangular_flag_on_post: Updates

☑ Our new work CoDAv2 is accepted by TPAMI, check out it here !

☑ As the first work to introduce 3D Gaussian Splatting into 3D Object Detection, 3DGS-DET is released here !

☑ Latest papers&codes about open-vocabulary perception are collected here.

☑ All the codes, data and pretrained models have been released!

☑ The training and testing codes have been released.

☑ The pretrained models have been released.

☑ The OV-setting SUN-RGBD datasets have been released.

☑ The OV-setting ScanNet datasets have been released.

☑ Paper LaTeX codes are available at https://scienhub.com/Yang/CoDA.

Framework

Samples

Installation

Our code is based on PyTorch 1.8.1, torchvision==0.9.1, CUDA 10.1 and Python 3.7. It may work with other versions.

Please also install the following Python dependencies:

matplotlib
opencv-python
plyfile
'trimesh>=2.35.39,=2.2,