Awesome-3D-Instance-Segmentation

🏠 About

Papers and codes for 3D Instance Segmentation for Indoor Scenes. 😎

This is an active repository, you can watch for following the latest advances. If you find it useful, please kindly star this repo.

Closed-Vocabulary 3D Segmentation

ID	keywords	Institute (first)	Paper	Publication	Others
2022-10-06	Mask3D	RWTH	Mask3d: Mask transformer for 3d semantic instance segmentation	ICRA2023	github
2023-03-01	ISBNet	VinAI	ISBNet: a 3D Point Cloud Instance Segmentation Network with Instance-aware Sampling and Box-aware Dynamic Convolution	CVPR2023	github

Open-Vocabulary 3D Segmentation

ID	keywords	Institute (first)	Paper	Publication	Others
2022-11-28	OpenScene	ETHz	OpenScene: 3D Scene Understanding with Open Vocabularies	CVPR2023	github
2022-11-29	PLA	HKU	PLA: Language-Driven Open-Vocabulary 3D Scene Understanding	CVPR2023	github
2023-05-01	3D-OVS	NTU	Weakly Supervised 3D Open-vocabulary Segmentation	NeurIPS2023	github
2023-05-01	OV3D	KAIST	Open-Vocabulary 3D Semantic Segmentation with Foundation Models	Arxiv	project
2023-9-1	OpenIns3D	Cambridge	OpenIns3D: Snap and Lookup for 3D Open-vocabulary Instance Segmentation	Arxiv	github
2023-10-29	OpenMask3D	ETH	OpenMask3D: Open-Vocabulary 3D Instance Segmentation	NeurIPS2023	github
2023-11-6	OVIR-3D	Rutgers University	OVIR-3D: Open-Vocabulary 3D Instance Retrieval Without Training on 3D Data	CoRL2023	github
2023-11-18	LEGaussians	Beihang University	LEGaussians: Language Embedded 3D Gaussians for Open-Vocabulary Scene Understanding	CVPR2024	github
2023-12-11	SAI3D	PKU	SAI3D: Segment Any Instance in 3D Scenes	CVPR2024	github
2023-12-18	Open3DIS	VinAI	Open3DIS: Open-vocabulary 3D Instance Segmentation with 2D Mask Guidance	CVPR2024	github
2024-01-01	MaskClustering	PKU	MaskClustering: View Consensus based Mask Graph Clustering for Open-Vocabulary 3D Instance Segmentation	CVPR2024	github
2024-02-23	OpenSUN3D	ETH Z	OpenSUN3D: 1st Workshop Challenge on Open-Vocabulary 3D Scene Understanding	Arxiv	github
2024-06-01	Open-YOLO 3D	MBZUAI	Open-YOLO 3D: Towards Fast and Accurate Open-Vocabulary 3D Instance Segmentation	Arxiv	github
2024-08-16	Dual-Path	KAIST	Zero-Shot Dual-Path Integration Framework for Open-Vocabulary 3D Instance Segmentation	Arxiv	project

3D Benchmarks

Date	keywords	Institute	Paper	Publication	Others
2017-01-14	ScanNet	Stanford University	ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes	CVPR2017	github
2017-09-18	Matterport3D	Princeton University	Matterport3D: Learning from RGB-D Data in Indoor Environments	3DV	github
2019-01-13	Replica	Facebook	The Replica dataset: A digital replica of indoor spaces	Arxiv	github
2021-11-07	ARKitScenes	Apple	ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Data	Arxiv	github
2021-09-28	KITTI-360	Zhejiang University	KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3D	PAMI2021	project
2021-11-07	ScanNet++	TUM	ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenes	CVPR2023	github

Contributing

your contributions are always welcome!

I will keep some pull requests open if I'm not sure if they are awesome for 3D Instance Segmentation, you could vote for them by adding 👍 to them.