Real-time and accurate open-vocabulary end-to-end object detection

Official PyTorch implementation of ODISE: Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Models [CVPR 2023 Highlight]

(TPAMI 2024) A Survey on Open Vocabulary Learning

An open, modular framework for zero-shot, language conditioned pick-and-drop tasks in arbitrary homes.

CLIP Surgery for Better Explainability with Enhancement in Open-Vocabulary Tasks

A curated list of papers, datasets and resources pertaining to open vocabulary object detection.

(CVPR 2023) PLA: Language-Driven Open-Vocabulary 3D Scene Understanding & (CVPR2024) RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understanding

[RSS2024] Official implementation of "Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigation"

Official code for NeurIPS2023 paper: CoDA: Collaborative Novel Box Discovery and Cross-modal Alignment for Open-vocabulary 3D Object Detection

[ICLR 2023] PyTorch implementation of VLDet （https://arxiv.org/abs/2211.14843）

[CVPR2023] Code Release of Aligning Bag of Regions for Open-Vocabulary Object Detection

[ICLR2024 Spotlight] Code Release of CLIPSelf: Vision Transformer Distills Itself for Open-Vocabulary Dense Prediction

Combining OwlViT with Segment Anything - Open-vocabulary Detection and Segmentation (Text-conditioned, and Image-conditioned)

[CVPR2024] Generative Region-Language Pretraining for Open-Ended Object Detection

Official implementation of "Open-Vocabulary Multi-Label Classification via Multi-Modal Knowledge Transfer".

Recognize Any Regions

Awesome OVD-OVS - A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Future

[IJCV 2024] MosaicFusion: Diffusion Models as Data Augmenters for Large Vocabulary Instance Segmentation

(NeurIPS2023) CoDet: Co-Occurrence Guided Region-Word Alignment for Open-Vocabulary Object Detection