#multi-modality repositories

Parsing-free RAG supported by VLMs

Official code for NeurIPS2023 paper: CoDA: Collaborative Novel Box Discovery and Cross-modal Alignment for Open-vocabulary 3D Object Detection

Long-RL: Scaling RL to Long Sequences (NeurIPS 2025)

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

MGM-Omni: Scaling Omni LLMs to Personalized Long-Horizon Speech

Official repository for VisionZip (CVPR 2025)

Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing images as inpu...

[ICML2023] Long-Term Rhythmic Video Soundtracker

Unifying Voxel-based Representation with Transformer for 3D Object Detection (NeurIPS 2022)

[CVPR 2024] Prompt Highlighter: Interactive Control for Multi-Modal LLMs