Pinned Loading

1. OmniAgent OmniAgent Public

   OmniAgent (ICML 2026): the first native omni-modal agent for active video perception — a 7B agent that beats Qwen2.5-VL-72B with 73% fewer frames on LVBench.

   Python 71 6

2. Qwen3-Omni Qwen3-Omni Public

   Forked from QwenLM/Qwen3-Omni

   Qwen3-omni is a natively end-to-end, omni-modal LLM developed by the Qwen team at Alibaba Cloud, capable of understanding text, audio, images, and video, as well as generating speech in real time.

   Jupyter Notebook

3. EchoInk EchoInk Public

   EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning (🔥The Exploration of R1 for General Audio-Visual Reasoning with Qwen2.5-Omni)

   Python 80 6

4. EchoTraffic EchoTraffic Public

   EchoTraffic: Enhancing Traffic Anomaly Understanding with Audio-Visual Insights (CVPR 2025)

   Python 14 1

5. xw-hu/Unveiling-Deep-Shadows xw-hu/Unveiling-Deep-Shadows Public

   A Survey and Benchmark on Image and Video Shadow Detection, Removal, and Generation in the Era of Deep Learning (Awesome & Benchmark)

   Python 109 4

6. Video-Instance-Shadow-Detection Video-Instance-Shadow-Detection Public

   Video Instance Shadow Detection Under the Sun and Sky (IEEE TIP 2024)

   Python 10 1