Open-Vocabulary Video Visual Relationship Detection

πŸŽ₯ Demo

This demo showcases our end to end model across various open-vocabulary scenarios.


πŸ“’ News

Nov 2025 We introduced VaM-VidVRD, the first multi-modal benchmark for Open-vocabulary Video Visual Relationship Detection featuring synchronized audio, text, and 3D data, in our paper "Multi-modal Open-vocabulary Video Visual Relationship Detection".
Apr 2025 Our paper "METOR: A Unified Framework for Mutual Enhancement of Objects and Relationships in Open-vocabulary Video Visual Relationship Detection" was accepted by IJCAI 2025.
Apr 2025 Our paper "End-to-end Open-vocabulary Video Visual Relationship Detection using Multi-modal Prompting" was accepted by IEEE TPAMI.
Dec 2023 Our paper "Multi-Modal Prompting for Open-Vocabulary Video Visual Relationship Detection" was accepted by AAAI 2024.

πŸ“š Publications

Multi-modal Open-vocabulary Video Visual Relationship Detection (Under Review)

End-to-end open-vocabulary video visual relationship detection using multi-modal prompting (TPAMI 2025)

METOR: A Unified Framework for Mutual Enhancement of Objects and Relationships (IJCAI 2025)

Multi-modal Prompting for Open-vocabulary Video Visual Relationship Detection (AAAI 2024)