Video Grounding
The agent narrows long videos to relevant segments and locks key frames before searching for external evidence.
Technical Report
* Equal Contribution, † Project Lead, ✉ Corresponding Author
1East China Normal University, 2Tencent Youtu Lab, 3University of Science and Technology of China, 4Wuhan University, 5Xiamen University, 6The Hong Kong University of Science and Technology
VideoSearcher studies Video Deep Research, where an agent must localize visual evidence in videos, invoke external search tools, and synthesize answers through a single coherent reasoning trajectory.
Video understanding is moving beyond closed-context perception toward open-world evidence exploration, a paradigm formalized as Video Deep Research (VDR). Existing multimodal search agents primarily target static images, and current VDR benchmarks rely on text-centric retrieval that discards crucial visual information. We propose VideoSearcher, a closed-loop agentic framework that empowers Vision-Language Models with multi-tool reasoning for VDR. VideoSearcher unifies temporal localization, spatial focusing, and multimodal search within a single reasoning trajectory, enabling agents to progressively ground visual clues, retrieve relevant evidence, and synthesize answers.
To optimize knowledge-intensive reasoning trajectories, we introduce Bi-branch Sequence Policy Optimization (BiSPO), which decouples tool-invocation optimization from answer-accuracy optimization. We further construct VideoSearch-QA, a benchmark for open-world video information grounding and multimodal search-based reasoning. Experiments show that VideoSearcher substantially improves over prior open-source agentic baselines across search-oriented and multimodal understanding benchmarks.
The agent narrows long videos to relevant segments and locks key frames before searching for external evidence.
Image search and web search connect localized visual clues with open-world knowledge.
Answer correctness and tool-use behavior are optimized through separated reward branches.
Qualitative examples illustrate how VideoSearcher builds a trajectory from video localization to visual entity search, evidence retrieval, and final answer synthesis.
@article{gao2026videosearcher,
title = {VideoSearcher: Empowering Video Deep Research with Multi-Tool Agentic Reasoning via Reinforcement Learning},
author = {Gao, Zhenkun and Bao, Yicheng and Peng, Jinlong and Li, Xueheng and Huang, Suyuan and Liu, Bangwei and Li, Kunquan and Gan, Zhenye and Hu, Tao and Xie, Chengjun and He, Xuanhua and Zhang, Zhizhong and Tan, Xin and Wang, Chengjie and Xie, Yuan},
journal = {Technical Report},
year = {2026}
}