论文标题

vid2player:可控的视频精灵,表现得像专业网球运动员

Vid2Player: Controllable Video Sprites that Behave and Appear like Professional Tennis Players

论文作者

Zhang, Haotian, Sciutto, Cristobal, Agrawala, Maneesh, Fatahalian, Kayvon

论文摘要

我们提出了一个系统,该系统将网球比赛的带注释的广播视频转换为可交互控制的视频精灵,表现得像专业的网球运动员。我们的方法基于可控的视频纹理,并利用网球集会的循环结构的领域知识来放置剪辑过渡并在关键的决策时刻播放的关键决策时刻接受控制输入。最重要的是,我们使用视频集中的点来对球员的法院定位和射击选择决策进行建模。我们使用这些行为模型来选择反映现实生活中玩家可能会在给定的比赛情况下采取的动作的视频剪辑,从而产生精灵,这些精灵在整个点的宏观级别上实现,而不仅仅是单个网球运动。我们的系统可以在类似温布尔登广播的专业网球运动员之间产生新的观点,从而实现了新的体验,例如在现实生活中没有竞争的球员之间创建对决,或在温网决赛中对球员的互动控制。根据专家网球运动员的说法,使用我们的方法产生的集会在玩家行为方面比仅考虑视频综合过程中运动过渡质量的视频精灵方法更为现实。

We present a system that converts annotated broadcast video of tennis matches into interactively controllable video sprites that behave and appear like professional tennis players. Our approach is based on controllable video textures, and utilizes domain knowledge of the cyclic structure of tennis rallies to place clip transitions and accept control inputs at key decision-making moments of point play. Most importantly, we use points from the video collection to model a player's court positioning and shot selection decisions during points. We use these behavioral models to select video clips that reflect actions the real-life player is likely to take in a given match play situation, yielding sprites that behave realistically at the macro level of full points, not just individual tennis motions. Our system can generate novel points between professional tennis players that resemble Wimbledon broadcasts, enabling new experiences such as the creation of matchups between players that have not competed in real life, or interactive control of players in the Wimbledon final. According to expert tennis players, the rallies generated using our approach are significantly more realistic in terms of player behavior than video sprite methods that only consider the quality of motion transitions during video synthesis.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源