论文标题
机器的视频编码:筛分功能的部分传输
Video Coding for Machines: Partial transmission of SIFT features
论文作者
论文摘要
该论文介绍了与人类和机器对解码视频的消费有关的视频编码的新范式的视频编码。对于此类任务,考虑了压缩视频和功能的联合传输。在本文中,我们将对功能的考虑重点放在筛分关键上。与从原始视频中提取的SIFT关键点相比,可以从解码的视频中提取它们的关键点及其参数的损失。研究了HEVC和VVC作为量化参数和比特率的功能的此类损失。在论文中,我们建议将残留特征数据与压缩视频一起传输。因此,即使对于强烈压缩的视频,也避免了整个筛分关键信息的传输。
The paper deals with Video Coding for Machines that is a new paradigm in video coding related to consumption of decoded video by humans and machines. For such tasks, joint transmission of compressed video and features is considered. In this paper, we focus our considerations of features on SIFT keypoints. They can be extracted from the decoded video with losses in number of keypoints and their parameters as compared to the SIFT keypoints extracted from the original video. Such losses are studied for HEVC and VVC as functions of the quantization parameter and the bitrate. In the paper, we propose to transmit the residual feature data together with the compressed video. Therefore, even for strongly compressed video, the transmission of whole all SIFT keypoint information is avoided.