H.266中的FRUC模式

目前的H.266引入两个新的帧间预测模式,一个是有华为提出的AFFINE模式,另一个是有高通提出的FRUC(Frame rate up conversion)模式,本文主要介绍FRUC模式,以后会介绍AFFINE模式,FRUC大约给H.266带来了5%左右的性能(CTC下),FRUC模式包含两个解码端导出运动信息的技术,一个叫TM(template matching),另一个叫BM(Bilateral matching),编码端无需传输任何运动信息,解码端根据某种运算可以自己导出MV等信息.

TM技术在CU级和sub-CU级均采用,如下图

块的上方和左方的重建像素将构成L型模板,模板之间的SAD失真将作为搜索MV的准则,当前块的模板将在参考帧进行search,得到的distortion最小的模板,这两个模板之间的位移即为当前块的MV,但是在H.266并不是在参考帧中盲目搜索,而是根据周围已编码的块获取相应的初始运动信息,并继承初始运动信息的参考索引,编码器仅需在参考索引指向的参考帧搜索即可,CU级和Sub-CU级均使用,具体过程如下图。

技术文档中描述如下:

 template matching is used to derive motioninformation of the current CU by finding the closest match between a template(top and/or left neighbouring blocks of the current CU) in the current pictureand a block (same size to the template) in a reference picture. Except the aforementionedFRUC merge mode, the template matching is also applied to AMVP mode. In the JEM,as done in HEVC, AMVP has two candidates. With template matching method, a newcandidate is derived. If the newly derived candidate by template matching isdifferent to the first existing AMVP candidate, it is inserted at the verybeginning of the AMVP candidate list and then the list size is set to two(meaning remove the second existing AMVP candidate). When applied to AMVP mode,only CU level search is applied.


BM技术在CU级和sub-CU级均采用,如下图

编码器可根据周围已编码的块为当前块得到一个初始的运动信息,假如是MV0,然后将MV0反向延长,可以在List1中找到pred1(对应图中的MV1),计算Pred1和pred0之间的distortion,并在此MV周围进行局部的search,搜索到最小的distortion对应的运动信息即为当前块的运动信息,此模式仅仅在B帧使用。

技术文档描述如下:

the bilateralmatching is used to derive motion information of the current CU by finding the closestmatch between two blocks along the motion trajectory of the current CU in two differentreference pictures. Under the assumption of continuous motion trajectory, themotion vectors MV0 and MV1 pointing to the two reference blocks shall beproportional to the temporal distances, i.e., TD0 and TD1, between the currentpicture and the two reference pictures. As a special case, when the currentpicture is temporally between the two reference pictures and the temporaldistance from the current picture to the two reference pictures is the same,the bilateral matching becomes mirror based bi-directional MV.

这两种技术都涉及到初始MV的确定的相关技术,可参考代码或者技术提案。在此仅仅给出MV candidates包含哪些。

CU级:

(i)   Original AMVP candidates if the current CU is in AMVPmode

(ii)  all merge candidates,

(iii)several MVs in the interpolated MV field

(iv) top and left neighbouring motion vectors

sub-CU级:

(i)    an MV determined from a CU-level search,

(ii)  top, left, top-left and top-right neighbouring MVs,

(iii)scaled versions of collocated MVs from referencepictures,

(iv) up to 4 ATMVP candidates,

(v)   up to 4 STMVP candidates

猜你喜欢

转载自blog.csdn.net/double_s_c/article/details/76148612