Error Concealment of Video Realistic Avatar for Virtual Conferencing System

Abstract

Avatars are usually employed in virtual conferencing system as user’s agent in a 3-D virtual space. In previous research, system architecture is established by integrating a 3-D model-based coder and a 2-D video coder under very low bit-rate video coding. It makes the avatar have more realistic expressions. In this paper, we develop a new error concealment scheme for the 2-D video coder as the enhancement layer, which is expected to be more suitable in the virtual conferencing system. A VQ-like algorithm is proposed to cluster the FAPs and its partial texture differences of each ROI according to the minimum quantization error. With the codevectors of each cluster, we can predict the partial texture difference by the nearest one to the received FAPs and generate a texture map. With the proposed scheme, we can alleviate the defect caused by the loss of the enhancement layer and reconstruct a vivid 3D virtual facial model while inefficient bandwidth is available.