Creating and sharing knowledge for telecommunications

Project: Light Field Processing and Encoding System

Acronym: LIFESYS
Main Objective:
LIFESYS focus on three main scientific and technological developments: (i) novel light field content processing tools; (ii) improved scalable light field image and video coding techniques; and (iii) light field creative content generation. In this context, three main research objectives have been defined:

Development of a Light Field Processing Toolbox – The light field representation format should allow a scalable representation of the content, in a manner where the various layers are defined by the author during the creative process, instead of making it a pure coding decision. For this, efficient depth-estimation and LF depth-based rendering tools will be developed, as well as LF processing tools, such as image correction, filtering and editing tools.

Development of Efficient Codecs for Light Field Content – In order to enable 3D LF content to be presented on various types of displays, such as legacy displays and also newer 3D LF displays, with different characteristics in terms of spatial and view resolutions, an efficient scalable codec will be developed. New coding approaches, beyond state-of-the-art and standard-based approaches will be investigated aiming to support new scalability features opened by LF content.

Development of a Light Field Authoring Application – In order to demonstrate the capabilities for the end-user and content creators of the LF technology, a showcase application will be developed that includes creative authoring tools to be used with LF content.
Reference: UID/EEA/50008
Funding: FCT
Start Date: 01-06-2016
End Date: 01-05-2018
Team: Paulo Jorge Lourenço Nunes, Luís Eduardo de Pinho Ducla Soares, Nuno Miguel Morais Rodrigues, Sérgio Manuel Maciel de Faria, Caroline Conti, Ricardo Jorge Santos Monteiro
Groups: Multimedia Signal Processing – Lx, Multimedia Signal Processing – Lr
Local Coordinator: Paulo Jorge Lourenço Nunes
Associated Publications