Multi-generator adversarial networks for light field saliency detection

Publication date

2021

Authors

Cai, Hongyan
Zhang , Xudong
Poppe, R.W.ISNI 0000000389426288
Sun, Rui
Zhang, Jun

Editors

Advisors

Supervisors

Document Type

Part of book
Open Access logo

License

taverne

Abstract

Compared to traditional cameras, light field imaging can additionally record the direction of incoming light. Based on this, light fields can be represented in focus stacks that focus at different depths and all-in-focus images. The refocusing information of focal stacks can provide supplementary information for saliency detection. In this paper, we propose a novel multi-generator adversarial network for saliency detection that consists of a cascaded multi-generator and a discriminator. The multi-generator extract saliency features from all-in-focus images and focal stacks. Besides, we set the predicted map multiplied by the all-in-focus image as the input of the discriminator. With this multiplication, we can preserve color and texture information of the salient objects, and reduce the computational cost. We conduct experiments on three public datasets. Compared with existing methods, our method achieves competitive results.

Keywords

light field, saliency detection, multi-generator adversarial network, focal stack, Taverne

Citation

Cai, H, Zhang , X, Poppe, R, Sun, R & Zhang, J 2021, Multi-generator adversarial networks for light field saliency detection. in Proceedings of the IEEE International Conference on Multimedia & Expo Workshops (ICMEW). IEEE, pp. 1-6. https://doi.org/10.1109/icmew53276.2021.9456017