Skin color correction via convolutional neural networks in 3D fringe projection profilometry

Abstract

Fringe Projection Profilometry (FPP) with Digital Light Projector technology is one of the most reliable 3D sensing techniques for biomedical applications. However, besides the fringe pattern images,often a color texture image is needed for an accurate medical documentation. This image may be acquired either by projecting a white image or a black image and relying on ambient light. Color Constancy is essential for a faithful digital record, although the optical properties of biological tissue make color reproducibility challenging. Furthermore, color perception is highly dependent on the illuminant. Here, we describe a deep learning-based method for skin color correction in FPP. We trained a convolutional neural network using a skin tone color palette acquired under different illumination conditions to learn the mapping relationship between the input color image and its counterpart in the sRGB color space. Preliminary experimental results demonstrate the potential for this approach.