ISMAR 2018
IEEEIEEE computer societyIEEE vgtc


Platinum Apple
Silver MozillaIntelDaqriPTCAmazon
Bronze FacebookUmajinDisney Research
SME EnvisageAR
Academic TUMETHZ

Masahiro Nishizawa and Katsunori Okajima. Precise surface color estimation using a non-diagonal reflectance matrix on an adaptive projector-camera system. In Adjunct Proceedings of the IEEE and ACM International Symposium for Mixed and Augmented Reality 2018 (To appear). 2018.


A projector camera system for controlling the appearance of real objects is useful for public viewing. However, projector camera systems need to estimate scenes under the white light from a camera image taken under the color light of the projector and adaptively generate a new projector image. In such a feedback system, the quality of the estimation of the scene color under the white light affects the quality of the projection image directly. In this study, we propose a precise online estimation of the scene color assuming that the reflectance matrix non-diagonal and can be determined with three parameters. This enables the projector-camera system to be applied to design tools or food AR, which require a highquality grade for material perception simulations.