The goal of this research was to develop a technology to easily generate a digital 3D copy of a real-world object by acquiring both the 3D shape and reflectances of a real-world object as digital data using a camera. Through this research, the technology for simultaneous estimation of 3D shape and reflectance was developed, and digital 3D digitization technology was advanced. While the conventional photographic equipment for 3D digitization is large in scale, this research has also progressed on how to realize it in a compact manner. These results were widely disseminated at international conferences and in international journals.

Grant

• 2019/4 – 2024/3 JSPS KAKENHI (A)
  “Research on Appearance and 3D imaging”
  PI: Yasuyuki Matsushita, Grant: 35,100K JPY

Publications

• Kazuma Minami; Hiroaki Santo; Fumio Okura; Yasuyuki Matsushita. Symmetric-light Photometric Stereo. Proceedings of IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2022.

• Lilika Makabe; Hiroaki Santo; Fumio Okura; Yasuyuki Matsushita. Shape-coded ArUco: Fiducial marker for bridging 2D and 3D modalities. Proceedings of IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2022.

• Xu Cao; Hiroaki Santo; Boxin Shi; Fumio Okura; Yasuyuki Matsushita. Bilateral Normal Integration. Proceedings of European Conference on Computer Vision (ECCV), 2022.

• Xu Cao; Michael Waechter; Boxin Shi; Ye Gao; Bo Zheng; Fumio Okura; Yasuyuki Matsushita. Shape and Albedo Recovery by Your Phone using Stereoscopic Flash and No-flash Photography. International Journal of Computer Vision (IJCV), 2022.

• Kenji Enomoto; Michael Waechter; Fumio Okura; Kiriakos N. Kutulakos; Yasuyuki Matsushita. Discrete Search Photometric Stereo for Fast and Accurate Shape Estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022.

• Feiran Li; Kent Fujiwara; Fumio Okua; Yasuyuki Matsushita. Shuffled Linear Regression with Outliers in Both Covariates and Responses. International Journal of Computer Vision (IJCV), 2022.

• Junxuan Li; Hondong Li; Yasuyuki Matsushita. Lighting, Reflectance and Geometry Estimation from 360° Panoramic Stereo Inproceedings. Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.

• Feiran Li; Kent Fujiwara; Fumio Okura; Yasuyuki Matsushita. A Closer Look at Rotation-invariant Deep Point Cloud Analysis. Proceedings of IEEE/CVF International Conference on Computer Vision (ICCV), 2021.

• Heng Guo; Fumio Okura; Boxin Shi; Takuya Funatomi; Yasuhiro Mukaigawa; Yasuyuki Matsushita. Multispectral Photometric Stereo for Spatially-Varying Spectral Reflectances: A well posed problem? Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.

• Xu Cao; Boxin Shi; Fumio Okura; Yasuyuki Matsushita. Normal Integration via Inverse Plane Fitting with Minimum Point-to-Plane Distance. Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.

• Junxuan Li; Hondong Li; Yasuyuki Matsushita. Lighting, Reflectance and Geometry Estimation from 360° Panoramic Stereo. Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.

• Xu Cao; Michael Waechter; Boxin Shi; Ye Gao; Bo Zheng; Yasuyuki Matsushita. Stereoscopic Flash and No-Flash Photography for Shape and Albedo Recovery. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.

• Kenji Enomoto; Michael Waechter; Kiriakos N. Kutulakos; Yasuyuki Matsushita. Photometric Stereo via Discrete Hypothesis-and-Test Search. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.

• Guanying Chen; Michael Waechter; Boxin Shi; Kwan-Yee Kenneth Wong; Yasuyuki Matsushita. What is Learned in Deep Uncalibrated Photometric Stereo? Proceedings of European Conference on Computer Vision (ECCV), 2020.

• Hiroaki Santo; Michael Waechter; Yasuyuki Matsushita. Deep near-light photometric stereo for spatially varying reflectances. Proceedings of European Conference on Computer Vision (ECCV), 2020.

• Daichi Iwata; Michael Waechter; Wen-Yan Lin; Yasuyuki Matsushita. An Analysis of Sketched IRLS for Accelerated Sparse Residual Regression. Proceedings of European Conference on Computer Vision (ECCV), 2020.

• Hiroaki Santo; Michael Waechter; Wen-Yan Lin; Yusuke Sugano; Yasuyuki Matsushita. Light structure from pin motion: Geometric point light source calibration. International Journal of Computer Vision (IJCV), vol. 128, no. 7, pp. 1889-1912, 2020.

• Hiroaki Santo; Masaki Samejima; Yusuke Sugano; Boxin Shi; Yasuyuki Matsushita. Deep Photometric Stereo Networks for Determining Surface Normal and Reflectances. Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020.