本研究では，カメラを用いて実世界にある物体の3次元形状と質感の両方をデータとして獲得し，実物体のデジタル3次元コピーを手軽に生成する技術の開発を目標としました．この研究を通じて，3次元形状と物体の質感を表現する反射率の同時推定技術が進展し，デジタル3次元化技術が進展しました．従来の3次元デジタル化のための撮影装置は大掛かりなものでしたが，それをコンパクトに実現する方法についても研究が進みました．これらの成果については，国際会議や国際論文誌にて広く発信しました．

関連研究費

• 2019年4月～2023年3月　JSPS 科学研究費助成事業 基盤研究(A)
  「質感と三次元形状のイメージングに関する研究」
  研究代表者：松下康之　配分総額 35,100千円

主要な発表文献

• Kazuma Minami; Hiroaki Santo; Fumio Okura; Yasuyuki Matsushita. Symmetric-light Photometric Stereo. Proceedings of IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2022.

• Lilika Makabe; Hiroaki Santo; Fumio Okura; Yasuyuki Matsushita. Shape-coded ArUco: Fiducial marker for bridging 2D and 3D modalities. Proceedings of IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2022.

• Xu Cao; Hiroaki Santo; Boxin Shi; Fumio Okura; Yasuyuki Matsushita. Bilateral Normal Integration. Proceedings of European Conference on Computer Vision (ECCV), 2022.

• Xu Cao; Michael Waechter; Boxin Shi; Ye Gao; Bo Zheng; Fumio Okura; Yasuyuki Matsushita. Shape and Albedo Recovery by Your Phone using Stereoscopic Flash and No-flash Photography. International Journal of Computer Vision (IJCV), 2022.

• Kenji Enomoto; Michael Waechter; Fumio Okura; Kiriakos N. Kutulakos; Yasuyuki Matsushita. Discrete Search Photometric Stereo for Fast and Accurate Shape Estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022.

• Feiran Li; Kent Fujiwara; Fumio Okua; Yasuyuki Matsushita. Shuffled Linear Regression with Outliers in Both Covariates and Responses. International Journal of Computer Vision (IJCV), 2022.

• Junxuan Li; Hondong Li; Yasuyuki Matsushita. Lighting, Reflectance and Geometry Estimation from 360° Panoramic Stereo Inproceedings. Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.

• Feiran Li; Kent Fujiwara; Fumio Okura; Yasuyuki Matsushita. A Closer Look at Rotation-invariant Deep Point Cloud Analysis. Proceedings of IEEE/CVF International Conference on Computer Vision (ICCV), 2021.

• Heng Guo; Fumio Okura; Boxin Shi; Takuya Funatomi; Yasuhiro Mukaigawa; Yasuyuki Matsushita. Multispectral Photometric Stereo for Spatially-Varying Spectral Reflectances: A well posed problem? Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.

• Xu Cao; Boxin Shi; Fumio Okura; Yasuyuki Matsushita. Normal Integration via Inverse Plane Fitting with Minimum Point-to-Plane Distance. Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.

• Junxuan Li; Hondong Li; Yasuyuki Matsushita. Lighting, Reflectance and Geometry Estimation from 360° Panoramic Stereo. Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.

• Xu Cao; Michael Waechter; Boxin Shi; Ye Gao; Bo Zheng; Yasuyuki Matsushita. Stereoscopic Flash and No-Flash Photography for Shape and Albedo Recovery. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.

• Kenji Enomoto; Michael Waechter; Kiriakos N. Kutulakos; Yasuyuki Matsushita. Photometric Stereo via Discrete Hypothesis-and-Test Search. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.

• Guanying Chen; Michael Waechter; Boxin Shi; Kwan-Yee Kenneth Wong; Yasuyuki Matsushita. What is Learned in Deep Uncalibrated Photometric Stereo? Proceedings of European Conference on Computer Vision (ECCV), 2020.

• Hiroaki Santo; Michael Waechter; Yasuyuki Matsushita. Deep near-light photometric stereo for spatially varying reflectances. Proceedings of European Conference on Computer Vision (ECCV), 2020.

• Daichi Iwata; Michael Waechter; Wen-Yan Lin; Yasuyuki Matsushita. An Analysis of Sketched IRLS for Accelerated Sparse Residual Regression. Proceedings of European Conference on Computer Vision (ECCV), 2020.

• Hiroaki Santo; Michael Waechter; Wen-Yan Lin; Yusuke Sugano; Yasuyuki Matsushita. Light structure from pin motion: Geometric point light source calibration. International Journal of Computer Vision (IJCV), vol. 128, no. 7, pp. 1889-1912, 2020.

• Hiroaki Santo; Masaki Samejima; Yusuke Sugano; Boxin Shi; Yasuyuki Matsushita. Deep Photometric Stereo Networks for Determining Surface Normal and Reflectances. Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020.