{"id":2617,"date":"2023-04-01T00:00:00","date_gmt":"2023-03-31T15:00:00","guid":{"rendered":"http:\/\/cvl.ist.osaka-u.ac.jp\/?p=2617"},"modified":"2025-07-03T14:43:45","modified_gmt":"2025-07-03T05:43:45","slug":"kiban-s_photogrammetry","status":"publish","type":"post","link":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/kiban-s_photogrammetry\/","title":{"rendered":"Photogrammetry through co-design of data-driven 3D estimation and imaging systems (JSPS KAKENHI (S) 2023-2027)"},"content":{"rendered":"<p><img loading=\"lazy\" class=\"alignnone  wp-image-2650\" src=\"http:\/\/cvl.ist.osaka-u.ac.jp\/wp-content\/uploads\/2023\/04\/mvas-300x78.jpg\" alt=\"\" width=\"873\" height=\"227\" srcset=\"http:\/\/cvl.ist.osaka-u.ac.jp\/wp-content\/uploads\/2023\/04\/mvas-300x78.jpg 300w, http:\/\/cvl.ist.osaka-u.ac.jp\/wp-content\/uploads\/2023\/04\/mvas-1024x267.jpg 1024w, http:\/\/cvl.ist.osaka-u.ac.jp\/wp-content\/uploads\/2023\/04\/mvas-200x52.jpg 200w, http:\/\/cvl.ist.osaka-u.ac.jp\/wp-content\/uploads\/2023\/04\/mvas-768x201.jpg 768w, http:\/\/cvl.ist.osaka-u.ac.jp\/wp-content\/uploads\/2023\/04\/mvas.jpg 1486w\" sizes=\"(max-width: 873px) 100vw, 873px\" \/><\/p>\n<p>This research aims to establish \u201cinnovative photogrammetry based on a data-driven approach and co-design of imaging systems\u201d for the purpose of faithful 3D digitization of real-world objects using cameras, and to realize a world where anyone can easily create high-quality 3D digital content. In this project, we will develop technologies to obtain not only the rough objects&#8217; shape (macro shape) but also the visible micro shape of the object surface (meso shape), which is essential for faithful digital reproduction and a finer shape that expresses reflectance (micro shape). In addition, this research will establish a technology for easily digitizing real-world objects in three dimensions using simple photographic equipment through the cooperative design of data-driven and imaging systems.<\/p>\n<h2>Grant<\/h2>\n<ul>\n<li>2023\/4 &#8211; 2028\/3 JSPS KAKENHI (S)<br \/>&#8220;Photogrammetry through co-design of data-driven 3D estimation and imaging systems&#8221;<br \/>PI: Yasuyuki Matsushita, Co-PIs: Fumio Okura, Hiroaki Santo, Grant: 157,200K JPY<\/li>\n<\/ul>\n<h2>Publications<\/h2>\n<ul>\n<li>Lilika Makabe, Hiroaki Santo, Fumio Okura, Michael S. Brown, Yasuyuki Matsushita. Spectral sensitivity estimation with an uncalibrated diffraction grating. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), 2025.<\/li>\n<li>Xinpeng Liu, Zeyi Huang, Fumio Okura, Yasuyuki Matsushita. HoGS: Unified near and far object reconstruction via homogeneous gaussian splatting. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025.<\/li>\n<li>Heng Guo, Jieji Ren, Feishi Wang, Boxin Shi, Mingjun Ren, Yasuyuki Matsushita. DiLiGenRT: A Photometric Stereo Dataset with Quantified Roughness and Translucency. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024. [<a href=\"https:\/\/photometricstereo.github.io\/imgs\/diligentrt\/CameraPaper.pdf\">Paper<\/a>] [<a href=\"https:\/\/photometricstereo.github.io\/diligentrt.html\">Project page<\/a>]<\/li>\n<li>Yufei Han, Heng Guo, Koki Fukai, Hiroaki Santo, Boxin Shi, Fumio Okura, Zhanyu Ma, Yunpeng Jia. <span style=\"font-size: revert; color: initial;\">NeRSP: Neural 3D Reconstruction for Reflective Objects with Sparse Polarized Images. <\/span><span style=\"font-size: revert; color: initial;\">Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024. [<a href=\"https:\/\/arxiv.org\/abs\/2406.07111\">arXiv<\/a>]<\/span><\/li>\n<li>Hiroaki Santo, Fumio Okura, Yasuyuki Matsushita. MVCPS-NeuS: Multi-view Constrained Photometric Stereo for Neural Surface Reconstruction. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024. [<a href=\"https:\/\/openaccess.thecvf.com\/content\/CVPR2024\/html\/Santo_MVCPS-NeuS_Multi-view_Constrained_Photometric_Stereo_for_Neural_Surface_Reconstruction_CVPR_2024_paper.html\">Paper<\/a>]<\/li>\n<li>Siwei Zhou, Youngha Chang, Nobuhiko Mukai, Hiroaki Santo, Fumio Okura, Yasuyuki Matsushita, Shuang Zhao. Path-Space Differentiable Rendering of Implicit Surfaces. Proceedings of ACM SIGGRAPH 2024 Conference, 2024. [<a href=\"https:\/\/shuangz.com\/projects\/psdr-sdf-sg24\/psdr-sdf-sg24.pdf\">Paper<\/a>] [<a href=\"https:\/\/shuangz.com\/projects\/psdr-sdf-sg24\/\">Project page<\/a>]<\/li>\n<li>Takuto Narumoto, Hiroaki Santo, Fumio Okura. Synthesizing time-varying BRDFs via latent space.<br \/>Proceedings of European Conference on Computer Vision (ECCV), 2024. [<a href=\"https:\/\/eccv.ecva.net\/virtual\/2024\/poster\/1289\">Paper<\/a>]<\/li>\n<li>Kohei Ashida; Hiroaki Santo; Fumio Okura; Yasuyuki Matsushita. Resolving scale ambiguity in multi-view 3D reconstruction using dual-pixel sensors. Proceedings of European Conference on Computer Vision (ECCV), 2024. [<a href=\"https:\/\/eccv.ecva.net\/virtual\/2024\/poster\/1345\">Paper<\/a>]<\/li>\n<li>Xu Cao, Hiroaki Santo, Fumio Okura, Yasuyuki Matsushita. Multi-View Azimuth Stereo via Tangent Space Consistency. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [<a href=\"https:\/\/arxiv.org\/abs\/2303.16447\">arXiv<\/a>]<\/li>\n<li>Kensuke Uchida, Hajime Nagahara, Yasuyuki Matsushita. A Compact BRDF Scanner with Multi-conjugate Optics. Proceedings of the IEEE International Conference on Computational Photography (ICCP), 2023.<\/li>\n<li>Lilika Makabe, Heng Guo, Hiroaki Santo, Fumio Okura, Yasuyuki Matsushita. Near-light Photometric Stereo with Symmetric Lights Proceedings of the IEEE International Conference on Computational Photography (ICCP), 2023.<\/li>\n<li>\u00a0<\/li>\n<\/ul>\n<p><\/p>","protected":false},"excerpt":{"rendered":"<p>This research aims to establish \u201cinnovative photogrammetry based on a data-driven approach and co-design of im [&hellip;]<\/p>\n","protected":false},"author":16,"featured_media":2648,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[22],"tags":[],"_links":{"self":[{"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/posts\/2617"}],"collection":[{"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/users\/16"}],"replies":[{"embeddable":true,"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/comments?post=2617"}],"version-history":[{"count":12,"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/posts\/2617\/revisions"}],"predecessor-version":[{"id":2886,"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/posts\/2617\/revisions\/2886"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/media\/2648"}],"wp:attachment":[{"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/media?parent=2617"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/categories?post=2617"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/tags?post=2617"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}