{"id":2604,"date":"2023-03-31T00:00:00","date_gmt":"2023-03-30T15:00:00","guid":{"rendered":"http:\/\/cvl.ist.osaka-u.ac.jp\/?p=2604"},"modified":"2025-07-03T14:43:01","modified_gmt":"2025-07-03T05:43:01","slug":"planttwin","status":"publish","type":"post","link":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/planttwin\/","title":{"rendered":"PlantTwin: Reconstructing plants for breeding and cultivation (JST FOREST 2021-2027)"},"content":{"rendered":"<p><img loading=\"lazy\" class=\"alignnone  wp-image-2627\" src=\"http:\/\/cvl.ist.osaka-u.ac.jp\/wp-content\/uploads\/2025\/03\/sohatsu-300x78.png\" alt=\"\" width=\"835\" height=\"217\" srcset=\"http:\/\/cvl.ist.osaka-u.ac.jp\/wp-content\/uploads\/2025\/03\/sohatsu-300x78.png 300w, http:\/\/cvl.ist.osaka-u.ac.jp\/wp-content\/uploads\/2025\/03\/sohatsu-200x52.png 200w, http:\/\/cvl.ist.osaka-u.ac.jp\/wp-content\/uploads\/2025\/03\/sohatsu-768x199.png 768w, http:\/\/cvl.ist.osaka-u.ac.jp\/wp-content\/uploads\/2025\/03\/sohatsu.png 1024w\" sizes=\"(max-width: 835px) 100vw, 835px\" \/><\/p>\n<p>The ultimate goal of this research is the complete virtualization of plants from sensing data, i.e., the generation of a plant digital twin. This research focuses particularly on technical elements related to computer vision, and reproduces not only the shape of the plant from a set of images taken of the plant, but also its branch and leaf structure, time-series changes, etc., including occluded areas. The virtualized plant model enables simulation and mapping to genes, and is a powerful tool for automating cultivation and accelerating breeding.<\/p>\n<h2>Grants<\/h2>\n<ul>\n<li>2021\/4\uff5e2028\/3 JST FOREST<br \/>&#8220;PlantTwin: Reconstructing plants for breeding and cultivation&#8221;<br \/>PI: Fumio Okura, Grant: 50,000K JPY<\/li>\n<\/ul>\n<h2>Publications<\/h2>\n<ul>\n<li>Yang Yang, Mao Dongni, Hiroaki Santo, Yasuyuki Matsushita, Fumio Okura. NeuraLeaf: Neural parametric leaf models with shape and deformation disentanglement. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), 2025.<\/li>\n<li>Xinpeng Liu, Zeyi Huang, Fumio Okura, Yasuyuki Matsushita. HoGS: Unified near and far object reconstruction via homogeneous gaussian splatting. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025.<\/li>\n<li>Xinpeng Liu, Hiroaki Santo, Yosuke Toda, Fumio Okura: TreeFormer: Single-view plant skeleton estimation via tree-constrained graph generation. Proc. IEEE\/CVF Winter Conference on Applications of Computer Vision (WACV&#8217;25), Feb 2025. [<a href=\"http:\/\/arxiv.org\/abs\/2411.16132\">arXiv<\/a>] [<a href=\"https:\/\/github.com\/huntorochi\/TreeFormer\/\">code<\/a>]<\/li>\n<li>Takuto Narumoto, Hiroaki Santo, Fumio Okura. Synthesizing time-varying BRDFs via latent space.<br \/>Proceedings of European Conference on Computer Vision (ECCV), 2024. [<a href=\"https:\/\/eccv.ecva.net\/virtual\/2024\/poster\/1289\">Paper<\/a>]<\/li>\n<li>Satoru Tsugawa, Kaname Teratsuji, Fumio Okura, Koji Noshita, Masaki Tateno, Jingyao Zhang, Taku Demura: Exploring the mechanical and morphological rationality of tree branch structure based on 3D point cloud analysis and the finite element method. Scientific Reports, Vol. 12, Article No 4054, Mar 2022. [<a href=\"https:\/\/doi.org\/10.1270\/jsbbs.21074\">paper<\/a>]<\/li>\n<li>Fumio Okura: 3D modeling and reconstruction of plants and trees: A cross-cutting review across computer graphics, vision, and plant phenotyping. Breeding Science, Vol. 72, Issue 1, pp. 31-47, Feb 2022. [<a href=\"https:\/\/doi.org\/10.1270\/jsbbs.21074\">paper<\/a>]<\/li>\n<\/ul>\n<p><\/p>","protected":false},"excerpt":{"rendered":"<p>The ultimate goal of this research is the complete virtualization of plants from sensing data, i.e., the gener [&hellip;]<\/p>\n","protected":false},"author":16,"featured_media":2627,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[22],"tags":[],"_links":{"self":[{"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/posts\/2604"}],"collection":[{"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/users\/16"}],"replies":[{"embeddable":true,"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/comments?post=2604"}],"version-history":[{"count":28,"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/posts\/2604\/revisions"}],"predecessor-version":[{"id":2885,"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/posts\/2604\/revisions\/2885"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/media\/2627"}],"wp:attachment":[{"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/media?parent=2604"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/categories?post=2604"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/cvl.ist.osaka-u.ac.jp\/en\/wp-json\/wp\/v2\/tags?post=2604"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}