The Library
Multi-view stereo network with point attention
Tools
Zhao, Rong, Gu, Zhuoer, Han, Xie, He, Ligang, Sun, Fusheng and Jiao, Shichao (2023) Multi-view stereo network with point attention. Applied Intelligence, 53 (22). pp. 26622-26636. doi:10.1007/s10489-023-04806-y ISSN 0924-669X.
Research output not available from this repository.
Request-a-Copy directly from author or use local Library Get it For Me service.
Official URL: http://dx.doi.org/10.1007/s10489-023-04806-y
Abstract
In recent years, learning-based multi-view stereo (MVS) reconstruction has gained superiority when compared with traditional methods. In this paper, we introduce a novel point-attention network, with an attention mechanism, based on the point cloud structure. During the reconstruction process, our method with an attention mechanism can guide the network to pay more attention to complex areas such as thin structures and low-texture surfaces. We first infer a coarse depth map using a modified classical MVS deep framework and convert it into the corresponding point cloud. Then, we add the high-frequency features and different-resolution features of the raw images to the point cloud. Finally, our network guides the weight distribution of points in different dimensions through the attention mechanism and computes the depth displacement of each point iteratively as the depth residual, which is added to the coarse depth prediction to obtain the final high-resolution depth map. Experimental results show that our proposed point-attention architecture can achieve a significant improvement in some scenes without reasonable geometrical assumptions on the DTU dataset and the Tanks and Temples dataset, suggesting that our method has a strong generalization ability.
Item Type: | Journal Article | ||||||||
---|---|---|---|---|---|---|---|---|---|
Divisions: | Faculty of Science, Engineering and Medicine > Science > Computer Science | ||||||||
Journal or Publication Title: | Applied Intelligence | ||||||||
Publisher: | Springer New York LLC | ||||||||
ISSN: | 0924-669X | ||||||||
Official Date: | November 2023 | ||||||||
Dates: |
|
||||||||
Volume: | 53 | ||||||||
Number: | 22 | ||||||||
Page Range: | pp. 26622-26636 | ||||||||
DOI: | 10.1007/s10489-023-04806-y | ||||||||
Status: | Peer Reviewed | ||||||||
Publication Status: | Published | ||||||||
Access rights to Published version: | Restricted or Subscription Access |
Request changes or add full text files to a record
Repository staff actions (login required)
View Item |