Privacy Policy Disclaimer
  Advanced SearchBrowse




Journal Article

Comparison of 2D and 3D semantic segmentation in urban areas using fused hyperspectral and lidar data


Kuras,  Agnieszka
External Organizations;

Jenul,  Anna
External Organizations;


Brell,  Maximilian
1.4 Remote Sensing, 1.0 Geodesy, Departments, GFZ Publication Database, Deutsches GeoForschungsZentrum;

Burud,  Ingunn
External Organizations;

External Ressource
No external resources are shared
Fulltext (public)

(Publisher version), 3MB

Supplementary Material (public)
There is no public supplementary material available

Kuras, A., Jenul, A., Brell, M., Burud, I. (2022): Comparison of 2D and 3D semantic segmentation in urban areas using fused hyperspectral and lidar data. - Journal of Spectral Imaging, 11, a11.

Cite as: https://gfzpublic.gfz-potsdam.de/pubman/item/item_5015266
Multisensor data fusion has become a hot topic in the remote sensing research community. This is thanks to significant technological advances and the ability to extract information that would have been challenging with a single sensor. However, sensory enhancement requires advanced analysis that enables deep learning. A framework is designed to effectively fuse hyperspectral and lidar data for semantic segmentation in the urban environment. Our work proposes a method of reducing dimensions by exploring the most representative features from hyperspectral and lidar data and using them for supervised semantic segmentation. In addition, we chose to compare segmentation models based on 2D and 3D convolutional operations with two different model architectures, such as U-Net and ResU-Net. All algorithms have been tested with three loss functions: standard Categorical Cross-Entropy, Focal Loss and a combination of Focal Loss and Jaccard Distance—Focal–Jaccard Loss. Experimental results demonstrated that the 3D segmentation of U-Net and ResU-Net with Focal and Focal–Jaccard Loss functions had significantly improved performance compared to the standard Categorical Cross-Entropy models. The results show a high accuracy score and reflect reality by preserving the complex geometry of the objects.