pages/_projects/spectra.md

96 lines
4.0 KiB
Markdown
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

---
layout: page
title: Spectra
description: Application using the morphological hierarchies and LiDAR data.
img: /assets/img/spectra-480.webp
importance: 1
category: thesis
---
This application allows interactive filtering of LiDAR data. We can
retrieve structures in the LiDAR data based on the elevation values of
the connected components and their shape and size attributes. To guide
the attribute thresholding we can plot the attribute space representing
all the shapes and sizes of the structures contained in the LiDAR data.
Such a plot can be called a shape-size pattern spectrum.
![Pattern spectrum of structures present in a LiDAR elevation model. The
x-axis represents the area of the structures (in m²) and the y-axis
represents their compactness (a shape-based
ratio).](/assets/img/spectra.png){.figure-img .img-fluid .rounded
.z-depth-1}
## Interactive filtering
We can use this spectrum to select the attribute thresholds. The current
application allows us to do this in real time!
![Video: Select the area and compactness attributes
thresholds.](/assets/vid/spetra_rennes_area_compactness.mp4){.figure-img
.img-fluid .rounded .z-depth-1}
In this spectrum, the x-axis represents the area attribute. Selecting
the right part of the spectrum allows us to filter the largest connected
components, while selecting the left part allows us to filter the
smallest connected components. In between we can characterize different
classes of structures sizes, including cars, trees, buildings. The
y-axis represents the compactness attribute. The compactness attribute
is defined as the ratio between the area of the connected component and
the square of its perimeter. It ranges from 0 for non-compact shapes to
1 for compact shapes. The top of the spectrum represents compact shapes
(e.g. circular shapes) while the bottom of the spectrum represents
linear shapes.
## Example driven
Selecting thresholds in the attribute space can still be difficult. We
propose to drive the threshold selection by the example. The application
allows to select in the LiDAR data structures and to highlight their
shapes and sizes in the spectrum.
![Video: Select a building as exemple to drive the attribute thersholding.](/assets/vid/spetra_rennes_area_compactness_select.mp4){.figure-img
.img-fluid .rounded .z-depth-1 }
## Wait, there's more!
In the previous example we showed the use of two attributes, area and
compactness. However, there are many more that we can use or even
define, depending on the purpose of the application.
Furthermore, the attribute space does not necessarily have to be limited
by two dimensions. If for now we are limited to a maximum of 3
dimensions for understanding and visualisation (as seen in the 3D
spectrum bellow), we can look forward to using new visualisation and
innovative user interfaces to jump into the multi-dimensional attribute
space exploration!
![3D spectrum (area, compactness, height).](/assets/vid/3D_axis2_trans_2x.mp4){.figure-img .img-fluid
.rounded .z-depth-1 loop=true autoplay=true}
## Notes
The underlying data structure for processing LiDAR data are hierarchical
morphologies, in particular component trees, which allow an efficient
representation of nested connected components for the computation of
shape and size attributes as well as efficient filtering.
The application was developed in Python using the [SAP
package](/projects/sap/) to build the trees, compute the spectra and
filter the data.
This application was developed as part of my PhD thesis. Experiments
and quantitative results have been published on use cases in a natural
environment, related to illegal gold panning and dikes detection [^1].
[^1]: F. Guiotte, G. Etaix, S. Lefèvre, et T. Corpetti, « *Interactive
Digital Terrain Model Analysis in Attribute Space* », International
Archives of the Photogrammetry, Remote Sensing and Spatial Information
Sciences, vol. XLIII-B2-2020, p. 12031209, 2020, doi:
[10.5194/isprs-archives-XLIII-B2-2020-1203-2020][doi].
[doi]: https://doi.org/10.5194/isprs-archives-XLIII-B2-2020-1203-2020