Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
121 tokens/sec
GPT-4o
9 tokens/sec
Gemini 2.5 Pro Pro
47 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Satellite Sunroof: High-res Digital Surface Models and Roof Segmentation for Global Solar Mapping (2408.14400v2)

Published 26 Aug 2024 in cs.CV and cs.LG

Abstract: The transition to renewable energy, particularly solar, is key to mitigating climate change. Google's Solar API aids this transition by estimating solar potential from aerial imagery, but its impact is constrained by geographical coverage. This paper proposes expanding the API's reach using satellite imagery, enabling global solar potential assessment. We tackle challenges involved in building a Digital Surface Model (DSM) and roof instance segmentation from lower resolution and single oblique views using deep learning models. Our models, trained on aligned satellite and aerial datasets, produce 25cm DSMs and roof segments. With ~1m DSM MAE on buildings, ~5deg roof pitch error and ~56% IOU on roof segmentation, they significantly enhance the Solar API's potential to promote solar adoption.

Summary

  • The paper introduces a method using satellite imagery and deep learning to generate high-resolution Digital Surface Models (DSMs) and roof segments, expanding global solar potential mapping beyond areas with aerial data.
  • The methodology employs a U-Net/Swin Transformer model trained on aerial data to process off-nadir satellite images, producing refined DSMs and roof segments despite lower resolution challenges.
  • Key results show ~1m MAE for building DSMs and 56% IoU for roof segmentation, enabling the scaling of solar assessments to an additional 1 billion buildings worldwide and facilitating global renewable energy transitions.

Satellite Sunroof: Enhanced Global Solar Mapping via Satellite Imagery

The paper "Satellite Sunroof: High-res Digital Surface Models and Roof Segmentation for Global Solar Mapping" from Google Research and the University of Toronto lays out a method to expand Google's Solar API using satellite imagery. The main objective of this work is to address the limitations of aerial imagery, primarily its narrow geographic coverage, thereby enabling a broader global assessment of solar energy potential. Specifically, the paper proposes using single-oblique satellite views integrated with deep learning models to achieve high-resolution Digital Surface Models (DSMs) and precise roof segmentation.

Methodology

The authors leverage off-nadir satellite RGB images at a resolution of 30cm as primary inputs. These are optionally supplemented by photogrammetry-derived DSMs and DTMs, which, when utilized appropriately, provide additional surface height context. The paper introduces a novel workflow to manage the challenges posed by lower resolution and inclination angles in satellite imagery, coupled with temporal inconsistencies between data sources. The methodology consists of base and refinement models, both employing a U-Net architecture enhanced by a Swin Transformer encoder. The models are trained using aligned high-quality aerial RGB and DSMs as labels, focusing on minimizing errors in height maps and accurately delineating roof segments.

The base model processes input data predicates to generate refined off-nadir height maps and roof segments through a reprojection mechanism to nadir view. The performance is evaluated using robust metrics such as intersection over union (IoU) for roof segmentation and mean absolute error (MAE) of DSMs over buildings. A refinement model further improves upon the base output by compensating for occlusions and artifacts in DSMs and roof segments, thus ensuring precise final RGB, DSM, and roof segment outputs.

Results

Notable outcomes from this paper include achieving a ~1m MAE in building DSMs and an IoU of around 56% for roof segmentation, indicating the models' effectiveness in producing high-resolution rooftop data from low-resolution satellite imagery. These measures place the method as a promising tool to supplement and scale the existing Google Solar API, promising expanded coverage to an additional 1 billion buildings globally.

The paper also includes ablation studies that verify the importance of the masking strategies and dataset size, affirming that the dataset comprising 1 million datapoints yields the best segmentation results. The end-to-end performance metrics, such as the Mean Absolute Percentage Error (MAPE), further validate the efficacy of the designed pipeline in achieving reliable solar potential estimations.

Implications and Future Work

The implications of this research are multifaceted. Practically, it expands the reach of solar energy assessments to a global scale, catering especially to regions where high-quality aerial imagery is not readily available. Theoretically, the paper contributes insights into efficient DSM generation and roof segmentation from challenging inputs derived from satellite imagery. This work also serves as a basis for further exploration of using remote-sensing imagery for environmental and energy applications.

Looking forward, the authors propose several enhancements, such as roof obstacle detection and refinement of roof segmentation through human-labeled data. The successful implementation of such improvements could lead to more precise solar potential forecasting, thus facilitating a more rapid transition to renewable energy sources on a global scale. The integration of additional datasets and the development of more advanced masking techniques will likely further bolster the system's robustness and applicability across diverse geographic regions.

X Twitter Logo Streamline Icon: https://streamlinehq.com