Navigation and service

Advertising division: JSC - Jülich Supercomputing Centre
Reference number: 2019M-011, Computer Science , Electrical/Computer Engineering

Master Thesis: Deep Learning for Satellite Image Super-Resolution

Background:
The cross-sectional team deep learning at the Jülich Supercomputing Centre (JSC) is conducting basic and applied research in the field of adaptive multi-layer neural network architectures that learn complex tasks from very large amount of unprocessed data. One of the tackled use cases is the processing and analysis of remote sensing images. Acquired data from sensors on-board aircraft and satellite platforms cannot be directly used by the applications. The interpretation of remote sensing images is not straightforward, and it requires a powerful yet highly accurate processing scheme to extract reliable and valuable information. Analytical methods such as machine learning and deep learning need be exploited to derive this value.

Project Description:
The goal of the project is to design a deep network for the fusion of disjoint reflectance bands that have different spatial resolution and have been acquired by the same sensor. The considered data are the one acquired by the Sentinel-2 mission [1], which includes a constellation of two satellites that collect multispectral bands of 10m, 20m and 60m spatial resolution for visible, near infrared (NIR) and shortwave infrared (SWIR). The network will be developed for fusing the whole bands to obtain finer spatial resolution versions of the coarse bands.

Benefits:
Direct access to high performance multi-GPU systems equipped with the state-of-the-art of deep learning frameworks (i.e., TensorFlow [2]).

Your Tasks:
Revise Generative Adversarial Networks (GANs) [3].
Reproduce the results of one proposed GAN network [4].
Adapt the network for Sentinel-2 data and optimize the hyperparameters.
Scale-up the training process.

Material:
The candidate should understand what is Pansharpening and its application for remote sensing images. In short, due to physical constrains of satellite sensor instruments, a single sensor cannot acquire images that have both high spatial and spectral resolutions. This limitation can be solved with Pansharpening, that is a set of data fusion approaches which are used to fuse the panchromatic (i.e., high spatial resolution) with the multispectral images (i.e., high spectral resolution) [5][6]. Pansharpening methods can be grouped into 4 categories: component substitution, multiresolution analysis, model, and super-resolution.

[1] https://sentinel.esa.int/web/sentinel/missions/sentinel-2
[2] https://www.tensorflow.org/
[3] https://arxiv.org/abs/1406.2661
[4] https://arxiv.org/abs/1805.03371
[5] https://openremotesensing.net/wp-content/uploads/2015/02/IEEE_TGRS_2015_vivone_pansharpening.pdf
[6] https://www.youtube.com/watch?v=JprRsQipCx4&t=84s

Your Profile:
Master’s student in Computer Science or Electrical/Computer Engineering
Medium knowledge of Machine Learning and Deep Learning
Medium/advanced knowledge of Python
English proficiency is expected

Information required:
Curriculum vitae (max 3 pages)
List of previous projects/experiences where Machine Learning and Deep Learning algorithms have been adopted.

We offer:
Financial support is provided by JSC for the duration of the thesis (i.e., 6 months with the possibility of extension to 9 months).

Contacts:

Please forward your application to both contacts.

Dr. Gabriele Cavallaro
Jülich Supercomputing Centre (JSC)
Forschungszentrum Jülich GmbH
Phone: +49 2461 61-3858
email: g.cavallaro@fz-juelich.de

Dr. Jenia Jitsev
Jülich Supercomputing Centre (JSC)
Forschungszentrum Jülich GmbH
Phone: +49 2461 61-9727
email: j.jitsev@fz-juelich.de