Skip to content

GeoscienceAustralia/sar-rtc-opera

Repository files navigation

opera-RTC-otf

On the fly production of sentinel-1 OPERA RTC backscatter

Requirments

  • Git
  • Docker
  • Conda (mamba best for speed)
  • The following setup expects fedora linux instance (e.g. aws linux ami - packages installed with yum)

Setup

  • Add user credentials to the files stored in the credentials folder
  • run install script (note credentials must be set on build, if these change the image will need to be rebuilt)
  • if conda is not installed on instance (mamba will be installed)
sh setup.sh --install-conda
  • if running with suitable conda install
sh setup.sh 

Instructions

  • set scene and data path details in config.yaml
  • Change the OPERA-rtc-template.yaml. This is the opera template used for all scenes specified
  • run process scripts
source run_process.sh
  • On an AWS instance with a large number of jobs, run with nohup to ensure process is not killed if an SSH disconnection occurs.
conda activate rtc_opera
nohup ./run_process.sh
  • in a new terminal, run the following to trace the output
tail -f nohup.out

Common errors

  • ensure credentials have been set before running the setup script. If this was not the case, update the credentials in the credentials folder and run the folllowing:
cp -fr credentials RTC
cd RTC
sh build_docker_image_otf.sh
cd ..

Update credentials locally

cp -fr credentials/.netrc ~/
chmod og-rw ~/.netrc
  • Error when downloding orbit files using sentineleof
ValueError: max() arg is an empty sequence

Try changing the .netrc credentials to copernicus CDSE (https://pypi.org/project/sentineleof/). Then run the following to replace the .netrc file.

cp -fr credentials/.netrc ~/
chmod og-rw ~/.netrc