How to manually give tropospheric datas if we face internet issues while processing Mintpy...

[Karthi-Wolf]

Hello everyone, I want help from processing mintpy from ISCE interferogram of stackSentinel.py. Im processing in HPC, where i can't get internet access so when i tried processing mintpy by i got ECMWF downloading error so, I did manually downloaded the ERA5 (did the same processing local system and copied the same ERA5 for the HPC testing) " i had earlier set the mintpy.txt as
"##-------------------------------- MintPy -----------------------------##
########## 1. Load Data (--load to exit after this step)

load_data.py -H to check more details and example inputs.

mintpy.load.processor = isce
##---------for ISCE only:
mintpy.load.metaFile = ~/IW*.xml
mintpy.load.baselineDir = ~/baselines
##---------interferogram datasets:
mintpy.load.unwFile = /~interferograms//filt_.unw
mintpy.load.corFile = ~/interferograms//filt_.cor
mintpy.load.connCompFile = ~/interferograms//filt_.unw.conncomp
##---------geometry datasets:
mintpy.load.demFile = ~geom_reference/hgt.rdr
mintpy.load.lookupYFile = ~geom_reference/lat.rdr
mintpy.load.lookupXFile = /geom_reference/lon.rdr
mintpy.load.incAngleFile =/geom_reference/los.rdr
mintpy.load.azAngleFile = ~/geom_reference/los.rdr
mintpy.load.shadowMaskFile = ~/geom_referenc/shadowMask.rdr
mintpy.load.waterMaskFile = ~/geom_reference/waterMask.rdr

########## 8. Tropospheric Delay Correction
mintpy.troposphericDelay.method = pyaps
mintpy.troposphericDelay.weatherModel = ERA5
mintpy.troposphericDelay.weatherDir =~/mintpy/ERA5"""

THIS is the output I got after i did processed the mintpy. can anyone help about it. Also say the best way to manually download and process tropospheric correction without internet in the HPC...

" " ******************** step - correct_troposphere ********************
Atmospheric correction using Weather Re-analysis dataset (PyAPS, Jolivet et al., 2011)
Weather Re-analysis dataset: ERA5

tropo_pyaps3.py -f /home/incois/mohanty/karthi/SBAS/output/mintpy/timeseries.h5 --model ERA5 -g /home/incois/mohanty/karthi/SBAS/output/mintpy/inputs/geometryRadar.h5 -w /home/incois/mohanty/karthi/SBAS/output/mintpy/ERA5
weather model: ERA5 - dry (hydrostatic) and wet delay
weather directory: /home/incois/mohanty/karthi/SBAS/output/mintpy/ERA5
output tropospheric delay time-series file: /home/incois/mohanty/karthi/SBAS/output/mintpy/inputs/ERA5.h5
output corrected displacement time-series file: /home/incois/mohanty/karthi/SBAS/output/mintpy/timeseries_ERA5.h5
read dates/time info from file: /home/incois/mohanty/karthi/SBAS/output/mintpy/timeseries.h5
time of cloest available product: 00:00 UTC
make directory: /home/incois/mohanty/karthi/SBAS/output/mintpy/ERA5/ERA5

---

Download global atmospheric model files...
update mode: ON
output file: /home/incois/mohanty/karthi/SBAS/output/mintpy/inputs/ERA5.h5

1. output file either do NOT exist or is NOT newer than all GRIB files.
   run or skip: run

---

downloading weather model data using PyAPS ...
number of grib files to download: 12

INFO: You are using the latest ECMWF platform for downloading datasets: https://cds.climate.copernicus.eu/api
Downloading 1 of 12: /home/incois/mohanty/karthi/SBAS/output/mintpy/ERA5/ERA5/ERA5_N10_N20_E70_E90_20240112_00.grb
{'product_type': ['reanalysis'], 'variable': ['geopotential', 'temperature', 'specific_humidity'], 'year': ['2024'], 'month': ['01'], 'day': ['12'], 'time': ['00:00'], 'pressure_level': ['1', '2', '3', '5', '7', '10', '20', '30', '50', '70', '100', '125', '150', '175', '200', '225', '250', '300', '350', '400', '450', '500', '550', '600', '650', '700', '750', '775', '800', '825', '850', '875', '900', '925', '950', '975', '1000'], 'data_format': 'grib', 'area': [20, 70, 10, 90]}
WARNING: the 1 attempt to download failed, retry it.

INFO: You are using the latest ECMWF platform for downloading datasets: https://cds.climate.copernicus.eu/api
Downloading 1 of 12: /home/incois/mohanty/karthi/SBAS/output/mintpy/ERA5/ERA5/ERA5_N10_N20_E70_E90_20240112_00.grb
{'product_type': ['reanalysis'], 'variable': ['geopotential', 'temperature', 'specific_humidity'], 'year': ['2024'], 'month': ['01'], 'day': ['12'], 'time': ['00:00'], 'pressure_level': ['1', '2', '3', '5', '7', '10', '20', '30', '50', '70', '100', '125', '150', '175', '200', '225', '250', '300', '350', '400', '450', '500', '550', '600', '650', '700', '750', '775', '800', '825', '850', '875', '900', '925', '950', '975', '1000'], 'data_format': 'grib', 'area': [20, 70, 10, 90]}
WARNING: the 2 attempt to download failed, retry it.

INFO: You are using the latest ECMWF platform for downloading datasets: https://cds.climate.copernicus.eu/api
Downloading 1 of 12: /home/incois/mohanty/karthi/SBAS/output/mintpy/ERA5/ERA5/ERA5_N10_N20_E70_E90_20240112_00.grb
{'product_type': ['reanalysis'], 'variable': ['geopotential', 'temperature', 'specific_humidity'], 'year': ['2024'], 'month': ['01'], 'day': ['12'], 'time': ['00:00'], 'pressure_level': ['1', '2', '3', '5', '7', '10', '20', '30', '50', '70', '100', '125', '150', '175', '200', '225', '250', '300', '350', '400', '450', '500', '550', '600', '650', '700', '750', '775', '800', '825', '850', '875', '900', '925', '950', '975', '1000'], 'data_format': 'grib', 'area': [20, 70, 10, 90]}

---

WARNING: downloading failed for 3 times, stop trying and continue.

---

---

Calculate tropospheric delay and write to HDF5 file...
update mode: ON
output file: /home/incois/mohanty/karthi/SBAS/output/mintpy/inputs/ERA5.h5

1. output file either do NOT exist or is NOT newer than all GRIB files.
   run or skip: run
   open geometry file: geometryRadar.h5
   reading incidenceAngle data from file: /home/incois/mohanty/karthi/SBAS/output/mintpy/inputs/geometryRadar.h5 ...
   reading height data from file: /home/incois/mohanty/karthi/SBAS/output/mintpy/inputs/geometryRadar.h5 ...
   reading latitude data from file: /home/incois/mohanty/karthi/SBAS/output/mintpy/inputs/geometryRadar.h5 ...
   reading longitude data from file: /home/incois/mohanty/karthi/SBAS/output/mintpy/inputs/geometryRadar.h5 ...

---

create HDF5 file: /home/incois/mohanty/karthi/SBAS/output/mintpy/inputs/ERA5.h5 with w mode
create dataset : date of |S1 in size of (0,) with compression = None
create dataset : timeseries of <class 'numpy.float32'> in size of (0, 3342, 5367) with compression = None
close HDF5 file: /home/incois/mohanty/karthi/SBAS/output/mintpy/inputs/ERA5.h5

calculating absolute delay for each date using PyAPS (Jolivet et al., 2011; 2014) ...
number of grib files used: 0"