l1a geo failing

oo_processing · by **oo_processing** » Fri Dec 25, 2020 11:09 am America/New_York

There are several that have been stuck in this way on two installations:

searobin 117 :/tmp/test> modis_L1A.py MOD00.P2020357.1710_1.PDS -o MOD00.P2020357.1710.ZHEJIANG_FULL.L1A_LAC --startnudge=0 --stopnudge=10
MODIS L1A version 6.0.6, built Aug 16 2019 12:46:26
scan: 0 out of 201 Fri Dec 25 10:58:23 2020
...
scan: 170 out of 201 Fri Dec 25 10:58:24 2020
searobin 118 :/tmp/test> modis_atteph.py -d --verbose MOD00.P20203
MOD00.P2020357.1710_1.PDS MOD00.P2020357.1710.ZHEJIANG_FULL.L1A_LAC
searobin 118 :/tmp/test> modis_atteph.py -d --verbose MOD00.P2020357.1710.ZHEJIANG_FULL.L1A_LAC
Aqua
Searching database: /optics1/software/seadas/seadas-7.5.3/ocssw/var/ancillary_data.db
Determining pass start and end times...
Aqua
()
Input file: MOD00.P2020357.1710.ZHEJIANG_FULL.L1A_LAC
Sensor : aqua
Start time: 2020357171000
End time : 2020357171450
()
Found: /optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/357/PM1EPHND.P2020357.1200.003
Found: /optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/357/PM1ATTNR.P2020357.1600.003
All required attitude and ephemeris files successfully determined and downloaded.
att1=/optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/357/PM1ATTNR.P2020357.1600.003
eph1=/optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/357/PM1EPHND.P2020357.1200.003
()
- All optimal ancillary data files were determined. -
searobin 119 :/tmp/test> ll -ltrh
total 223M
-rw-r--r-- 1 oo_processing oo_processing 45M Dec 25 10:56 MOD00.P2020357.1710_1.PDS
-rw-rw-r-- 1 oo_processing oo_processing 178M Dec 25 10:58 MOD00.P2020357.1710.ZHEJIANG_FULL.L1A_LAC
-rw-rw-r-- 1 oo_processing oo_processing 186 Dec 25 10:58 MOD00.P2020357.1710.ZHEJIANG_FULL.L1A_LAC.atteph
searobin 120 :/tmp/test> modis_GEO.py MOD00.P2020357.1710.ZHEJIANG_FULL.L
MOD00.P2020357.1710.ZHEJIANG_FULL.L1A_LAC    MOD00.P2020357.1710.ZHEJIANG_FULL.L1A_LAC.atteph
searobin 120 :/tmp/test> modis_GEO.py MOD00.P2020357.1710.ZHEJIANG_FULL.L1A_LAC -o MOD00.P2020357.1710.ZHEJIANG_FULL.GEO --threshold=95 --ancdb=./ancillary_data.db
MODIS GEO version 6.1.0, built Aug 16 2019 12:46:24
scan: 0 out of 189 Fri Dec 25 10:59:45 2020
...
scan: 180 out of 189 Fri Dec 25 10:59:54 2020
Percent valid data (61.00) is less than threshold (95.00)
ERROR: MODIS geolocation processing failed.

It may be the original PDS files. I d/l'ed them around that time to see:

[bmurch@dell8 ~]$ ll -ltrh ./MOD00.P2020357.*
-rw-rw-r--. 1 bmurch bmurch 30M Dec 25 11:13 ./MOD00.P2020357.1710_1.PDS.bz2
-rw-rw-r--. 1 bmurch bmurch 9.0K Dec 25 11:14 ./MOD00.P2020357.1715_1.PDS.bz2
-rw-rw-r--. 1 bmurch bmurch 55M Dec 25 11:15 ./MOD00.P2020357.1705_1.PDS.bz2
-rw-rw-r--. 1 bmurch bmurch 39M Dec 25 11:15 ./MOD00.P2020357.1720_1.PDS.bz2

oo_processing · by **oo_processing** » Mon Jan 04, 2021 11:49 am America/New_York

There is still no response on this. I have several regions stuck on doy 357 both in initial processing NRT and after the full anc becomes available:

FILE=/optics1/scratch/data/roi/l0/2020/357/MOD00.P2020357.1705_1.PDS.bz2
FILE=/optics1/scratch/data/roi/l0/2020/357/MOD00.P2020357.1710_1.PDS.bz2

I have tried to download them a few times and still the same files:
searobin 171 :/optics1/virtual_ant/S4P_ROI_H5/seadas_l1a_geo_extract_h5> ll MOD00.P2020357.1705_1.PDS.bz2 /optics1/scratch/data/roi/l0/2020/357/MOD00.P2020357.1705_1.PDS.bz2
-rw-rw-r-- 1 oo_processing oo_processing 57448513 Jan 4 11:44 MOD00.P2020357.1705_1.PDS.bz2
-rw-r--r-- 1 oo_processing oo_processing 57448513 Dec 22 16:17 /optics1/scratch/data/roi/l0/2020/357/MOD00.P2020357.1705_1.PDS.bz2
searobin 172 :/optics1/virtual_ant/S4P_ROI_H5/seadas_l1a_geo_extract_h5> ll MOD00.P2020357.1710_1.PDS.bz2 /optics1/scratch/data/roi/l0/2020/357/MOD00.P2020357.1710_1.PDS.bz2
-rw-rw-r-- 1 oo_processing oo_processing 30431453 Jan 4 11:43 MOD00.P2020357.1710_1.PDS.bz2
-rw-r--r-- 1 oo_processing oo_processing 30431453 Dec 22 16:17 /optics1/scratch/data/roi/l0/2020/357/MOD00.P2020357.1710_1.PDS.bz2

searobin 167 :/optics1/virtual_ant/S4P_ROI_H5/seadas_l1a_geo_extract_h5> diff MOD00.P2020357.1710_1.PDS.bz2 /optics1/scratch/data/roi/l0/2020/357/MOD00.P2020357.1710_1.PDS.bz2
searobin 168 :/optics1/virtual_ant/S4P_ROI_H5/seadas_l1a_geo_extract_h5>
...
searobin 170 :/optics1/virtual_ant/S4P_ROI_H5/seadas_l1a_geo_extract_h5> diff MOD00.P2020357.1705_1.PDS.bz2 /optics1/scratch/data/roi/l0/2020/357/MOD00.P2020357.1705_1.PDS.bz2
searobin 171 :/optics1/virtual_ant/S4P_ROI_H5/seadas_l1a_geo_extract_h5>

OB.DAACx - SeanBailey · by **OB.DAACx - SeanBailey** » Wed Jan 06, 2021 3:04 pm America/New_York

The MOD00.P2020357.1710_1.PDS file was short. A regenerated version is now available. Try again.

Sean

oo_processing · by **oo_processing** » Thu Jan 07, 2021 10:41 am America/New_York

Sean,
Works perfectly.
Thanks,
Brock