modis_L1B.py failures (bad LUT data?)

[martakonik]

Hello everyone,

I haven't found a solution to this problem, and I am experiencing a similar processing issue.
However, I found an additional comment about the Toolkit version in the logs, which I pasted below.

Does anyone know whether Seadas may require a reinstall?

Thank you,
Marta

****************************************
BEGIN_PGE: Wed Feb 26 19:14:02 2025
MSG_TAG: 11
FILE: /opt/AQUA/LogUser.A2025001103000.L1B_LAC
LOGGING: status message logging enabled
TRACE_LEVEL: tracing disabled
PID_LOGGING: disabled
DISABLED_LEVELS: none
DISABLED_SEEDS: none
DISABLED_CODES: none
THREAD-SAFE MODE: disabled
TOOLKIT_VERSION: SCF TK5.2.20
****************************************

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
!! W A R N I N G !!
!! The Toolkit version found in the PCF does not !!
!! match the current Toolkit version. The PCF in use !!
!! should be replaced with a PCF constructed from the !!
!! template PCF delivered with THIS version of the !!
!! Toolkit (see TOOLKIT_VERSION in banner, above). !!
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

[OB.DAAC - SeanBailey]

I can confirm that with the latest code and the current LUTs modis_GEO and modis_L1B work for data in Dec 2024 and Jan 2025 (including the examples mentioned in this thread).

Which version of the OCSSW code are you running? Are you certain you have the latest MODIS LUTs?

Sean

[woodbri]

I'm struggling with this problem also. I read the various threads and can't find a resolution. I would really appreciate some help getting this resolved.

Thanks,
-Steve

system: Ubuntu-20.04
clean install of tag V2024.8 - is this the latest software?

$ cat LogReport.MOD00.P2025145.1750_1.PDS.L1B_LAC

****************************************
BEGIN_PGE: Sun May 25 14:42:44 2025
MSG_TAG: 11
FILE: /data/www/nasa/tmp-535548-2/LogReport.MOD00.P2025145.1750_1.PDS.L1B_LAC
LOGGING: status message logging enabled
TRACE_LEVEL: tracing disabled
PID_LOGGING: disabled
DISABLED_LEVELS: none
DISABLED_SEEDS: none
DISABLED_CODES: none
THREAD-SAFE MODE: disabled
TOOLKIT_VERSION: SCF TK5.2.19
****************************************

Sun May 25 14:42:44 2025

TDLUT_ReadPiecewiseLinearFunction():MODIS_F_NOK:295817224
LUT associated with "m1" has times out of order.

==========================================================
Sun May 25 14:42:44 2025

Read_L1B_SDS_LUT():MODIS_F_NOK:295817224
Call to TDLUT_ReadPiecewiseLinearFunction() failed.

==========================================================

Sun May 25 14:42:44 2025

Read_LUT_Tables():MODIS_F_NOK:295817224
Call to Read_L1B_SDS_LUT() failed.
File LUN: 700050
File type: Reflective_Lookup_Tables_file

==========================================================

Sun May 25 14:42:44 2025

Fatal error(NOK) running...MOD_PR02. TIME:Sun May 25 14:42:44 2025
Operator Actions:
Contact MCST.

==========================================================

Here is a log of my run:

2$ cat log

https://oceandata.sci.gsfc.nasa.gov/getfile/MOD00.P2025145.1750_1.PDS.bz2

## stdout:
file: MOD00.P2025145.1750_1.PDS.bz2
tdir: tmp-535548-2
date: 20250525
file: MOD00.P2025145.1750_1.PDS.bz2

bunzip2 MOD00.P2025145.1750_1.PDS.bz2

modis_L1A.py MOD00.P2025145.1750_1.PDS -o MOD00.P2025145.1750_1.PDS.L1A_LAC
MODIS L1A version 6.0.6, built Aug 16 2019 12:46:26
scan: 0 out of 207 Sun May 25 14:42:33 2025
scan: 10 out of 207 Sun May 25 14:42:33 2025
scan: 20 out of 207 Sun May 25 14:42:33 2025
scan: 30 out of 207 Sun May 25 14:42:34 2025
scan: 40 out of 207 Sun May 25 14:42:34 2025
scan: 50 out of 207 Sun May 25 14:42:34 2025
scan: 60 out of 207 Sun May 25 14:42:34 2025
scan: 70 out of 207 Sun May 25 14:42:34 2025
scan: 80 out of 207 Sun May 25 14:42:34 2025
scan: 90 out of 207 Sun May 25 14:42:34 2025
scan: 100 out of 207 Sun May 25 14:42:34 2025
scan: 110 out of 207 Sun May 25 14:42:34 2025
scan: 120 out of 207 Sun May 25 14:42:34 2025
scan: 130 out of 207 Sun May 25 14:42:34 2025
scan: 140 out of 207 Sun May 25 14:42:34 2025
scan: 150 out of 207 Sun May 25 14:42:34 2025
scan: 160 out of 207 Sun May 25 14:42:34 2025
scan: 170 out of 207 Sun May 25 14:42:34 2025
scan: 180 out of 207 Sun May 25 14:42:34 2025
scan: 190 out of 207 Sun May 25 14:42:34 2025
scan: 200 out of 207 Sun May 25 14:42:34 2025

getanc.py --timeout=60 --refreshDB MOD00.P2025145.1750_1.PDS.L1A_LAC
Aqua
icefile=/u/oceandata/var/anc/0250/524/20250524120000-CMC-L4_GHRSST-SSTfnd-CMC0.1deg-GLOB-v02.0-fv03.0.nc
met1=/u/oceandata/var/anc/MAO_/IT./GMAO_IT.20250525T080000.MET.NRT.nc
met2=/u/oceandata/var/anc/MAO_/IT./GMAO_IT.20250525T080000.MET.NRT.nc
met3=/u/oceandata/var/anc/MAO_/IT./GMAO_IT.20250525T080000.MET.NRT.nc
ozone1=/u/oceandata/var/anc/MAO_/IT./GMAO_IT.20250525T080000.MET.NRT.nc
ozone2=/u/oceandata/var/anc/MAO_/IT./GMAO_IT.20250525T080000.MET.NRT.nc
ozone3=/u/oceandata/var/anc/MAO_/IT./GMAO_IT.20250525T080000.MET.NRT.nc
sstfile=/u/oceandata/var/anc/0250/524/20250524120000-CMC-L4_GHRSST-SSTfnd-CMC0.1deg-GLOB-v02.0-fv03.0.nc


*** WARNING: The following ancillary data types were missing or are not optimal: MET
*** Beware that certain MET and OZONE files just chosen by this program are not optimal.
*** For near real-time processing the remaining files may become available soon.

Failed: 'getanc.py --timeout=60 --refreshDB MOD00.P2025145.1750_1.PDS.L1A_LAC', error 256

modis_atteph.py --timeout=60 --refreshDB -v MOD00.P2025145.1750_1.PDS.L1A_LAC
Aqua
Searching database: /u/oceandata/var/ancillary_data.db
Determining pass start and end times...
Aqua

Input file: MOD00.P2025145.1750_1.PDS.L1A_LAC
Sensor : aqua
Start time: 2025145175000
End time : 2025145175500

OBPG session started
Found: /u/oceandata/var/anc/2025/145/PM1ATTNR_NRT.A2025145.1745.061
Found: /u/oceandata/var/anc/2025/145/PM1ATTNR_NRT.A2025145.1750.061
Found: /u/oceandata/var/anc/2025/145/PM1ATTNR_NRT.A2025145.1755.061
Found: /u/oceandata/var/anc/2025/145/PM1EPHND_NRT.A2025145.1745.061
Found: /u/oceandata/var/anc/2025/145/PM1EPHND_NRT.A2025145.1750.061
Found: /u/oceandata/var/anc/2025/145/PM1EPHND_NRT.A2025145.1755.061
All required attitude and ephemeris files successfully determined and downloaded.
att1=/u/oceandata/var/anc/2025/145/PM1ATTNR_NRT.A2025145.1745.061
att2=/u/oceandata/var/anc/2025/145/PM1ATTNR_NRT.A2025145.1750.061
att3=/u/oceandata/var/anc/2025/145/PM1ATTNR_NRT.A2025145.1755.061
eph1=/u/oceandata/var/anc/2025/145/PM1EPHND_NRT.A2025145.1745.061
eph2=/u/oceandata/var/anc/2025/145/PM1EPHND_NRT.A2025145.1750.061
eph3=/u/oceandata/var/anc/2025/145/PM1EPHND_NRT.A2025145.1755.061


- All optimal ancillary data files were determined and downloaded. -

Failed: 'modis_atteph.py --timeout=60 --refreshDB -v MOD00.P2025145.1750_1.PDS.L1A_LAC', error 256

modis_GEO.py --time=60 MOD00.P2025145.1750_1.PDS.L1A_LAC -o MOD00.P2025145.1750_1.PDS.GEO
MODIS GEO version 6.1.0, built Aug 16 2019 12:46:24
scan: 0 out of 203 Sun May 25 14:42:37 2025
scan: 10 out of 203 Sun May 25 14:42:37 2025
scan: 20 out of 203 Sun May 25 14:42:38 2025
scan: 30 out of 203 Sun May 25 14:42:38 2025
scan: 40 out of 203 Sun May 25 14:42:38 2025
scan: 50 out of 203 Sun May 25 14:42:39 2025
scan: 60 out of 203 Sun May 25 14:42:39 2025
scan: 70 out of 203 Sun May 25 14:42:39 2025
scan: 80 out of 203 Sun May 25 14:42:40 2025
scan: 90 out of 203 Sun May 25 14:42:40 2025
scan: 100 out of 203 Sun May 25 14:42:40 2025
scan: 110 out of 203 Sun May 25 14:42:41 2025
scan: 120 out of 203 Sun May 25 14:42:41 2025
scan: 130 out of 203 Sun May 25 14:42:41 2025
scan: 140 out of 203 Sun May 25 14:42:42 2025
scan: 150 out of 203 Sun May 25 14:42:42 2025
scan: 160 out of 203 Sun May 25 14:42:42 2025
scan: 170 out of 203 Sun May 25 14:42:43 2025
scan: 180 out of 203 Sun May 25 14:42:43 2025
scan: 190 out of 203 Sun May 25 14:42:43 2025
scan: 200 out of 203 Sun May 25 14:42:44 2025

modis_L1B.py MOD00.P2025145.1750_1.PDS.L1A_LAC MOD00.P2025145.1750_1.PDS.GEO -o MOD00.P2025145.1750_1.PDS.L1B_LAC -q MOD00.P2025145.1750_1.PDS.L1B_QKM -k MOD00.P2025145.1750_1.PDS.L1B_HKM
MODIS Aqua L1B version 6.2.1_obpg, built Aug 16 2019 12:46:19
ERROR: MODIS L1B processing failed.
Please examine the LogStatus and LogUser files for more information.

Failed: 'modis_L1B.py MOD00.P2025145.1750_1.PDS.L1A_LAC MOD00.P2025145.1750_1.PDS.GEO -o MOD00.P2025145.1750_1.PDS.L1B_LAC -q MOD00.P2025145.1750_1.PDS.L1B_QKM -k MOD00.P2025145.1750_1.PDS.L1B_HKM', error 256
## jobid: /tmp/G4hE7Pwo4I
## job status:
terminated by error
exit code 1
completed at Sun May 25 14:42:23 2025
elapsed time 23 seconds

[alaroy]

We ended up upgrading OCSSW from our previous very old version to 2025.V1 at which point the problem went away.

[woodbri]

But I am running on a new install of V2025.1 and I'm getting this issue!
I installed like this:

mkdir -p /u/ocssw
cd /u/ocssw

wget -N https://oceandata.sci.gsfc.nasa.gov/manifest/install_ocssw
wget -N https://oceandata.sci.gsfc.nasa.gov/manifest/manifest.py

chmod +x install_ocssw

#./install_ocssw --install_dir /u/ocssw --tag V2025.1 --update

./install_ocssw --install_dir /u/ocssw --tag V2025.1 --bin --opt --luts --modisa --viirsj1 --viirsj2 --viirsn --common --root --viirsdem --oci

maybe I'm missing a parameter?


cat LogReport.MOD00.P2025146.0900_1.PDS.L1B_LAC

****************************************
BEGIN_PGE: Tue May 27 14:06:31 2025
MSG_TAG: 11
FILE: /data/www/nasa/tmp-708648-1/LogReport.MOD00.P2025146.0900_1.PDS.L1B_LAC
LOGGING: status message logging enabled
TRACE_LEVEL: tracing disabled
PID_LOGGING: disabled
DISABLED_LEVELS: none
DISABLED_SEEDS: none
DISABLED_CODES: none
THREAD-SAFE MODE: disabled
TOOLKIT_VERSION: SCF TK5.2.19
****************************************

Tue May 27 14:06:31 2025

TDLUT_ReadPiecewiseLinearFunction():MODIS_F_NOK:295817224
LUT associated with "m1" has times out of order.

==========================================================

Tue May 27 14:06:31 2025

Read_L1B_SDS_LUT():MODIS_F_NOK:295817224
Call to TDLUT_ReadPiecewiseLinearFunction() failed.

==========================================================

Tue May 27 14:06:31 2025

Read_LUT_Tables():MODIS_F_NOK:295817224
Call to Read_L1B_SDS_LUT() failed.
File LUN: 700050
File type: Reflective_Lookup_Tables_file

==========================================================

Tue May 27 14:06:31 2025

Fatal error(NOK) running...MOD_PR02. TIME:Tue May 27 14:06:31 2025
Operator Actions:
Contact MCST.

==========================================================