Page 1 of 1

Problems of Landsat-8 image processing with ocssw

Posted: Thu Nov 07, 2024 11:18 am America/New_York
by jmen
Hi everyone,

Recently, I would like to do atmospheric correction for landsat-8 OLI images. I used WSL2 + Ubuntu 24.04.1 + SeaDAS 9.1 + ocssw V2024.1.

# PRIMARY INPUT OUTPUT FIELDS
ifile=/home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LC08_L1TP_021037_20231223_20240103_02_T1_MTL.txt
ofile=/home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LANDSAT8_OLI.20231223T162520.L2.OC.nc

# SUITE
suite=OC

# ANCILLARY INPUTS Default = climatology (select 'Get Ancillary' to download ancillary files)

l2prod: angstrom aot_865 chlor_a Kd_490 Rrs_vvv

I fail to obtain valid OLI Rrs and the l2gen shows:
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
execution exception: java.io.IOException: l2gen failed with exit code 139.
Check log for more details.
Loading default parameters from /home/jilinmen/SeaDAS-9.1/ocssw/share/common/msl12_defaults.par
Input file /home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LC08_L1TP_021037_20231223_20240103_02_T1_MTL.txt is a Landsat 8/9 OLI L1B GEOTIFF file.

Loading characteristics for OLIL8
Opening sensor information file /home/jilinmen/SeaDAS-9.1/ocssw/share/oli/msl12_sensor_info.dat
Bnd Lam Fo Tau_r k_oz k_no2 t_co2 awhite aw bbw
0 443.000 189.652 2.352e-01 2.929e-03 5.024e-19 1.000e+00 1.000e+00 7.170e-03 2.169e-03
1 482.000 200.396 1.685e-01 1.957e-02 3.213e-19 1.000e+00 1.000e+00 1.581e-02 1.529e-03
2 561.000 182.079 9.020e-02 1.038e-01 8.351e-20 1.000e+00 1.000e+00 6.998e-02 8.054e-04
3 655.000 155.038 4.793e-02 6.200e-02 1.177e-20 1.000e+00 1.000e+00 3.751e-01 4.215e-04
4 865.000 95.063 1.551e-02 2.223e-03 3.306e-23 1.000e+00 1.000e+00 4.630e+00 1.332e-04
5 1609.000 24.755 1.284e-03 0.000e+00 0.000e+00 1.000e+00 1.000e+00 7.607e+02 1.052e-05
6 2201.000 8.546 3.697e-04 0.000e+00 0.000e+00 1.000e+00 1.000e+00 2.250e+03 2.958e-06


Loading default parameters for OLIL8 from /home/jilinmen/SeaDAS-9.1/ocssw/share/oli/msl12_defaults.par
Loading default sub-sensor parameters for OLIL8 from /home/jilinmen/SeaDAS-9.1/ocssw/share/oli/l8/msl12_defaults.par
Loading parameters for suite OC from /home/jilinmen/SeaDAS-9.1/ocssw/share/oli/msl12_defaults_OC.par
Loading command line parameters

Loading user parameters for OLIL8

Internal data compression requested at compression level: 4
Reading Thuillier_F0.dat
OLI Level-1B /home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LC08_L1TP_021037_20231223_20240103_02_T1_MTL.txt
OLI Level-1B Collection 2
OLI Level-1B Band[0]:/home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LC08_L1TP_021037_20231223_20240103_02_T1_B1.TIF
TIFFReadDirectory: Warning, Unknown field with tag 42113 (0xa481) encountered.
OLI Level-1B Band[1]:/home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LC08_L1TP_021037_20231223_20240103_02_T1_B2.TIF
TIFFReadDirectory: Warning, Unknown field with tag 42113 (0xa481) encountered.
OLI Level-1B Band[2]:/home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LC08_L1TP_021037_20231223_20240103_02_T1_B3.TIF
TIFFReadDirectory: Warning, Unknown field with tag 42113 (0xa481) encountered.
OLI Level-1B Band[3]:/home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LC08_L1TP_021037_20231223_20240103_02_T1_B4.TIF
TIFFReadDirectory: Warning, Unknown field with tag 42113 (0xa481) encountered.
OLI Level-1B Band[4]:/home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LC08_L1TP_021037_20231223_20240103_02_T1_B5.TIF
TIFFReadDirectory: Warning, Unknown field with tag 42113 (0xa481) encountered.
OLI Level-1B Band[5]:/home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LC08_L1TP_021037_20231223_20240103_02_T1_B6.TIF
TIFFReadDirectory: Warning, Unknown field with tag 42113 (0xa481) encountered.
OLI Level-1B Band[6]:/home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LC08_L1TP_021037_20231223_20240103_02_T1_B7.TIF
TIFFReadDirectory: Warning, Unknown field with tag 42113 (0xa481) encountered.
OLI Level-1B Band[8]:/home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LC08_L1TP_021037_20231223_20240103_02_T1_B9.TIF
TIFFReadDirectory: Warning, Unknown field with tag 42113 (0xa481) encountered.
OLI Level-1B Angle File:/home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LC08_L1TP_021037_20231223_20240103_02_T1_ANG.txt
OLI Level-1B Band[0]:/home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LC08_L1TP_021037_20231223_20240103_02_T1_B1.TIF
OLI Level-1B Band[1]:/home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LC08_L1TP_021037_20231223_20240103_02_T1_B2.TIF
TIFFReadDirectory: Warning, Unknown field with tag 42113 (0xa481) encountered.
OLI Level-1B Band[2]:/home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LC08_L1TP_021037_20231223_20240103_02_T1_B3.TIF
TIFFReadDirectory: Warning, Unknown field with tag 42113 (0xa481) encountered.
TIFFReadDirectory: Warning, Unknown field with tag 42113 (0xa481) encountered.
OLI Level-1B Band[3]:/home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LC08_L1TP_021037_20231223_20240103_02_T1_B4.TIF
OLI Level-1B Band[4]:/home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LC08_L1TP_021037_20231223_20240103_02_T1_B5.TIF
TIFFReadDirectory: Warning, Unknown field with tag 42113 (0xa481) encountered.
TIFFReadDirectory: Warning, Unknown field with tag 42113 (0xa481) encountered.
OLI Level-1B Band[5]:/home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LC08_L1TP_021037_20231223_20240103_02_T1_B6.TIF
TIFFReadDirectory: Warning, Unknown field with tag 42113 (0xa481) encountered.
TIFFReadDirectory: Warning, Unknown field with tag 42113 (0xa481) encountered.
OLI Level-1B Band[6]:/home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LC08_L1TP_021037_20231223_20240103_02_T1_B7.TIF
OLI Level-1B Band[8]:/home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LC08_L1TP_021037_20231223_20240103_02_T1_B9.TIF
TIFFReadDirectory: Warning, Unknown field with tag 42113 (0xa481) encountered.
OLI Start Time: 2023-12-23 357 16:25:20.459469
OLI file has 7 bands, 7721 samples, 7851 lines
Allocated 6570599 bytes in L1 record.
Allocated 2316300 bytes in L2 record.

Opening: /home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LANDSAT8_OLI.20231223T162520.L2.OC.nc


The following products will be included in /home/jilinmen/test/LC08_L1TP_021037_20231223_20240103_02_T1/LANDSAT8_OLI.20231223T162520.L2.OC.nc.
0 aot_865
1 angstrom
2 Rrs_443
3 Rrs_482
4 Rrs_561
5 Rrs_655
6 chlor_a
7 Kd_490
8 l2_flags



Begin l2gen Version 9.7.0-V2024.1 Processing
Sensor is OLIL8
Sensor ID is 15
Sensor has 7 reflective bands
Sensor has 0 emissive bands
Number of along-track detectors per band is 1
Number of input pixels per scan is 7721
Processing pixels 1 to 7721 by 1
Processing scans 1 to 7851 by 1
Ocean processing enabled
Land processing enabled
Atmospheric correction enabled

Begin MSl12 processing at 2024312100020000

Allocated 6570599 bytes in L1 record.
Allocated 6570599 bytes in L1 record.
Allocated 6570599 bytes in L1 record.
/home/jilinmen/SeaDAS-9.1/ocssw/bin/ocssw_runner: line 23: 5130 Segmentation fault (core dumped) $*
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------

***The system information is as follows:***
-----------------------------------------------------------
Main Application Platform:
-----------------------------------------------------------
Application Version: SeaDAS 9.1.0
SNAP Engine Version: 11.0.0.0* (SeaDAS Platform modified)
SNAP Desktop Version: 11.0.0.0* (SeaDAS Platform modified)
SNAP Engine Build Date: 202410022358
SNAP Desktop Build Date: 202410030002
Installation Directory: /home/jilinmen/SeaDAS-9.1
Data Directory: /home/jilinmen/.seadas9
Configuration: /home/jilinmen/SeaDAS-9.1/etc/snap.properties
VM Configuration: /home/jilinmen/SeaDAS-9.1/etc/seadas.conf
VM Configuration: /home/jilinmen/SeaDAS-9.1/etc/snap.conf
VM Configuration (gpt): /home/jilinmen/SeaDAS-9.1/bin/gpt.vmoptions
VM Configuration (pconvert): /home/jilinmen/SeaDAS-9.1/bin/pconvert.vmoptions
Runtime Configuration: /home/jilinmen/.seadas9/etc/snap.properties
Runtime Configuration (SeaDAS Toolbox): /home/jilinmen/.seadas9/etc/seadas.properties
JRE: OpenJDK Runtime Environment 11.0.19+7
JVM: OpenJDK 64-Bit Server VM by Eclipse Adoptium
Memory: 4096 MiB
OCSSWROOT (Environment Variable): null
Python3 Version: Python 3.12.4 | packaged by Anaconda, Inc. | (main, Jun 18 2024, 15:12:24) [GCC 11.2.0]
Python3 Directory: /home/jilinmen/anaconda3/bin/python3
Python3 Requests Installed: YES
Earthdata Netrc Entry: YES


-----------------------------------------------------------
SeaDAS Toolbox:
-----------------------------------------------------------
SeaDAS Toolbox Version: 2.1.0
SeaDAS Toolbox Build Date: 202410030012
Configuration: /home/jilinmen/.seadas9/etc/seadas.properties
OCSSW Location: local
[OCSSW-Local] Root Directory: /home/jilinmen/SeaDAS-9.1/ocssw
[OCSSW-Local] Python3 Version: Python 3.12.4 | packaged by Anaconda, Inc. | (main, Jun 18 2024, 15:12:24) [GCC 11.2.0]
[OCSSW-Local] Python3 Directory: /home/jilinmen/anaconda3/bin/python3
[OCSSW-Local] Python3 Requests Installed: YES
[OCSSW-Local] Earthdata Netrc Entry: YES
[OCSSW-Local] Log Directory: /home/jilinmen


-----------------------------------------------------------
NASA Science Processing (OCSSW):
-----------------------------------------------------------
OCSSWROOT=/home/jilinmen/SeaDAS-9.1/ocssw
OCDATAROOT=/home/jilinmen/SeaDAS-9.1/ocssw/share
l2gen version: msl12 9.7.0-V2024.1 (Jul 17 2024 13:15:09)
l2bin version: 7.0.7
l3bin version: 5.14
l3mapgen version: l3mapgen 2.4.0-V2024.1 (Jul 17 2024 13:14:38)
Installed Missions: ['olil8', 'viirsdem']


-----------------------------------------------------------
General System and Software:
-----------------------------------------------------------
Operating system: Ubuntu 24.04.1 LTS
Java version: 1.8.0_431
Python3 version: 3.12.4 (part of an Anaconda installation)
Python3 Path: /home/jilinmen/anaconda3/bin/python3
Env:
CC=gcc
CXX=g++
ELEMENTS=/home/jilinmen/SeaDAS-9.1/ocssw/var/seawifs
EOS_LIB_PREFIX=linux64
FC=gfortran
GCC_TUNE=
HDFEOS_LIB=/home/jilinmen/SeaDAS-9.1/ocssw/opt/EOS/lib/linux64
HRPT_STATION_IDENTIFICATION_FILE=/home/jilinmen/SeaDAS-9.1/ocssw/share/seawifs/station/station_id.dat
L2GEN_ANC=/home/jilinmen/SeaDAS-9.1/ocssw/var/anc
LIB3_BIN=/home/jilinmen/SeaDAS-9.1/ocssw/opt/bin
LIB3_CHECK=0
LIB3_DIR=/home/jilinmen/SeaDAS-9.1/ocssw/opt
LIB3_INC=/home/jilinmen/SeaDAS-9.1/ocssw/opt/include
LIB3_LIB=/home/jilinmen/SeaDAS-9.1/ocssw/opt/lib
NAVCTL=/home/jilinmen/SeaDAS-9.1/ocssw/share/seawifs/nav
NAVQC=/home/jilinmen/SeaDAS-9.1/ocssw/share/seawifs/nav
OCSSW_ARCH=linux_64
OCSSW_BIN=/home/jilinmen/SeaDAS-9.1/ocssw/bin
OCSSW_DEBUG=0
OCSSW_MODIS=1
OCTS_REGISTRATION_TABLES=/home/jilinmen/SeaDAS-9.1/ocssw/share/octs/nav
OCVARROOT=/home/jilinmen/SeaDAS-9.1/ocssw/var
ORBCTL=/home/jilinmen/SeaDAS-9.1/ocssw/share/seawifs/nav
PGSINC=/home/jilinmen/SeaDAS-9.1/ocssw/opt/EOS/include
PGSLIB=/home/jilinmen/SeaDAS-9.1/ocssw/opt/EOS/lib/linux64
PROJ_DATA=/home/jilinmen/SeaDAS-9.1/ocssw/opt/share/proj
PROJ_LIB=/home/jilinmen/SeaDAS-9.1/ocssw/opt/share/proj
SWFTBL=/home/jilinmen/SeaDAS-9.1/ocssw/share/seawifs/qc
SWTBL=/home/jilinmen/SeaDAS-9.1/ocssw/share/seawifs


Any suggestions would be appreciated!

Sincerely,
Jilin

Re: Problems of Landsat-8 image processing with ocssw

Posted: Tue Nov 12, 2024 6:58 pm America/New_York
by oo_processing
We are also working to get some Landsat-8 data. It seems the OLI processor didn't get enough love. You should install an older version of OCSSW. The V2022.2 works for us.
See this old thread viewtopic.php?t=4788#p16904
Good luck!
Yuyuan