Processing Landsat 8 images with L2gen

[aliolive]

Hi,
I am using Ubuntu Virtualbox in Windows as host system, the virtual machine with 100GB HD and 4Gb of RAM.
I have to process images from MODIS Aqua and Landsat 8, so I installed Seadas 7.4 and the OCSSW to MODIS Aqua and OLI.
The l2gen worked fine to MODIS Aqua images, but when I tried to process the OLI MTL.txt file, it didn't work.

I got the following Execution log:

Execution log for
[/home/andrea/seadas-7.4/ocssw/run/scripts/ocssw_runner, --ocsswroot, /home/andrea/seadas-7.4/ocssw, l2gen, par=/home/andrea/Documents/Seadas_training_sea_temperature/Landsat8/tmpParFile5010759599916297524.par]
Input file /home/andrea/Documents/Seadas_training_sea_temperature/Landsat8/LC08_L1TP_218076_20161207_20170317_01_T1_MTL.txt is a Landsat 8 OLI L1B GEOTIFF file.
Loading default parameters from /home/andrea/seadas-7.4/ocssw/run/data/common/msl12_defaults.par
Loading default parameters for OLI from /home/andrea/seadas-7.4/ocssw/run/data/oli/msl12_defaults.par
Loading parameters for suite OC from /home/andrea/seadas-7.4/ocssw/run/data/oli/msl12_defaults_OC.par
Loading command line parameters

Loading user parameters for OLI

Loading characteristics for OLI
Opening sensor information file /home/andrea/seadas-7.4/ocssw/run/data/oli/msl12_sensor_info.dat
  Bnd   Lam       Fo    Tau_r     k_oz    k_no2    t_co2   awhite       aw      bbw
    0  443.000  189.652 2.352e-01 2.929e-03 5.024e-19 1.000e+00 1.000e+00 7.170e-03 2.169e-03
    1  482.000  200.396 1.685e-01 1.957e-02 3.213e-19 1.000e+00 1.000e+00 1.581e-02 1.529e-03
    2  561.000  182.079 9.020e-02 1.038e-01 8.351e-20 1.000e+00 1.000e+00 6.998e-02 8.054e-04
    3  655.000  155.038 4.793e-02 6.200e-02 1.177e-20 1.000e+00 1.000e+00 3.751e-01 4.215e-04
    4  865.000   95.063 1.551e-02 2.223e-03 3.306e-23 1.000e+00 1.000e+00 4.630e+00 1.332e-04
    5 1609.000   24.755 1.284e-03 0.000e+00 0.000e+00 1.000e+00 1.000e+00 7.607e+02 1.052e-05
    6 2201.000    8.546 3.697e-04 0.000e+00 0.000e+00 1.000e+00 1.000e+00 2.250e+03 2.958e-06

Internal data compression requested at compression level: 4
OLI Level-1B /home/andrea/Documents/Seadas_training_sea_temperature/Landsat8/LC08_L1TP_218076_20161207_20170317_01_T1_MTL.txt
OLI Level-1B Band[0]:/home/andrea/Documents/Seadas_training_sea_temperature/Landsat8/LC08_L1TP_218076_20161207_20170317_01_T1_B1.TIF
OLI Level-1B Band[1]:/home/andrea/Documents/Seadas_training_sea_temperature/Landsat8/LC08_L1TP_218076_20161207_20170317_01_T1_B2.TIF
OLI Level-1B Band[2]:/home/andrea/Documents/Seadas_training_sea_temperature/Landsat8/LC08_L1TP_218076_20161207_20170317_01_T1_B3.TIF
OLI Level-1B Band[3]:/home/andrea/Documents/Seadas_training_sea_temperature/Landsat8/LC08_L1TP_218076_20161207_20170317_01_T1_B4.TIF
OLI Level-1B Band[4]:/home/andrea/Documents/Seadas_training_sea_temperature/Landsat8/LC08_L1TP_218076_20161207_20170317_01_T1_B5.TIF
OLI Level-1B Band[5]:/home/andrea/Documents/Seadas_training_sea_temperature/Landsat8/LC08_L1TP_218076_20161207_20170317_01_T1_B6.TIF
OLI Level-1B Band[6]:/home/andrea/Documents/Seadas_training_sea_temperature/Landsat8/LC08_L1TP_218076_20161207_20170317_01_T1_B7.TIF
OLI Level-1B Band[7]:/home/andrea/Documents/Seadas_training_sea_temperature/Landsat8/LC08_L1TP_218076_20161207_20170317_01_T1_B8.TIF
OLI Level-1B Band[8]:/home/andrea/Documents/Seadas_training_sea_temperature/Landsat8/LC08_L1TP_218076_20161207_20170317_01_T1_B9.TIF
OLI Level-1B Band[9]:/home/andrea/Documents/Seadas_training_sea_temperature/Landsat8/LC08_L1TP_218076_20161207_20170317_01_T1_B10.TIF
OLI Level-1B Band[10]:/home/andrea/Documents/Seadas_training_sea_temperature/Landsat8/LC08_L1TP_218076_20161207_20170317_01_T1_B11.TIF
OLI Start Time: 2016-12-07 342 12:58:0.319848
OLI file has 7 bands, 7671 samples, 7761 lines
Allocated 6697047 bytes in L1 record.
Allocated 3252516 bytes in L2 record.

Opening: /home/andrea/Documents/Seadas_training_sea_temperature/Landsat8/L2016342125829.L2_LAC_OC
Reading Thuillier_F0.dat

The following products will be included in /home/andrea/Documents/Seadas_training_sea_temperature/Landsat8/L2016342125829.L2_LAC_OC.
0 aot_865
1 angstrom
2 Rrs_443
3 Rrs_482
4 Rrs_561
5 Rrs_655
6 chlor_a
7 Kd_490
8 l2_flags

Begin l2gen Version 8.10.3-r0 Processing
Sensor is OLI
Sensor ID is 18
Sensor has 7 reflective bands
Sensor has 0 emmissive bands
Number of along-track detectors per band is 1
Number of input pixels per scan is 7671
Processing pixels 1 to 7671 by 1
Processing scans 1 to 7761 by 1
Ocean processing enabled
Land processing enabled
Atmospheric correction enabled

Begin MSl12 processing at 2017083175323000

Allocated 6697047 bytes in L1 record.
Allocated 6697047 bytes in L1 record.
Allocated 6697047 bytes in L1 record.
2017-03-24 17:53:23       7401 /data5/swdev/seadas/build/src/liboli/ias_odl_get_field.c     302  ERROR Input ODL value overflows allocated space
2017-03-24 17:53:23       7401 /data5/swdev/seadas/build/src/liboli/ias_odl_get_field.c     302  ERROR Input ODL value overflows allocated space
2017-03-24 17:53:23       7401 /data5/swdev/seadas/build/src/liboli/ias_odl_get_field.c     302  ERROR Input ODL value overflows allocated space
2017-03-24 17:53:23       7401 /data5/swdev/seadas/build/src/liboli/ias_odl_get_field.c     302  ERROR Input ODL value overflows allocated space
2017-03-24 17:53:23       7401 /data5/swdev/seadas/build/src/liboli/ias_odl_get_field.c     302  ERROR Input ODL value overflows allocated space
2017-03-24 17:53:23       7401 /data5/swdev/seadas/build/src/liboli/ias_odl_get_field.c     302  ERROR Input ODL value overflows allocated space
2017-03-24 17:53:23       7401 /data5/swdev/seadas/build/src/liboli/ias_odl_get_field.c     302  ERROR Input ODL value overflows allocated space
2017-03-24 17:53:23       7401 /data5/swdev/seadas/build/src/liboli/ias_odl_get_field.c     302  ERROR Input ODL value overflows allocated space
2017-03-24 17:53:23       7401 /data5/swdev/seadas/build/src/liboli/ias_odl_get_field.c     302  ERROR Input ODL value overflows allocated space
2017-03-24 17:53:23       7401 /data5/swdev/seadas/build/src/liboli/ias_odl_get_field.c     302  ERROR Input ODL value overflows allocated space
2017-03-24 17:53:23       7401 /data5/swdev/seadas/build/src/liboli/ias_odl_get_field.c     302  ERROR Input ODL value overflows allocated space
Invalid SCA 1 requested.
Error generating LOS vector.
Error projecting scene UL corner to L1T line/sample.
2017-03-24 17:53:23       7401 /data5/swdev/seadas/build/src/liboli/smeta_api.c      46  ERROR Fitting scene frame to product metadata.

2017-03-24 17:53:23       7401 /data5/swdev/seadas/build/src/liboli/get_oli_nom_angles.c      34  ERROR Initializing the metadata file /home/andrea/Documents/Seadas_training_sea_temperature/Landsat8/LC08_L1TP_218076_20161207_20170317_01_T1_MTL.txt.
-E- /data5/swdev/seadas/build/src/liboli/get_oli_nom_angles.c line 37: Initializing the metadata file /home/andrea/Documents/Seadas_training_sea_temperature/Landsat8/LC08_L1TP_218076_20161207_20170317_01_T1_MTL.txt.

[OB.DAACx - SeanBailey]

With the release of Collection 1 the Landsat file format underwent some changes.
The l2gen code currently only supports the "pre-collection" format.  Until we can modify the code to support the Collection 1 changes, you will need to obtain the pre-collection format data for processing with l2gen.

Sean

[aliolive]

Thank you, Sean! Problem solved!
Andrea

[oo_processing]

Sean,

I see from Earth Explorer, that:

"Changes to Pre-Collection datasets:
Effective April 30, 2017, newly-acquired Landsat 7 ETM+ and Landsat 8 OLI/TIRS scenes are being processed into the Landsat Collection 1 inventory only; Landsat Pre-Collection inventory is no longer being populated with newly-acquired data.

Users downloading Landsat Pre-Collection data may experience longer than expected download times.

The Landsat Pre-Collection inventory will no longer be available after October 1, 2017. Users are strongly encouraged to use only Landsat Collection 1 in their applications."

Do you know when the changes will be made to seadas to support this? My NRT processing of Landsat data has ground to a halt.
Thanks,
Brock

[OB.DAACx - SeanBailey]

Yes, we are aware and will eventually release the fix...Sooner than later, but I don't have a firm date.
Sean

[oo_processing]

Sean,
Any luck on determining a date for this fix?
There is a firm date as to when the older data format will disappear, and only the new format will exist :eek: . And of course as you know, anything produced in the last couple of months is in the new format only.
Cheers,
Brock

[OB.DAACx - SeanBailey]

Not really.  We are planning a release of SeaDAS this summer to finally include processing support under Windows.
The OCSSW update will likely coincide with that release.

Sean

[dlewis]

The installed SeaDAS 7.4 responds with a "No appropriate reader found for: *MTL.txt" when I feed it a collection 1 OLI file.
Is there any update on when the capability to process these OLI collection 1 files will be available?
David Lewis

[OB SeaDAS - dshea]

We are in the final testing phase for SeaDAS 7.5 which will be able to read the new OLI format.  Sorry I can't give you an exact target date, but we are close.

don

[alicealo]

Hello everyone,

I am willing to process a Landsat 8 OLI image with l2gen for atmospheric correction. If I understand properly from these posts:
-  l2gen does not work with Collection 1 images in Seadas 7.4;
- However, Landsat 8 Pre-Collection images are not longer available for download from Earth Explorer; and
- SeaDAS 7.5 - which will be compatible with Collection 1 images -  is underway but no ready yet.

I am new to SeaDAS and data correction in general, so I am hoping I am missing something and there any way to work around that until SeaDAS 7.5 is ready for release. Any help / recommendation would be much appreciated!

Thank you!
Best,
Alice