Problem processing VIIRS data

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
woodbri
Posts: 79
Joined: Thu Jun 04, 2015 10:50 am America/New_York
Answers: 0
Has endorsed: 7 times
Endorsed: 2 times

Problem processing VIIRS data

by woodbri » Sat Jun 15, 2024 2:28 pm America/New_York

I've been processing various VIIRS datasets successfully for some time but a while back the processing failed. I've been trying to get this working again.

The old processing was based on the following software downloads.

Code: Select all

#!/bin/sh

mkdir -p /u/oceandata
cd /u/oceandata

wget -N https://oceandata.sci.gsfc.nasa.gov/ocssw/install_ocssw.py
chmod +x install_ocssw.py

./install_ocssw.py -v --install-dir=/u/oceandata  --git-branch=v7.5 --arch=linux_64 --aqua --avhrr --terra --viirsn --viirsj1 --viirsdem --src

I seemed to be failing because of an issue with LUTs. In reading the forum, I got the idea that I needed to update to a new TAG like T2024.20 so I installed:

Code: Select all

mkdir -p /u/ocssw
cd /u/ocssw

wget https://oceandata.sci.gsfc.nasa.gov/manifest/install_ocssw
wget https://oceandata.sci.gsfc.nasa.gov/manifest/manifest.py

chmod +x install_ocssw

./install_ocssw --install_dir /u/ocssw --tag T2024.20 --bin --opt --luts --modisa --viirsj1 --viirsj2 --viirsn --common --root --viirsdem
One issue I had with this was l2bin average=area does not seem to be supported any more. I removed it, but wonder if I should be doing something else to get the same effect.

Now I get:

Code: Select all

-E- Invalid argument "geo1"
   geo1 (string) (current=/u/ocssw/var/anc/2024/166/JPSS1_VIIRS.20240614T160000.GEO.nc) (source=JPSS1_VIIRS.20240614T160000.L1A.nc.anc)
Here is the more complete run log:

Code: Select all

l2gen ifile=JPSS1_VIIRS.20240614T160000.L1A.nc geofile=JPSS1_VIIRS.20240614T160000.GEO.nc ofile=JPSS1_VIIRS.20240614T160000.chl.L2.nc suite=OC l2prod=chlor_a,Kd_490 par=JPSS1_VIIRS.20240614T160000.L1A.nc.anc resolution=375
Loading default parameters from /u/ocssw/share/common/msl12_defaults.par
Input file JPSS1_VIIRS.20240614T160000.L1A.nc is VIIRS JPSS-1 L1A NetCDF4.

Loading characteristics for VIIRSJ1
Opening sensor information file /u/ocssw/share/viirs/j1/msl12_sensor_info.dat
  Bnd   Lam       Fo    Tau_r     k_oz    k_no2    t_co2   awhite       aw      bbw
    0  411.000  172.571 3.210e-01 2.618e-04 6.006e-19 1.000e+00 1.000e+00 1.169e-02 2.984e-03
    1  445.000  192.488 2.312e-01 3.220e-03 4.932e-19 1.000e+00 1.000e+00 1.833e-02 2.131e-03
    2  489.000  197.681 1.573e-01 2.129e-02 2.886e-19 1.000e+00 1.000e+00 2.174e-02 1.428e-03
    3  556.000  182.765 9.252e-02 9.965e-02 8.767e-20 1.000e+00 1.000e+00 7.367e-02 8.275e-04
    4  667.000  151.106 4.420e-02 4.771e-02 8.008e-21 1.000e+00 8.871e-01 4.505e-01 3.883e-04
    5  746.000  127.525 2.815e-02 1.083e-02 1.820e-21 1.000e+00 7.872e-01 2.833e+00 2.447e-04
    6  868.000   94.945 1.533e-02 2.062e-03 6.223e-23 1.000e+00 6.486e-01 4.768e+00 1.315e-04
    7 1238.000   45.609 3.650e-03 3.897e-14 0.000e+00 9.994e-01 0.000e+00 1.359e+02 3.044e-05
    8 1604.000   24.974 1.296e-03 2.357e-14 0.000e+00 9.890e-01 0.000e+00 7.720e+02 1.063e-05
    9 2258.000    7.711 3.285e-04 1.388e-13 0.000e+00 9.696e-01 0.000e+00 2.197e+03 2.648e-06

  Bnd   Lam
   10 3700.000
   11 4050.000
   12 8550.000
   13 10763.000
   14 12013.000

Loading default parameters for VIIRSJ1 from /u/ocssw/share/viirs/msl12_defaults.par
Loading default sub-sensor parameters for VIIRSJ1 from /u/ocssw/share/viirs/j1/msl12_defaults.par
Loading parameters for suite OC from /u/ocssw/share/viirs/msl12_defaults_OC.par
Loading parameters for suite OC from /u/ocssw/share/viirs/j1/msl12_defaults_OC.par
Loading command line parameters

Loading user parameters for VIIRSJ1

-E- Invalid argument "geo1"
   geo1 (string) (current=/u/ocssw/var/anc/2024/166/JPSS1_VIIRS.20240614T160000.GEO.nc) (source=JPSS1_VIIRS.20240614T160000.L1A.nc.anc)

-------------------------------------------------

l2gen ifile=JPSS1_VIIRS.20240614T160000.L1A.nc geofile=JPSS1_VIIRS.20240614T160000.GEO.nc ofile=JPSS1_VIIRS.20240614T160000.tc.L2.nc suite=OC l2prod=rhos_vvv par=JPSS1_VIIRS.20240614T160000.L1A.nc.anc resolution=375
Loading default parameters from /u/ocssw/share/common/msl12_defaults.par
Input file JPSS1_VIIRS.20240614T160000.L1A.nc is VIIRS JPSS-1 L1A NetCDF4.

Loading characteristics for VIIRSJ1
Opening sensor information file /u/ocssw/share/viirs/j1/msl12_sensor_info.dat
  Bnd   Lam       Fo    Tau_r     k_oz    k_no2    t_co2   awhite       aw      bbw
    0  411.000  172.571 3.210e-01 2.618e-04 6.006e-19 1.000e+00 1.000e+00 1.169e-02 2.984e-03
    1  445.000  192.488 2.312e-01 3.220e-03 4.932e-19 1.000e+00 1.000e+00 1.833e-02 2.131e-03
    2  489.000  197.681 1.573e-01 2.129e-02 2.886e-19 1.000e+00 1.000e+00 2.174e-02 1.428e-03
    3  556.000  182.765 9.252e-02 9.965e-02 8.767e-20 1.000e+00 1.000e+00 7.367e-02 8.275e-04
    4  667.000  151.106 4.420e-02 4.771e-02 8.008e-21 1.000e+00 8.871e-01 4.505e-01 3.883e-04
    5  746.000  127.525 2.815e-02 1.083e-02 1.820e-21 1.000e+00 7.872e-01 2.833e+00 2.447e-04
    6  868.000   94.945 1.533e-02 2.062e-03 6.223e-23 1.000e+00 6.486e-01 4.768e+00 1.315e-04
    7 1238.000   45.609 3.650e-03 3.897e-14 0.000e+00 9.994e-01 0.000e+00 1.359e+02 3.044e-05
    8 1604.000   24.974 1.296e-03 2.357e-14 0.000e+00 9.890e-01 0.000e+00 7.720e+02 1.063e-05
    9 2258.000    7.711 3.285e-04 1.388e-13 0.000e+00 9.696e-01 0.000e+00 2.197e+03 2.648e-06

  Bnd   Lam
   10 3700.000
   11 4050.000
   12 8550.000
   13 10763.000
   14 12013.000

Loading default parameters for VIIRSJ1 from /u/ocssw/share/viirs/msl12_defaults.par
Loading default sub-sensor parameters for VIIRSJ1 from /u/ocssw/share/viirs/j1/msl12_defaults.par
Loading parameters for suite OC from /u/ocssw/share/viirs/msl12_defaults_OC.par
Loading parameters for suite OC from /u/ocssw/share/viirs/j1/msl12_defaults_OC.par
Loading command line parameters

Loading user parameters for VIIRSJ1

-E- Invalid argument "geo1"
   geo1 (string) (current=/u/ocssw/var/anc/2024/166/JPSS1_VIIRS.20240614T160000.GEO.nc) (source=JPSS1_VIIRS.20240614T160000.L1A.nc.anc)
Failed: 'l2gen ifile=JPSS1_VIIRS.20240614T160000.L1A.nc geofile=JPSS1_VIIRS.20240614T160000.GEO.nc ofile=JPSS1_VIIRS.20240614T160000.tc.L2.nc suite=OC l2prod=rhos_vvv par=JPSS1_VIIRS.20240614T160000.L1A.nc.anc resolution=375', error 256Failed: 'l2gen ifile=JPSS1_VIIRS.20240614T160000.L1A.nc geofile=JPSS1_VIIRS.20240614T160000.GEO.nc ofile=JPSS1_VIIRS.20240614T160000.chl.L2.nc suite=OC l2prod=chlor_a,Kd_490 par=JPSS1_VIIRS.20240614T160000.L1A.nc.anc resolution=375', error 256Error: The fileError: The fileJPSS1_VIIRS.20240614T160000.tc.L2.ncJPSS1_VIIRS.20240614T160000.chl.L2.nccould not be read.could not be read.


-------------------------------------------------

l2bin suite=SFREFL ifile=JPSS1_VIIRS.20240614T160000.tc.L2.nc ofile=JPSS1_VIIRS.20240614T160000.tc.L3b.nc resolution=Q  l3bprod=rhos_489,rhos_556,rhos_667
l2bin 7.0.7 (Jun  6 2024 21:11:35)


-------------------------------------------------

l2bin prodtype=regional ofile=JPSS1_VIIRS.20240614T160000.chl.L3b.nc infile=JPSS1_VIIRS.20240614T160000.chl.L2.nc resolution=Q  l3bprod=chlor_a,Kd_490
l2bin 7.0.7 (Jun  6 2024 21:11:35)

Failed: 'l2bin suite=SFREFL ifile=JPSS1_VIIRS.20240614T160000.tc.L2.nc ofile=JPSS1_VIIRS.20240614T160000.tc.L3b.nc resolution=Q  l3bprod=rhos_489,rhos_556,rhos_667', error 256Failed: 'l2bin prodtype=regional ofile=JPSS1_VIIRS.20240614T160000.chl.L3b.nc infile=JPSS1_VIIRS.20240614T160000.chl.L2.nc resolution=Q  l3bprod=chlor_a,Kd_490', error 256
-------------------------------------------------
...
Would appreciate some guidance on how to proceed.

Filters:

woodbri
Posts: 79
Joined: Thu Jun 04, 2015 10:50 am America/New_York
Answers: 0
Has endorsed: 7 times
Endorsed: 2 times

Re: Problem processing VIIRS data

by woodbri » Wed Jun 19, 2024 10:23 pm America/New_York

Based on this thread:
[viewtopic.php?t=2978]

I changed
par=
to
parfile=
and this seems to resolve the
geo1
related issue.

Post Reply