Page 1 of 1

Ancillary data in SeaDAS v7.5 for MODIS-Aqua processing

Posted: Sat May 12, 2018 1:36 am America/New_York
by rakeshs
Hello,
I've installed SeaDAS v7.5 and facing the following issue.

I'm getting this error in l2gen

-E- $OCSSWROOT/ocssw-src/src/l2gen/ice_mask.c line 223: File, "", doesn't follow naming convention described at http://nsidc.org/data/docs/daac/nsidc0051_gsfc_seaice.gd.html#namingconvention

And if I don't give ancillary data it ends up like
"Skipping ancillary retrieval for scan #### - entire scan invalid"

Can anybody help me with this?

Thanks,
Rakesh

Ancillary data in SeaDAS v7.5 for MODIS-Aqua processing

Posted: Sat May 12, 2018 12:17 pm America/New_York
by melliott
Just using some random data files, I've not been able to reproduce this. What was your input file?

Ancillary data in SeaDAS v7.5 for MODIS-Aqua processing

Posted: Sun May 13, 2018 12:04 am America/New_York
by rakeshs
Hello Melliott,

Here is the command:
l2gen ifile=A2009155084000.L1B_LAC geofile=A2009155084000.GEO ofile=A2009155084000.L2_LAC spixl=500 epixl=1000 sline=1000 eline=2000 l2prod=nLw_vvv par=A2009155084000.L1B_LAC.anc

Here is the output:
Input file A2009155084000.L1B_LAC is MODIS Aqua Level-1B HDF-EOS product.
Loading default parameters from /home/rakesh/SeaDAS/ocssw/share/common/msl12_defaults.par
Loading default parameters for MODISA from /home/rakesh/SeaDAS/ocssw/share/modis/msl12_defaults.par
Loading default sub-sensor parameters for MODISA from /home/rakesh/SeaDAS/ocssw/share/modis/aqua/msl12_defaults.par
Loading parameters for suite OC from /home/rakesh/SeaDAS/ocssw/share/modis/msl12_defaults_OC.par
Loading command line parameters

Loading user parameters for MODISA

Loading characteristics for MODISA
Opening sensor information file /home/rakesh/SeaDAS/ocssw/share/modis/aqua/msl12_sensor_info.dat
  Bnd   Lam       Fo    Tau_r     k_oz    k_no2    t_co2   awhite       aw      bbw
    0  412.000  172.912 3.099e-01 1.987e-03 5.814e-19 1.000e+00 1.000e+00 2.030e-02 2.884e-03
    1  443.000  187.622 2.367e-01 3.189e-03 4.985e-19 1.000e+00 1.000e+00 1.110e-02 2.181e-03
    2  469.000  205.878 1.914e-01 8.745e-03 3.938e-19 1.000e+00 1.000e+00 1.034e-02 1.749e-03
    3  488.000  194.933 1.592e-01 2.032e-02 2.878e-19 1.000e+00 1.000e+00 1.676e-02 1.447e-03
    4  531.000  185.747 1.126e-01 6.838e-02 1.525e-19 1.000e+00 1.000e+00 4.494e-02 1.014e-03
    5  547.000  186.539 9.906e-02 8.622e-02 1.194e-19 1.000e+00 1.000e+00 5.491e-02 8.886e-04
    6  555.000  183.869 9.432e-02 9.553e-02 9.445e-20 1.000e+00 1.000e+00 5.839e-02 8.443e-04
    7  645.000  157.811 5.082e-02 7.382e-02 1.382e-20 1.000e+00 9.133e-01 3.458e-01 4.469e-04
    8  667.000  152.255 4.443e-02 4.890e-02 7.065e-21 1.000e+00 8.921e-01 4.923e-01 3.900e-04
    9  678.000  148.052 4.146e-02 3.787e-02 8.304e-21 1.000e+00 8.783e-01 5.116e-01 3.634e-04
   10  748.000  128.065 2.849e-02 1.235e-02 2.157e-21 1.000e+00 7.832e-01 2.800e+00 2.470e-04
   11  859.000   97.174 1.613e-02 2.347e-03 6.212e-23 1.000e+00 6.519e-01 4.396e+00 1.384e-04
   12  869.000   95.824 1.540e-02 1.936e-03 7.872e-23 1.000e+00 6.403e-01 4.727e+00 1.320e-04
   13 1240.000   45.467 3.617e-03 0.000e+00 0.000e+00 9.994e-01 0.000e+00 1.147e+02 3.021e-05
   14 1640.000   23.977 1.219e-03 0.000e+00 0.000e+00 9.890e-01 0.000e+00 6.689e+02 1.000e-05
   15 2130.000    9.885 4.286e-04 0.000e+00 0.000e+00 9.696e-01 0.000e+00 2.810e+03 3.465e-06

  Bnd   Lam
   16 3750.000
   17 3959.000
   18 4050.000
   19 6715.000
   20 7325.000
   21 8550.000
   22 11000.000
   23 12000.000

Internal data compression requested at compression level: 4
Opening filter file /home/rakesh/SeaDAS/ocssw/share/modis/msl12_filter.dat
Setting 7 x 5 straylight filter on HILT mask

Filter Kernel
1 1 1 1 1 1 1
1 1 1 1 1 1 1
1 1 1 1 1 1 1
1 1 1 1 1 1 1
1 1 1 1 1 1 1

Minimum fill set to 1 pixels

Setting 7 x 5 straylight filter on CLDICE mask

Filter Kernel
1 1 1 1 1 1 1
1 1 1 1 1 1 1
1 1 1 1 1 1 1
1 1 1 1 1 1 1
1 1 1 1 1 1 1

Minimum fill set to 1 pixels

Reading Thuillier_F0.dat
Processing at 1000 meter resolution.
    1000-meter file: A2009155084000.L1B_LAC

Allocated 2343838 bytes in L1 record.
Allocated 920720 bytes in L2 record.

Opening: A2009155084000.L2_LAC

The following products will be included in A2009155084000.L2_LAC.
0 nLw_412
1 nLw_443
2 nLw_469
3 nLw_488
4 nLw_531
5 nLw_547
6 nLw_555
7 nLw_645
8 nLw_667
9 nLw_678
10 l2_flags

Begin l2gen Version 9.3.0-V2018.0.15 Processing
Sensor is MODISA
Sensor ID is 7
Sensor has 16 reflective bands
Sensor has 8 emissive bands
Number of along-track detectors per band is 10
Number of input pixels per scan is 1354
Processing pixels 500 to 1000 by 1
Processing scans 1000 to 2000 by 1
Ocean processing enabled
Land processing enabled
Atmospheric correction enabled

Begin MSl12 processing at 2018133093125000

Allocated 2343838 bytes in L1 record.
Allocated 2343838 bytes in L1 record.
Allocated 2343838 bytes in L1 record.
Allocated 2343838 bytes in L1 record.
Allocated 2343838 bytes in L1 record.
Loading radiance to brightness temperature from /home/rakesh/SeaDAS/ocssw/share/modis/aqua/cal/bt_modisa.hdf
Loading land mask file from /home/rakesh/SeaDAS/ocssw/share/common/landmask_GMT15ARC.nc
Loading bathymetry mask file from /home/rakesh/SeaDAS/ocssw/share/common/watermask.dat
Loading ice mask file from /home/rakesh/SeaDAS/ocssw/var/anc/2009/155/N200915500_SEAICE_NSIDC_24h.hdf
Loaded near real time NSIDC ice HDF file.
Loading elevation file from /home/rakesh/SeaDAS/ocssw/share/common/ETOPO1_ocssw.nc
Loading XCAL rvs and polarization sensitivities from /home/rakesh/SeaDAS/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.12d_412.hdf
Loading XCAL rvs and polarization sensitivities from /home/rakesh/SeaDAS/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.12d_443.hdf
Loading XCAL rvs and polarization sensitivities from /home/rakesh/SeaDAS/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.12d_469.hdf
Loading XCAL rvs and polarization sensitivities from /home/rakesh/SeaDAS/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.12d_488.hdf
Loading XCAL rvs and polarization sensitivities from /home/rakesh/SeaDAS/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.12d_531.hdf
Loading XCAL rvs and polarization sensitivities from /home/rakesh/SeaDAS/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.12d_547.hdf
Loading XCAL rvs and polarization sensitivities from /home/rakesh/SeaDAS/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.12d_555.hdf
Loading XCAL rvs and polarization sensitivities from /home/rakesh/SeaDAS/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.12d_645.hdf
Loading XCAL rvs and polarization sensitivities from /home/rakesh/SeaDAS/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.12d_667.hdf
Loading XCAL rvs and polarization sensitivities from /home/rakesh/SeaDAS/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.12d_678.hdf
Loading XCAL rvs and polarization sensitivities from /home/rakesh/SeaDAS/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.12d_748.hdf
Loading XCAL rvs and polarization sensitivities from /home/rakesh/SeaDAS/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.12d_869.hdf
Loading climatology file /home/rakesh/SeaDAS/ocssw/share/common/sst_climatology.hdf
Loading Daily V2 0.25-deg OI Reynolds SST reference from /home/rakesh/SeaDAS/ocssw/var/anc/2009/155/N2009155_SST_OIV2AVAM_24h.nc

Loading SSS reference from Climatology file: /home/rakesh/SeaDAS/ocssw/share/common/sss_climatology_woa2009.hdf

Skipping ancillary retrieval for scan 999 - entire scan invalid

Using  869.0 nm channel for cloud flagging over water.
Using  412.0 nm channel for cloud flagging over land.

Skipping ancillary retrieval for scan 999 - entire scan invalid
Skipping ancillary retrieval for scan 999 - entire scan invalid
Skipping ancillary retrieval for scan 1000 - entire scan invalid
Skipping ancillary retrieval for scan 1001 - entire scan invalid
Processing scan #   999 (1 of 1001) after      0 seconds

Loading SSES table from /home/rakesh/SeaDAS/ocssw/share/modis/aqua/cal/sst_sses_modisa.v6.3.2.gt100counts.hdf

Loading SSES table from /home/rakesh/SeaDAS/ocssw/share/modis/aqua/cal/sst4_sses_modisa.v6.3.2.gt100counts.hdf
  looking for month 6 mission AQUA
Loading SST4 lat band coefficients from /home/rakesh/SeaDAS/ocssw/share/modis/aqua/cal/AQUA_collection_6_SST4_latband1_coeffs_v6.3.txt:
6  -90.0  -40.0   0.83954412   1.01336634   0.48449111   2.06650734   0.00000000  -0.00015458  -0.00021437
6  -40.0  -20.0   0.52161992   1.02287006   0.55941284   2.33219862   0.00000000  -0.00005998  -0.00024794
6  -20.0    0.0   0.27888691   1.05774128   0.30395690   2.88050127   0.00852535   0.00018723  -0.00019743
6    0.0   20.0   0.65785897   1.04832208   0.28724673   2.75032473   0.00908989   0.00000000  -0.00013969
6   20.0   40.0   0.28621861   1.02784431   0.62791157   2.37682891   0.00838274   0.00000000  -0.00025764
6   40.0   90.0   0.40973866   1.01528335   0.69253224   1.96335208   0.01420814   0.00000000  -0.00026228
Loading SST lat band coefficients from /home/rakesh/SeaDAS/ocssw/share/modis/aqua/cal/AQUA_collection_6_SST_latband1_coeffs_v6.3.txt:
6  -90.0  -40.0   1.19381309   0.94507158   0.16576625   0.53231257   0.01267841  -0.00074515   0.00020622
6  -40.0  -20.0   1.88156164   0.92531514   0.13021563   0.77342933   0.00865039  -0.00218656   0.00014836
6  -20.0    0.0   3.69277835   0.85453707   0.12039568   0.93536049   0.01486333  -0.00287055   0.00008372
6    0.0   20.0   4.78338909   0.81816196   0.11645862   0.78418994   0.01340674  -0.00218353   0.00012754
6   20.0   40.0   2.07086802   0.93286544   0.12331814   1.05546510   0.01634476  -0.00261726   0.00014048
6   40.0   90.0   1.49793792   0.94750416   0.14180578   0.68836480   0.00000000  -0.00160105   0.00019344
sst reference day offset = 0.000000
sst reference night offset = 0.000000
Skipping ancillary retrieval for scan 1002 - entire scan invalid
Skipping ancillary retrieval for scan 1003 - entire scan invalid
Skipping ancillary retrieval for scan 1004 - entire scan invalid
.
.
.
Skipping ancillary retrieval for scan 2000 - entire scan invalid
Skipping ancillary retrieval for scan 2001 - entire scan invalid
Processing scan #  1999 (1001 of 1001) after      7 seconds

Percentage of pixels flagged:
Flag # 1:          ATMFAIL          0   0.0000
Flag # 2:             LAND          0   0.0000
Flag # 3:         PRODWARN          0   0.0000
Flag # 4:          HIGLINT          0   0.0000
Flag # 5:             HILT     397058  79.1739
Flag # 6:         HISATZEN          0   0.0000
Flag # 7:           COASTZ          0   0.0000
Flag # 8:            SPARE          0   0.0000
Flag # 9:       STRAYLIGHT      76701  15.2943
Flag #10:           CLDICE          0   0.0000
Flag #11:        COCCOLITH          0   0.0000
Flag #12:          TURBIDW          0   0.0000
Flag #13:         HISOLZEN          0   0.0000
Flag #14:            SPARE          0   0.0000
Flag #15:            LOWLW          0   0.0000
Flag #16:          CHLFAIL          0   0.0000
Flag #17:          NAVWARN     501501 100.0000
Flag #18:           ABSAER          0   0.0000
Flag #19:            SPARE          0   0.0000
Flag #20:       MAXAERITER          0   0.0000
Flag #21:         MODGLINT          0   0.0000
Flag #22:          CHLWARN          0   0.0000
Flag #23:          ATMWARN          0   0.0000
Flag #24:            SPARE          0   0.0000
Flag #25:           SEAICE          0   0.0000
Flag #26:          NAVFAIL     501501 100.0000
Flag #27:           FILTER          0   0.0000
Flag #28:            SPARE          0   0.0000
Flag #29:        BOWTIEDEL          0   0.0000
Flag #30:            HIPOL          0   0.0000
Flag #31:         PRODFAIL          0   0.0000
Flag #32:            SPARE          0   0.0000

End MSl12 processing at 2018133093132000
Processing Rate = 143.000000 scans/sec

Processing Completed


Also, I can process other sensors like HICO.

Thanks for the swift response.
Rakesh

Ancillary data in SeaDAS v7.5 for MODIS-Aqua processing

Posted: Mon May 14, 2018 12:47 am America/New_York
by rakeshs
Hello,

Today I tried running l2gen again and it is running fine now.

I don't know how the issue got resolved but it has.

Thanks a lot for listening.
Rakesh