Hawkeye processing with MUMM
-
- Posts: 1519
- Joined: Wed Sep 18, 2019 6:15 pm America/New_York
- Been thanked: 9 times
Re: Hawkeye processing with MUMM
Yes, the code works with Hawkeye...hasn't been evaluated with it, but it doesn't blow up, so that's a good sign 
Sean

Sean
Re: Hawkeye processing with MUMM
Hi Sean,
It blew up on one image we tried it on (Mac version). We have a few more scenes we'll try it on, and I'll respond back to this thread later.
Thanks!
Tim
It blew up on one image we tried it on (Mac version). We have a few more scenes we'll try it on, and I'll respond back to this thread later.
Thanks!
Tim
Re: Hawkeye processing with MUMM
Hello,
I am working with Dr. Moore - This is the exact error we are receiving:
execution exception: java.io.IOException: l2gen failed with exit code 1.
Check log for more details.
Loading default parameters from /Users/Victoria/ocssw/share/common/msl12_defaults.par
Input file /Users/Victoria/Desktop/Vanern/Jun15/SEAHAWK1_HAWKEYE.20210615T100509.L1A.nc is HAWKEYE L1A file.
Loading characteristics for HAWKEYE
Opening sensor information file /Users/Victoria/ocssw/share/hawkeye/msl12_sensor_info.dat
Bnd Lam Fo Tau_r k_oz k_no2 t_co2 awhite aw bbw
0 412.000 173.272 3.176e-01 2.539e-04 6.042e-19 1.000e+00 0.000e+00 4.840e-03 2.953e-03
1 447.000 196.058 2.267e-01 3.553e-03 4.780e-19 1.000e+00 0.000e+00 8.042e-03 2.090e-03
2 488.000 198.810 1.585e-01 2.069e-02 2.938e-19 1.000e+00 0.000e+00 1.493e-02 1.440e-03
3 510.000 187.653 1.322e-01 4.136e-02 2.087e-19 1.000e+00 0.000e+00 3.218e-02 1.193e-03
4 556.000 183.098 9.294e-02 9.903e-02 9.124e-20 1.000e+00 0.000e+00 5.971e-02 8.316e-04
5 670.000 150.871 4.334e-02 4.454e-02 7.967e-21 1.000e+00 0.000e+00 4.417e-01 3.806e-04
6 752.000 127.079 2.728e-02 9.505e-03 1.530e-21 1.000e+00 0.000e+00 2.856e+00 2.372e-04
7 867.000 95.258 1.540e-02 2.108e-03 3.778e-23 1.000e+00 0.000e+00 4.742e+00 1.322e-04
Loading default parameters for HAWKEYE from /Users/Victoria/ocssw/share/hawkeye/msl12_defaults.par
Loading parameters for suite OC from /Users/Victoria/ocssw/share/hawkeye/msl12_defaults_OC.par
Loading command line parameters
Loading user parameters for HAWKEYE
Internal data compression requested at compression level: 4
Opening filter file /Users/Victoria/ocssw/share/hawkeye/hawkeye_filter.dat
Setting -1 x 5 straylight filter on HILT mask
Filter Kernel
0 0 1 0 0
0 1 1 1 0 s
1 1 1 1 1
0 1 1 1 0
0 0 1 0 0
Minimum fill set to 1 pixels
Setting -1 x 5 straylight filter on CLDICE mask
Filter Kernel
0 0 1 0 0
0 1 1 1 0
1 1 1 1 1
0 1 1 1 0
0 0 1 0 0
Minimum fill set to 1 pixels
Setting -1 x 7 interquartile averaging filter on Lt(6)-Lr(6)
Filter Kernel
0 0 0 1 0 0 0
0 0 1 1 1 0 0
0 1 1 1 1 1 0
1 1 1 1 1 1 1
0 1 1 1 1 1 0
0 0 1 1 1 0 0
0 0 0 1 0 0 0
Minimum fill set to 13 pixels
Setting -1 x 7 interquartile averaging filter on Lt(7)-Lr(7)
Filter Kernel
0 0 0 1 0 0 0
0 0 1 1 1 0 0
0 1 1 1 1 1 0
1 1 1 1 1 1 1
0 1 1 1 1 1 0
0 0 1 1 1 0 0
0 0 0 1 0 0 0
Minimum fill set to 13 pixels
Setting -1 x 7 interquartile averaging filter on Lt(8)-Lr(8)
Filter Kernel
0 0 0 1 0 0 0
0 0 1 1 1 0 0
0 1 1 1 1 1 0
1 1 1 1 1 1 1
0 1 1 1 1 1 0
0 0 1 1 1 0 0
0 0 0 1 0 0 0
Minimum fill set to 13 pixels
Reading Thuillier_F0.dat
Opening Hawkeye L1A file
Hawkeye L1A npix = 1800; nscans = 6000; nbands = 8
Reading Hawkeye calibration LUT
Will skip first 0 and last 64 scans.
Opening Hawkeye GEO file
Allocated 1819832 bytes in L1 record.
Allocated 705600 bytes in L2 record.
Opening: /Users/Victoria/Desktop/Vanern/Jun15/SEAHAWK1_HAWKEYE.20210615T100509.L2.OC_MUMM.nc
The following products will be included in /Users/Victoria/Desktop/Vanern/Jun15/SEAHAWK1_HAWKEYE.20210615T100509.L2.OC_MUMM.nc.
0 aot_867
1 angstrom
2 Rrs_412
3 Rrs_447
4 Rrs_488
5 Rrs_510
6 Rrs_556
7 Rrs_670
8 chlor_a
9 chl_ocx
10 Kd_490
11 pic
12 poc
13 l2_flags
Begin l2gen Version 9.5.1-V2022.0 Processing
Sensor is HAWKEYE
Sensor ID is 27
Sensor has 8 reflective bands
Sensor has 0 emissive bands
Number of along-track detectors per band is 1
Number of input pixels per scan is 1800
Processing pixels 1 to 1800 by 1
Processing scans 1 to 5936 by 1
Ocean processing enabled
Land processing enabled
Atmospheric correction enabled
Begin MSl12 processing at 2022264191130000
Allocated 1819832 bytes in L1 record.
Allocated 1819832 bytes in L1 record.
Allocated 1819832 bytes in L1 record.
Allocated 1819832 bytes in L1 record.
Allocated 1819832 bytes in L1 record.
Allocated 1819832 bytes in L1 record.
Allocated 1819832 bytes in L1 record.
Loading land mask file from /Users/Victoria/ocssw/share/common/landmask_null.dat
Loading bathymetry mask file from /Users/Victoria/ocssw/share/common/watermask.dat
Loading ice mask file from /Users/Victoria/ocssw/share/common/ice_climatology.hdf
Loaded monthly NSIDC ice climatology HDF file.
Loading elevation file from /Users/Victoria/ocssw/share/common/ETOPO1_ocssw.nc
Loading DEM info from /Users/Victoria/ocssw/share/common/ETOPO1_ocssw.nc
Loading climatology file /Users/Victoria/ocssw/share/common/sst_climatology.hdf
Loading SSS reference from Climatology file: /Users/Victoria/ocssw/share/common/sss_climatology_woa2009.hdf
Opening meteorological files.
met1 = /Users/Victoria/ocssw/share/common/met_climatology_v2014.hdf
met2 =
met3 =
ozone1 = /Users/Victoria/ocssw/share/common/ozone_climatology_v2014.hdf
ozone2 =
ozone3 =
no2 = /Users/Victoria/ocssw/share/common/no2_climatology_v2013.hdf
Opening ozone file /Users/Victoria/ocssw/share/common/ozone_climatology_v2014.hdf
Opening NO2 file /Users/Victoria/ocssw/share/common/no2_climatology_v2013.hdf
Opening NO2 frac file /Users/Victoria/ocssw/share/common/trop_f_no2_200m.hdf
Loading Rayleigh LUT /Users/Victoria/ocssw/share/hawkeye/rayleigh/rayleigh_hawkeye_412_iqu.hdf
Loading Rayleigh LUT /Users/Victoria/ocssw/share/hawkeye/rayleigh/rayleigh_hawkeye_447_iqu.hdf
Loading Rayleigh LUT /Users/Victoria/ocssw/share/hawkeye/rayleigh/rayleigh_hawkeye_488_iqu.hdf
Loading Rayleigh LUT /Users/Victoria/ocssw/share/hawkeye/rayleigh/rayleigh_hawkeye_510_iqu.hdf
Loading Rayleigh LUT /Users/Victoria/ocssw/share/hawkeye/rayleigh/rayleigh_hawkeye_556_iqu.hdf
Loading Rayleigh LUT /Users/Victoria/ocssw/share/hawkeye/rayleigh/rayleigh_hawkeye_670_iqu.hdf
Loading Rayleigh LUT /Users/Victoria/ocssw/share/hawkeye/rayleigh/rayleigh_hawkeye_752_iqu.hdf
Loading Rayleigh LUT /Users/Victoria/ocssw/share/hawkeye/rayleigh/rayleigh_hawkeye_867_iqu.hdf
Using 867.0 nm channel for cloud flagging over water.
Using 412.0 nm channel for cloud flagging over land.
Processing scan # 0 (1 of 5936) after 0 seconds
Aerosol selection bands 670 and 670
MUMM correction enabled.
chl_hu: using 447.00 556.00 670.00
Loading aerosol models from /Users/Victoria/ocssw/share/hawkeye/aerosol/aerosol_hawkeye
Number of Wavelengths 8
Number of Solar Zenith Angles 33
Number of View Zenith Angles 35
Number of Relative Azimuth Angles 19
Number of Scattering Angles 75
Number of Diffuse Transmittance Wavelengths 8
Number of Diffuse Transmittance Zenith Angles 33
Using Gordon & Wang aerosol model selection
and MUMM correction
Using bands at 670.0 and 670.0 nm for model selection
Extrapolating from 670.0 nm
Aerosol selection bands must be greater than 600nm with short wave less than long wave (5,5)
I am working with Dr. Moore - This is the exact error we are receiving:
execution exception: java.io.IOException: l2gen failed with exit code 1.
Check log for more details.
Loading default parameters from /Users/Victoria/ocssw/share/common/msl12_defaults.par
Input file /Users/Victoria/Desktop/Vanern/Jun15/SEAHAWK1_HAWKEYE.20210615T100509.L1A.nc is HAWKEYE L1A file.
Loading characteristics for HAWKEYE
Opening sensor information file /Users/Victoria/ocssw/share/hawkeye/msl12_sensor_info.dat
Bnd Lam Fo Tau_r k_oz k_no2 t_co2 awhite aw bbw
0 412.000 173.272 3.176e-01 2.539e-04 6.042e-19 1.000e+00 0.000e+00 4.840e-03 2.953e-03
1 447.000 196.058 2.267e-01 3.553e-03 4.780e-19 1.000e+00 0.000e+00 8.042e-03 2.090e-03
2 488.000 198.810 1.585e-01 2.069e-02 2.938e-19 1.000e+00 0.000e+00 1.493e-02 1.440e-03
3 510.000 187.653 1.322e-01 4.136e-02 2.087e-19 1.000e+00 0.000e+00 3.218e-02 1.193e-03
4 556.000 183.098 9.294e-02 9.903e-02 9.124e-20 1.000e+00 0.000e+00 5.971e-02 8.316e-04
5 670.000 150.871 4.334e-02 4.454e-02 7.967e-21 1.000e+00 0.000e+00 4.417e-01 3.806e-04
6 752.000 127.079 2.728e-02 9.505e-03 1.530e-21 1.000e+00 0.000e+00 2.856e+00 2.372e-04
7 867.000 95.258 1.540e-02 2.108e-03 3.778e-23 1.000e+00 0.000e+00 4.742e+00 1.322e-04
Loading default parameters for HAWKEYE from /Users/Victoria/ocssw/share/hawkeye/msl12_defaults.par
Loading parameters for suite OC from /Users/Victoria/ocssw/share/hawkeye/msl12_defaults_OC.par
Loading command line parameters
Loading user parameters for HAWKEYE
Internal data compression requested at compression level: 4
Opening filter file /Users/Victoria/ocssw/share/hawkeye/hawkeye_filter.dat
Setting -1 x 5 straylight filter on HILT mask
Filter Kernel
0 0 1 0 0
0 1 1 1 0 s
1 1 1 1 1
0 1 1 1 0
0 0 1 0 0
Minimum fill set to 1 pixels
Setting -1 x 5 straylight filter on CLDICE mask
Filter Kernel
0 0 1 0 0
0 1 1 1 0
1 1 1 1 1
0 1 1 1 0
0 0 1 0 0
Minimum fill set to 1 pixels
Setting -1 x 7 interquartile averaging filter on Lt(6)-Lr(6)
Filter Kernel
0 0 0 1 0 0 0
0 0 1 1 1 0 0
0 1 1 1 1 1 0
1 1 1 1 1 1 1
0 1 1 1 1 1 0
0 0 1 1 1 0 0
0 0 0 1 0 0 0
Minimum fill set to 13 pixels
Setting -1 x 7 interquartile averaging filter on Lt(7)-Lr(7)
Filter Kernel
0 0 0 1 0 0 0
0 0 1 1 1 0 0
0 1 1 1 1 1 0
1 1 1 1 1 1 1
0 1 1 1 1 1 0
0 0 1 1 1 0 0
0 0 0 1 0 0 0
Minimum fill set to 13 pixels
Setting -1 x 7 interquartile averaging filter on Lt(8)-Lr(8)
Filter Kernel
0 0 0 1 0 0 0
0 0 1 1 1 0 0
0 1 1 1 1 1 0
1 1 1 1 1 1 1
0 1 1 1 1 1 0
0 0 1 1 1 0 0
0 0 0 1 0 0 0
Minimum fill set to 13 pixels
Reading Thuillier_F0.dat
Opening Hawkeye L1A file
Hawkeye L1A npix = 1800; nscans = 6000; nbands = 8
Reading Hawkeye calibration LUT
Will skip first 0 and last 64 scans.
Opening Hawkeye GEO file
Allocated 1819832 bytes in L1 record.
Allocated 705600 bytes in L2 record.
Opening: /Users/Victoria/Desktop/Vanern/Jun15/SEAHAWK1_HAWKEYE.20210615T100509.L2.OC_MUMM.nc
The following products will be included in /Users/Victoria/Desktop/Vanern/Jun15/SEAHAWK1_HAWKEYE.20210615T100509.L2.OC_MUMM.nc.
0 aot_867
1 angstrom
2 Rrs_412
3 Rrs_447
4 Rrs_488
5 Rrs_510
6 Rrs_556
7 Rrs_670
8 chlor_a
9 chl_ocx
10 Kd_490
11 pic
12 poc
13 l2_flags
Begin l2gen Version 9.5.1-V2022.0 Processing
Sensor is HAWKEYE
Sensor ID is 27
Sensor has 8 reflective bands
Sensor has 0 emissive bands
Number of along-track detectors per band is 1
Number of input pixels per scan is 1800
Processing pixels 1 to 1800 by 1
Processing scans 1 to 5936 by 1
Ocean processing enabled
Land processing enabled
Atmospheric correction enabled
Begin MSl12 processing at 2022264191130000
Allocated 1819832 bytes in L1 record.
Allocated 1819832 bytes in L1 record.
Allocated 1819832 bytes in L1 record.
Allocated 1819832 bytes in L1 record.
Allocated 1819832 bytes in L1 record.
Allocated 1819832 bytes in L1 record.
Allocated 1819832 bytes in L1 record.
Loading land mask file from /Users/Victoria/ocssw/share/common/landmask_null.dat
Loading bathymetry mask file from /Users/Victoria/ocssw/share/common/watermask.dat
Loading ice mask file from /Users/Victoria/ocssw/share/common/ice_climatology.hdf
Loaded monthly NSIDC ice climatology HDF file.
Loading elevation file from /Users/Victoria/ocssw/share/common/ETOPO1_ocssw.nc
Loading DEM info from /Users/Victoria/ocssw/share/common/ETOPO1_ocssw.nc
Loading climatology file /Users/Victoria/ocssw/share/common/sst_climatology.hdf
Loading SSS reference from Climatology file: /Users/Victoria/ocssw/share/common/sss_climatology_woa2009.hdf
Opening meteorological files.
met1 = /Users/Victoria/ocssw/share/common/met_climatology_v2014.hdf
met2 =
met3 =
ozone1 = /Users/Victoria/ocssw/share/common/ozone_climatology_v2014.hdf
ozone2 =
ozone3 =
no2 = /Users/Victoria/ocssw/share/common/no2_climatology_v2013.hdf
Opening ozone file /Users/Victoria/ocssw/share/common/ozone_climatology_v2014.hdf
Opening NO2 file /Users/Victoria/ocssw/share/common/no2_climatology_v2013.hdf
Opening NO2 frac file /Users/Victoria/ocssw/share/common/trop_f_no2_200m.hdf
Loading Rayleigh LUT /Users/Victoria/ocssw/share/hawkeye/rayleigh/rayleigh_hawkeye_412_iqu.hdf
Loading Rayleigh LUT /Users/Victoria/ocssw/share/hawkeye/rayleigh/rayleigh_hawkeye_447_iqu.hdf
Loading Rayleigh LUT /Users/Victoria/ocssw/share/hawkeye/rayleigh/rayleigh_hawkeye_488_iqu.hdf
Loading Rayleigh LUT /Users/Victoria/ocssw/share/hawkeye/rayleigh/rayleigh_hawkeye_510_iqu.hdf
Loading Rayleigh LUT /Users/Victoria/ocssw/share/hawkeye/rayleigh/rayleigh_hawkeye_556_iqu.hdf
Loading Rayleigh LUT /Users/Victoria/ocssw/share/hawkeye/rayleigh/rayleigh_hawkeye_670_iqu.hdf
Loading Rayleigh LUT /Users/Victoria/ocssw/share/hawkeye/rayleigh/rayleigh_hawkeye_752_iqu.hdf
Loading Rayleigh LUT /Users/Victoria/ocssw/share/hawkeye/rayleigh/rayleigh_hawkeye_867_iqu.hdf
Using 867.0 nm channel for cloud flagging over water.
Using 412.0 nm channel for cloud flagging over land.
Processing scan # 0 (1 of 5936) after 0 seconds
Aerosol selection bands 670 and 670
MUMM correction enabled.
chl_hu: using 447.00 556.00 670.00
Loading aerosol models from /Users/Victoria/ocssw/share/hawkeye/aerosol/aerosol_hawkeye
Number of Wavelengths 8
Number of Solar Zenith Angles 33
Number of View Zenith Angles 35
Number of Relative Azimuth Angles 19
Number of Scattering Angles 75
Number of Diffuse Transmittance Wavelengths 8
Number of Diffuse Transmittance Zenith Angles 33
Using Gordon & Wang aerosol model selection
and MUMM correction
Using bands at 670.0 and 670.0 nm for model selection
Extrapolating from 670.0 nm
Aerosol selection bands must be greater than 600nm with short wave less than long wave (5,5)
-
- Posts: 1519
- Joined: Wed Sep 18, 2019 6:15 pm America/New_York
- Been thanked: 9 times
Re: Hawkeye processing with MUMM
The error message indicates what went wrong
As a variant of the Gordon and Wang approach, the MUMM algorithm requires two bands to do the atmospheric correction.
The Hawkeye default configuration uses a CZCS-like approach and so specifies aer_wave_long and aer_wave_short as the same band (670nm). All you should need to do is set aer_wave_long=867 and aer_wave_short=752.
Keep in mind that the gains were defined for the CZCS-like correction, so no guarantees that they are appropriate for the MUMM approach.
Sean

As a variant of the Gordon and Wang approach, the MUMM algorithm requires two bands to do the atmospheric correction.
The Hawkeye default configuration uses a CZCS-like approach and so specifies aer_wave_long and aer_wave_short as the same band (670nm). All you should need to do is set aer_wave_long=867 and aer_wave_short=752.
Keep in mind that the gains were defined for the CZCS-like correction, so no guarantees that they are appropriate for the MUMM approach.
Sean