Earthdata Forum

I've been having problems with the N2019???_SST_OIV2AV_24h.nc files. Yesterday, a bunch failed and Sean indicated it was because the :title was changed by NOAA, and showed me a way to replace the string to one that works. Yesterday it did work. However, now I cannot even find the SST files after 2019211. The failures all say either:

*** ERROR: The HTTP transfer failed with status code 404.
*** Please check your network connection and for the existence of the remote file:
*** oceandata.sci.gsfc.nasa.gov/cgi/getfile/N2019215_SST_OIV2AV_24h.nc
***
*** Also check to make sure you have write permissions under the directory:
*** /optics1/software/seadas/seadas-7.5/ocssw/var/anc/2019/215
or
HTTP Error: 503 - Service Temporarily Unavailable
*** ERROR: The HTTP transfer failed with status code 503.
*** Please check your network connection and for the existence of the remote file:
*** oceandata.sci.gsfc.nasa.gov/cgi/getfile/N2019215_SST_OIV2AV_24h.nc
***
*** Also check to make sure you have write permissions under the directory:
*** /optics1/software/seadas/seadas-7.5/ocssw/var/anc/2019/215

[bmurch@dell8 Documents]$ wget https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N2019211_SST_OIV2AV_24h.nc
--2019-08-08 09:19:35--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N2019211_SST_OIV2AV_24h.nc
Resolving oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)... xx.xxx.xx.xx, 2001:4d0:2418:128::84
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1635528 (1.6M) [application/octet-stream]
Saving to: ‘N2019211_SST_OIV2AV_24h.nc’

100%[=============================================================================================================================================================>] 1,635,528   5.44MB/s   in 0.3s  

2019-08-08 09:19:36 (5.44 MB/s) - ‘N2019211_SST_OIV2AV_24h.nc’ saved [1635528/1635528]

[bmurch@dell8 Documents]$ wget https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N2019212_SST_OIV2AV_24h.nc
--2019-08-08 09:19:40--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N2019212_SST_OIV2AV_24h.nc
Resolving oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)... xx.xxx.xx.xx, 2001:4d0:2418:128::84
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2019-08-08 09:19:45 ERROR 404: Not Found.

[bmurch@dell8 Documents]$ wget https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N2019213_SST_OIV2AV_24h.nc
--2019-08-08 09:30:12--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N2019213_SST_OIV2AV_24h.nc
Resolving oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)... xx.xxx.xx.xx, 2001:4d0:2418:128::84
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2019-08-08 09:30:18 ERROR 404: Not Found.

[bmurch@dell8 Documents]$ wget https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N2019214_SST_OIV2AV_24h.nc
--2019-08-08 09:30:22--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N2019214_SST_OIV2AV_24h.nc
Resolving oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)... xx.xxx.xx.xx, 2001:4d0:2418:128::84
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2019-08-08 09:30:27 ERROR 404: Not Found.

[bmurch@dell8 Documents]$ wget https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N2019215_SST_OIV2AV_24h.nc
--2019-08-08 09:19:53--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N2019215_SST_OIV2AV_24h.nc
Resolving oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)... xx.xxx.xx.xx, 2001:4d0:2418:128::84
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2019-08-08 09:19:58 ERROR 404: Not Found.

searobin 293 :/optics1/software/seadas/seadas-7.5/ocssw/var/anc/2019> wget https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N2019216_SST_OIV2AV_24h.nc
--2019-08-08 09:09:49--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N2019216_SST_OIV2AV_24h.nc
Resolving oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)... xx.xxx.xx.xx, 2001:4d0:2418:128::84
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2019-08-08 09:09:55 ERROR 404: Not Found.

searobin 294 :/optics1/software/seadas/seadas-7.5/ocssw/var/anc/2019> wget https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N2019217_SST_OIV2AV_24h.nc
--2019-08-08 09:10:05--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N2019217_SST_OIV2AV_24h.nc
Resolving oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)... xx.xxx.xx.xx, 2001:4d0:2418:128::84
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2019-08-08 09:10:10 ERROR 404: Not Found.

searobin 295 :/optics1/software/seadas/seadas-7.5/ocssw/var/anc/2019> wget https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N2019218_SST_OIV2AV_24h.nc
--2019-08-08 09:10:14--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N2019218_SST_OIV2AV_24h.nc
Resolving oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)... xx.xxx.xx.xx, 2001:4d0:2418:128::84
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2019-08-08 09:10:20 ERROR 404: Not Found.

I removed them from the archive until we get a response from NOAA on whether the header change was intentional.
In the meantime, if you want to edit the title: value manually, you can grab the files directly from NCEI:
https://www.ncei.noaa.gov/data/sea-surface-temperature-optimum-interpolation/access/avhrr-only/

Tommy

Tommy,
So from that website, if I grab:
avhrr-only-v2.20190803_preliminary.nc

And I rename it to N2019215_SST_OIV2AV_24h.nc, change the :title

python3 $OCSSWROOT/scripts/ncattredit.py N2019215_SST_OIV2AV_24h.nc SST_Swap_pair.txt
searobin 345 :/optics1/virtual_ant/S4P_ROI_H5> ncdump -h N2019215_SST_OIV2AV_24h.nc > N2019215_SST_OIV2AV_24h.new.txt
searobin 346 :/optics1/virtual_ant/S4P_ROI_H5> diff N2019215_SST_OIV2AV_24h.org.txt N2019215_SST_OIV2AV_24h.new.txt
1c1
< netcdf avhrr-only-v2.20190803_preliminary {
---

> netcdf N2019215_SST_OIV2AV_24h {

59,60d58
<               :title = "NOAA/NCEI 1/4 Degree Daily Optimum Interpolation Sea Surface Temperature (OISST) Analysis," ;
<               :history = "Version 2.0" ;
64a63,64

>               :title = "NCEI Daily-OISST-V2 based mainly on AVHRR, Interim" ;
>               :history = "Version 2.0\n[2019-08-08T10:47:54] ncattredit.py N2019215_SST_OIV2AV_24h.nc SST_Swap_pair.txt" ;

and it should work?

Yes - the internal reader in l2gen is keying off the title: value in the header.

Tommy