obdaac_download.py Whoops (received status 404)

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
gnwiii
Posts: 713
Joined: Fri Jan 29, 2021 5:51 pm America/New_York
Answers: 2
Has thanked: 1 time

obdaac_download.py Whoops (received status 404)

by gnwiii » Tue Jul 14, 2020 12:57 pm America/New_York

I have been downloading 12 months of level-3 binned files for various products on July 12 and 13.  I first use wget to download a list with sha1sums, then extract the filenames for each product into a list.  Using the (normally reliable) obdaac_download.py, Whoopsed on a few files for some products.  For example:

% obdaac_download.py --filelist SNPP_VIIRS.2019.PAR.list
Whoops...problem retrieving V20192132019243.L3b_MO_SNPP_PAR.nc (received status 404)
Whoops...problem retrieving V20192442019273.L3b_MO_SNPP_PAR.nc (received status 404)
% obdaac_download.py V20192442019273.L3b_MO_SNPP_PAR.nc
Whoops...problem retrieving V20192442019273.L3b_MO_SNPP_PAR.nc (received status 404)
% obdaac_download.py V20192442019273.L3b_MO_SNPP_PAR.nc
Whoops...problem retrieving V20192442019273.L3b_MO_SNPP_PAR.nc (received status 404)
% obdaac_download.py V20192442019273.L3b_MO_SNPP_PAR.nc
% sha1sum -c V20192442019273.L3b_MO_SNPP_PAR.sha1sum
V20192442019273.L3b_MO_SNPP_PAR.nc: OK
Downloading some of the files with "(received status 404)" using the level-3 browser was also successful.

Filters:

OB.DAACx - SeanBailey
Posts: 1519
Joined: Wed Sep 18, 2019 6:15 pm America/New_York
Answers: 1
Been thanked: 9 times

obdaac_download.py Whoops (received status 404)

by OB.DAACx - SeanBailey » Tue Jul 14, 2020 1:48 pm America/New_York

Both of those files are available (just pulled them down with that reliable script :grin:)
Those files reside on two different storage devices, but it's possible there was an intermittent networking issue.

BTW, all data access is via the getfile API, so the download  working for the L3 browser but not a prior attempt with the obdaac_download script strongly suggests a temporary whoops.
If it happens more than irregularly, or is persistent, definitely let us know. 

Sean

Post Reply