I am using the API to get a list of ILRS SP3 files, however many of the listed files are missing.
The following query returns links to 453 ILRS Precise SP3 files from 2023.
https://cmr.earthdata.nasa.gov/search/granules.json?collection_concept_id=C1537291495-CDDIS&created_at=2023-01-01T00:00:00Z,2023-12-31T00:00:00Z&page_size=2000
However all files with v80 in the name are missing, eg
https://cddis.nasa.gov/archive/slr/products/orbits/etalon1/230401/ilrsa.orb.etalon1.230401.v80.sp3.gz
"404 Error Message: Page Not Found on cddis.nasa.gov"
Note: I can't avoid using the API because the webpage is not working, which I reported in a separate issue.
viewtopic.php?t=6004
Requests:
-Please correct and also check previous years as i have not done that.
-So far I have not encountered this problem in 2024 data, but it would be good to avoid recurrence.
ILRS Precise SP3 files listed by the API are missing
Re: ILRS Precise SP3 files listed by the API are missing
I have completely given up on using the API...
In theory it is convenient but in practice I have encountered too many issues, including:
1) It only returns a small subset of files listed on the web.
2) Many of the files it lists do not exist.
3) The file sizes it return are incorrect.
4) There is no obvious way to filter on fields, so user has to download large listings and filter manually.
I have reverted to scraping 100s of html pages to generate file lists.
I have resolved my issue with not being able to load some html pages due to this error:
"curl: (56) Recv failure: Connection was reset"
Solution was to update the default windows 10 curl to the latest version from:
8.7.1 (Windows) libcurl/8.7.1 Schannel zlib/1.3 WinIDN, Release-Date: 2024-03-27
to:
curl 8.10.1 (x86_64-w64-mingw32) libcurl/8.10.1 LibreSSL/3.9.2 zlib/1.3.1 brotli/1.1.0 zstd/1.5.6 WinIDN libpsl/0.21.5 libssh2/1.11.0 nghttp2/1.63.0 ngtcp2/1.7.0 nghttp3/1.5.0 Release-Date: 2024-09-18
In theory it is convenient but in practice I have encountered too many issues, including:
1) It only returns a small subset of files listed on the web.
2) Many of the files it lists do not exist.
3) The file sizes it return are incorrect.
4) There is no obvious way to filter on fields, so user has to download large listings and filter manually.
I have reverted to scraping 100s of html pages to generate file lists.
I have resolved my issue with not being able to load some html pages due to this error:
"curl: (56) Recv failure: Connection was reset"
Solution was to update the default windows 10 curl to the latest version from:
8.7.1 (Windows) libcurl/8.7.1 Schannel zlib/1.3 WinIDN, Release-Date: 2024-03-27
to:
curl 8.10.1 (x86_64-w64-mingw32) libcurl/8.10.1 LibreSSL/3.9.2 zlib/1.3.1 brotli/1.1.0 zstd/1.5.6 WinIDN libpsl/0.21.5 libssh2/1.11.0 nghttp2/1.63.0 ngtcp2/1.7.0 nghttp3/1.5.0 Release-Date: 2024-09-18