Earthdata Forum

Welcome to the Earthdata Forum! Here, the scientific user community and subject matter experts from NASA Distributed Active Archive Centers (DAACs), and other contributors, discuss research needs, data, and data applications.
https://forum.earthdata.nasa.gov/

anc file always returns as HTML

https://forum.earthdata.nasa.gov/viewtopic.php?t=2923

Page 1 of 1

anc file always returns as HTML

Posted: Sat Feb 19, 2022 11:44 pm America/New_York
by oo_processing
I have been trying all do to get this anc file. It always returns as HTML.
$ curl -b ~/.urs_cookies_sentinel -c ~/.urs_cookies_sentinel -L -n --interface 2607:fe50:0:6330::104 --retry 5 --retry-delay 2 --max-time 0 --output /shares/cms_optics/apps/seadas/seadas-7.5.3/ocssw/var/anc/2022/050/PM1ATTNR_NRT.A2022050.1215.061 https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/ATTNR_NRT.A2022050.1215.061
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 746 100 746 0 0 132 0 0:00:05 0:00:05 --:--:-- 177
$ file /shares/cms_optics/apps/seadas/seadas-7.5.3/ocssw/var/anc/2022/050/PM1ATTNR_NRT.A2022050.1215.061/shares/cms_optics/apps/seadas/seadas-7.5.3/ocssw/var/anc/2022/050/PM1ATTNR_NRT.A2022050.1215.061: HTML document, ASCII text

Re: anc file always returns as HTML

Posted: Mon Feb 21, 2022 11:32 am America/New_York
by OB.DAACx - SeanBailey
The file exists and I was just able to download it (and it wasn't an HTML file). Try again, and if it's still an HTML file for you, crack it open and see what it says.

Sean

Re: anc file always returns as HTML

Posted: Mon Feb 21, 2022 4:32 pm America/New_York
by stefan.maier
There seems to be an intermittent issue with the "file search" (https://oceandata.sci.gsfc.nasa.gov/api/file_search/) utility. There are periods when it comes back with an error:

.:. ERROR .:.
Ocean Biology Distributed Active Archive Center (OB.DAAC)
We are sorry, but an error has occurred. Please use the back button to return to the previous page

Stefan

Re: anc file always returns as HTML

Posted: Mon Feb 21, 2022 5:49 pm America/New_York
by oo_processing
Sean, This seems to be a bad gateway issue.
We have seen this before as I recall.
PS, its not just anc files. MODIS, OLCI and VIIRS have all seen the "<!-- IE needs 512+ bytes: [http]://blogs.msdn.com/b/ieinternals/archive/2010/08/19/http-error-pages-in-internet-explorer.aspx -->" show up as well.

From home ip: (IPv4: 65.32.108.3):
[bmurch@dell8 work]$ curl -v -4 -b ~/.urs_cookies -c ~/.urs_cookies -L -n --retry 5 --retry-delay 2 --max-time 0 --output ./PM1ATTNR_NRT.A2022050.1215.061 https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/PM1ATTNR_NRT.A2022050.1215.061
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* About to connect() to oceandata.sci.gsfc.nasa.gov port 443 (#0)
* Trying 169.154.128.84...
* Connected to oceandata.sci.gsfc.nasa.gov (169.154.128.84) port 443 (#0)
* Initializing NSS with certpath: sql:/etc/pki/nssdb
* CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
* SSL connection using TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256
* Server certificate:
* subject: CN=oceancolor.gsfc.nasa.gov
* start date: Jan 28 13:02:19 2022 GMT
* expire date: Apr 28 13:02:18 2022 GMT
* common name: oceancolor.gsfc.nasa.gov
* issuer: CN=R3,O=Let's Encrypt,C=US
* Server auth using Basic with user 'oo_processing'
> GET /cgi/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=21a87b271b22d823ed4494a4f691f7e65663072c
>
< HTTP/1.1 302 Found
< Server: nginx
< Date: Mon, 21 Feb 2022 22:41:37 GMT
< Transfer-Encoding: chunked
< Connection: keep-alive
< Location: /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061
< Content-Security-Policy: upgrade-insecure-requests; default-src 'self' 'unsafe-inline' 'unsafe-eval' data: oceancolor.gsfc.nasa.gov *.earthdata.nasa.gov *.google.com *.gstatic.com *.googleapis.com [link].googletagmanager.com [link].google-analytics.com [link].youtube.com s.ytimg.com stats.g.doubleclick.net dap.digitalgov.gov cdn.earthdata.nasa.gov api.ipify.org www.cloudflare.com maxcdn.bootstrapcdn.com platform.twitter.com;
< Strict-Transport-Security: max-age=31536000; includesubdomains; preload
< X-Frame-Options: SAMEORIGIN
<
* Ignoring the response-body
{ [data not shown]
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
* Issue another request to this URL: 'https://oceandata.sci.gsfc.nasa.gov/ob/getfile/PM1ATTNR_NRT.A2022050.1215.061'
* Found bundle for host oceandata.sci.gsfc.nasa.gov: 0x1a3b160
* Re-using existing connection! (#0) with host oceandata.sci.gsfc.nasa.gov
* Connected to oceandata.sci.gsfc.nasa.gov (169.154.128.84) port 443 (#0)
* Server auth using Basic with user 'oo_processing'
> GET /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=21a87b271b22d823ed4494a4f691f7e65663072c
>
< HTTP/1.1 502 Bad Gateway
< Server: nginx
< Date: Mon, 21 Feb 2022 22:41:37 GMT
< Content-Type: text/html; charset=utf-8
< Content-Length: 746
< Connection: keep-alive
* Replaced cookie app-obdaac="21a87b271b22d823ed4494a4f691f7e65663072c" for ___domain oceandata.sci.gsfc.nasa.gov, path /, expire 0
< Set-Cookie: app-obdaac=21a87b271b22d823ed4494a4f691f7e65663072c; path=/; secure
<
{ [data not shown]
100 746 100 746 0 0 779 0 --:--:-- --:--:-- --:--:-- 0
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
Warning: Transient problem: HTTP error Will retry in 2 seconds. 5 retries
Warning: left.
Throwing away 746 bytes
* Found bundle for host oceandata.sci.gsfc.nasa.gov: 0x1a3b160
* Re-using existing connection! (#0) with host oceandata.sci.gsfc.nasa.gov
* Connected to oceandata.sci.gsfc.nasa.gov (169.154.128.84) port 443 (#0)
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Server auth using Basic with user 'oo_processing'
> GET /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=21a87b271b22d823ed4494a4f691f7e65663072c
>
< HTTP/1.1 502 Bad Gateway
< Server: nginx
< Date: Mon, 21 Feb 2022 22:41:40 GMT
< Content-Type: text/html; charset=utf-8
< Content-Length: 746
< Connection: keep-alive
* Replaced cookie app-obdaac="21a87b271b22d823ed4494a4f691f7e65663072c" for ___domain oceandata.sci.gsfc.nasa.gov, path /, expire 0
< Set-Cookie: app-obdaac=21a87b271b22d823ed4494a4f691f7e65663072c; path=/; secure
<
{ [data not shown]
100 746 100 746 0 0 2986 0 --:--:-- --:--:-- --:--:-- 2995
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
Warning: Transient problem: HTTP error Will retry in 2 seconds. 4 retries
Warning: left.
Throwing away 746 bytes
* Found bundle for host oceandata.sci.gsfc.nasa.gov: 0x1a3b160
* Re-using existing connection! (#0) with host oceandata.sci.gsfc.nasa.gov
* Connected to oceandata.sci.gsfc.nasa.gov (169.154.128.84) port 443 (#0)
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Server auth using Basic with user 'oo_processing'
> GET /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=21a87b271b22d823ed4494a4f691f7e65663072c
>
< HTTP/1.1 502 Bad Gateway
< Server: nginx
< Date: Mon, 21 Feb 2022 22:41:42 GMT
< Content-Type: text/html; charset=utf-8
< Content-Length: 746
< Connection: keep-alive
* Replaced cookie app-obdaac="21a87b271b22d823ed4494a4f691f7e65663072c" for ___domain oceandata.sci.gsfc.nasa.gov, path /, expire 0
< Set-Cookie: app-obdaac=21a87b271b22d823ed4494a4f691f7e65663072c; path=/; secure
<
{ [data not shown]
100 746 100 746 0 0 2994 0 --:--:-- --:--:-- --:--:-- 2995
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
Warning: Transient problem: HTTP error Will retry in 2 seconds. 3 retries
Warning: left.
Throwing away 746 bytes
* Found bundle for host oceandata.sci.gsfc.nasa.gov: 0x1a3b160
* Re-using existing connection! (#0) with host oceandata.sci.gsfc.nasa.gov
* Connected to oceandata.sci.gsfc.nasa.gov (169.154.128.84) port 443 (#0)
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Server auth using Basic with user 'oo_processing'
> GET /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=21a87b271b22d823ed4494a4f691f7e65663072c
>
< HTTP/1.1 502 Bad Gateway
< Server: nginx
< Date: Mon, 21 Feb 2022 22:41:44 GMT
< Content-Type: text/html; charset=utf-8
< Content-Length: 746
< Connection: keep-alive
* Replaced cookie app-obdaac="21a87b271b22d823ed4494a4f691f7e65663072c" for ___domain oceandata.sci.gsfc.nasa.gov, path /, expire 0
< Set-Cookie: app-obdaac=21a87b271b22d823ed4494a4f691f7e65663072c; path=/; secure
<
{ [data not shown]
100 746 100 746 0 0 3026 0 --:--:-- --:--:-- --:--:-- 3032
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
Warning: Transient problem: HTTP error Will retry in 2 seconds. 2 retries
Warning: left.
Throwing away 746 bytes
* Found bundle for host oceandata.sci.gsfc.nasa.gov: 0x1a3b160
* Re-using existing connection! (#0) with host oceandata.sci.gsfc.nasa.gov
* Connected to oceandata.sci.gsfc.nasa.gov (169.154.128.84) port 443 (#0)
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Server auth using Basic with user 'oo_processing'
> GET /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=21a87b271b22d823ed4494a4f691f7e65663072c
>
< HTTP/1.1 502 Bad Gateway
< Server: nginx
< Date: Mon, 21 Feb 2022 22:41:46 GMT
< Content-Type: text/html; charset=utf-8
< Content-Length: 746
< Connection: keep-alive
* Replaced cookie app-obdaac="21a87b271b22d823ed4494a4f691f7e65663072c" for ___domain oceandata.sci.gsfc.nasa.gov, path /, expire 0
< Set-Cookie: app-obdaac=21a87b271b22d823ed4494a4f691f7e65663072c; path=/; secure
<
{ [data not shown]
100 746 100 746 0 0 3085 0 --:--:-- --:--:-- --:--:-- 3082
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
Warning: Transient problem: HTTP error Will retry in 2 seconds. 1 retries
Warning: left.
Throwing away 746 bytes
* Found bundle for host oceandata.sci.gsfc.nasa.gov: 0x1a3b160
* Re-using existing connection! (#0) with host oceandata.sci.gsfc.nasa.gov
* Connected to oceandata.sci.gsfc.nasa.gov (169.154.128.84) port 443 (#0)
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Server auth using Basic with user 'oo_processing'
> GET /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=21a87b271b22d823ed4494a4f691f7e65663072c
>
< HTTP/1.1 502 Bad Gateway
< Server: nginx
< Date: Mon, 21 Feb 2022 22:41:49 GMT
< Content-Type: text/html; charset=utf-8
< Content-Length: 746
< Connection: keep-alive
* Replaced cookie app-obdaac="21a87b271b22d823ed4494a4f691f7e65663072c" for ___domain oceandata.sci.gsfc.nasa.gov, path /, expire 0
< Set-Cookie: app-obdaac=21a87b271b22d823ed4494a4f691f7e65663072c; path=/; secure
<
{ [data not shown]
100 746 100 746 0 0 2989 0 --:--:-- --:--:-- --:--:-- 2995
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
[bmurch@dell8 work]$ date; ll ./PM1ATTNR_NRT.A2022050.1215.061; cat ./PM1ATTNR_NRT.A2022050.1215.061
Mon Feb 21 17:42:05 EST 2022
-rw-rw-r--. 1 bmurch bmurch 746 Feb 21 17:41 ./PM1ATTNR_NRT.A2022050.1215.061

<!doctype html>
<html lang='en'>
<head>
<meta charset='utf-8'>
<title>ERROR @ Ocean Biology Distributed Active Archive Center (OB.DAAC)</title>
<meta name='viewport' content='width=device-width, initial-scale=1'>
</head>
<body link=white vlink=white alink=white style='background-color:#1C4960; color:white; font-size:175%'>
<br>
<hr color= #666699>
<center>
<h1>
<b>.:. ERROR .:.</b>
</h1>
<h2>Ocean Biology Distributed Active Archive Center (OB.DAAC)</h2>
<blockquote>We are sorry, but an error has occurred. Please use the back button to return to the previous page</blockquote>

From work IPv4:
[bmurch@optics0] ~ $ curl -v -4 -b ~/.urs_cookies -c ~/.urs_cookies -L -n --retry 5 --retry-delay 2 --max-time 0 --output ./PM1ATTNR_NRT.A2022050.1215.061 https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/PM1ATTNR_NRT.A2022050.1215.061
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* About to connect() to oceandata.sci.gsfc.nasa.gov port 443 (#0)
* Trying 169.154.128.84...
* Connected to oceandata.sci.gsfc.nasa.gov (169.154.128.84) port 443 (#0)
* Initializing NSS with certpath: sql:/etc/pki/nssdb
* CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
* SSL connection using TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256
* Server certificate:
* subject: CN=oceancolor.gsfc.nasa.gov
* start date: Jan 28 13:02:19 2022 GMT
* expire date: Apr 28 13:02:18 2022 GMT
* common name: oceancolor.gsfc.nasa.gov
* issuer: CN=R3,O=Let's Encrypt,C=US
* Server auth using Basic with user 'oo_processing'
> GET /cgi/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=322e1fd92e865bccf76fa5de7044791423ad0181
>
< HTTP/1.1 302 Found
< Server: nginx
< Date: Mon, 21 Feb 2022 22:43:11 GMT
< Transfer-Encoding: chunked
< Connection: keep-alive
< Location: /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061
< Content-Security-Policy: upgrade-insecure-requests; default-src 'self' 'unsafe-inline' 'unsafe-eval' data: oceancolor.gsfc.nasa.gov *.earthdata.nasa.gov *.google.com *.gstatic.com *.googleapis.com [link]googletagmanager.com [link].google-analytics.com [link].youtube.com s.ytimg.com stats.g.doubleclick.net dap.digitalgov.gov cdn.earthdata.nasa.gov api.ipify.org www.cloudflare.com maxcdn.bootstrapcdn.com platform.twitter.com;
< Strict-Transport-Security: max-age=31536000; includesubdomains; preload
< X-Frame-Options: SAMEORIGIN
<
* Ignoring the response-body
{ [data not shown]
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
* Issue another request to this URL: 'https://oceandata.sci.gsfc.nasa.gov/ob/getfile/PM1ATTNR_NRT.A2022050.1215.061'
* Found bundle for host oceandata.sci.gsfc.nasa.gov: 0x9990e0
* Re-using existing connection! (#0) with host oceandata.sci.gsfc.nasa.gov
* Connected to oceandata.sci.gsfc.nasa.gov (169.154.128.84) port 443 (#0)
* Server auth using Basic with user 'oo_processing'
> GET /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=322e1fd92e865bccf76fa5de7044791423ad0181
>
< HTTP/1.1 502 Bad Gateway
< Server: nginx
< Date: Mon, 21 Feb 2022 22:43:11 GMT
< Content-Type: text/html; charset=utf-8
< Content-Length: 746
< Connection: keep-alive
* Replaced cookie app-obdaac="322e1fd92e865bccf76fa5de7044791423ad0181" for ___domain oceandata.sci.gsfc.nasa.gov, path /, expire 0
< Set-Cookie: app-obdaac=322e1fd92e865bccf76fa5de7044791423ad0181; path=/; secure
<
{ [data not shown]
100 746 100 746 0 0 1318 0 --:--:-- --:--:-- --:--:-- 1318
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
Warning: Transient problem: HTTP error Will retry in 2 seconds. 5 retries
Warning: left.
Throwing away 746 bytes
* Found bundle for host oceandata.sci.gsfc.nasa.gov: 0x9990e0
* Re-using existing connection! (#0) with host oceandata.sci.gsfc.nasa.gov
* Connected to oceandata.sci.gsfc.nasa.gov (169.154.128.84) port 443 (#0)
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Server auth using Basic with user 'oo_processing'
> GET /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=322e1fd92e865bccf76fa5de7044791423ad0181
>
< HTTP/1.1 502 Bad Gateway
< Server: nginx
< Date: Mon, 21 Feb 2022 22:43:13 GMT
< Content-Type: text/html; charset=utf-8
< Content-Length: 746
< Connection: keep-alive
* Replaced cookie app-obdaac="322e1fd92e865bccf76fa5de7044791423ad0181" for ___domain oceandata.sci.gsfc.nasa.gov, path /, expire 0
< Set-Cookie: app-obdaac=322e1fd92e865bccf76fa5de7044791423ad0181; path=/; secure
<
{ [data not shown]
100 746 100 746 0 0 4005 0 --:--:-- --:--:-- --:--:-- 4010
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
Warning: Transient problem: HTTP error Will retry in 2 seconds. 4 retries
Warning: left.
Throwing away 746 bytes
* Found bundle for host oceandata.sci.gsfc.nasa.gov: 0x9990e0
* Re-using existing connection! (#0) with host oceandata.sci.gsfc.nasa.gov
* Connected to oceandata.sci.gsfc.nasa.gov (169.154.128.84) port 443 (#0)
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Server auth using Basic with user 'oo_processing'
> GET /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=322e1fd92e865bccf76fa5de7044791423ad0181
>
< HTTP/1.1 502 Bad Gateway
< Server: nginx
< Date: Mon, 21 Feb 2022 22:43:16 GMT
< Content-Type: text/html; charset=utf-8
< Content-Length: 746
< Connection: keep-alive
* Replaced cookie app-obdaac="322e1fd92e865bccf76fa5de7044791423ad0181" for ___domain oceandata.sci.gsfc.nasa.gov, path /, expire 0
< Set-Cookie: app-obdaac=322e1fd92e865bccf76fa5de7044791423ad0181; path=/; secure
<
{ [data not shown]
100 746 100 746 0 0 3959 0 --:--:-- --:--:-- --:--:-- 3968
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
Warning: Transient problem: HTTP error Will retry in 2 seconds. 3 retries
Warning: left.
Throwing away 746 bytes
* Found bundle for host oceandata.sci.gsfc.nasa.gov: 0x9990e0
* Re-using existing connection! (#0) with host oceandata.sci.gsfc.nasa.gov
* Connected to oceandata.sci.gsfc.nasa.gov (169.154.128.84) port 443 (#0)
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Server auth using Basic with user 'oo_processing'
> GET /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=322e1fd92e865bccf76fa5de7044791423ad0181
>
< HTTP/1.1 502 Bad Gateway
< Server: nginx
< Date: Mon, 21 Feb 2022 22:43:18 GMT
< Content-Type: text/html; charset=utf-8
< Content-Length: 746
< Connection: keep-alive
* Replaced cookie app-obdaac="322e1fd92e865bccf76fa5de7044791423ad0181" for ___domain oceandata.sci.gsfc.nasa.gov, path /, expire 0
< Set-Cookie: app-obdaac=322e1fd92e865bccf76fa5de7044791423ad0181; path=/; secure
<
{ [data not shown]
100 746 100 746 0 0 4032 0 --:--:-- --:--:-- --:--:-- 4032
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
Warning: Transient problem: HTTP error Will retry in 2 seconds. 2 retries
Warning: left.
Throwing away 746 bytes
* Found bundle for host oceandata.sci.gsfc.nasa.gov: 0x9990e0
* Re-using existing connection! (#0) with host oceandata.sci.gsfc.nasa.gov
* Connected to oceandata.sci.gsfc.nasa.gov (169.154.128.84) port 443 (#0)
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Server auth using Basic with user 'oo_processing'
> GET /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=322e1fd92e865bccf76fa5de7044791423ad0181
>
< HTTP/1.1 502 Bad Gateway
< Server: nginx
< Date: Mon, 21 Feb 2022 22:43:20 GMT
< Content-Type: text/html; charset=utf-8
< Content-Length: 746
< Connection: keep-alive
* Replaced cookie app-obdaac="322e1fd92e865bccf76fa5de7044791423ad0181" for ___domain oceandata.sci.gsfc.nasa.gov, path /, expire 0
< Set-Cookie: app-obdaac=322e1fd92e865bccf76fa5de7044791423ad0181; path=/; secure
<
{ [data not shown]
100 746 100 746 0 0 3992 0 --:--:-- --:--:-- --:--:-- 4010
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
Warning: Transient problem: HTTP error Will retry in 2 seconds. 1 retries
Warning: left.
Throwing away 746 bytes
* Found bundle for host oceandata.sci.gsfc.nasa.gov: 0x9990e0
* Re-using existing connection! (#0) with host oceandata.sci.gsfc.nasa.gov
* Connected to oceandata.sci.gsfc.nasa.gov (169.154.128.84) port 443 (#0)
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Server auth using Basic with user 'oo_processing'
> GET /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=322e1fd92e865bccf76fa5de7044791423ad0181
>
< HTTP/1.1 502 Bad Gateway
< Server: nginx
< Date: Mon, 21 Feb 2022 22:43:22 GMT
< Content-Type: text/html; charset=utf-8
< Content-Length: 746
< Connection: keep-alive
* Replaced cookie app-obdaac="322e1fd92e865bccf76fa5de7044791423ad0181" for ___domain oceandata.sci.gsfc.nasa.gov, path /, expire 0
< Set-Cookie: app-obdaac=322e1fd92e865bccf76fa5de7044791423ad0181; path=/; secure
<
{ [data not shown]
100 746 100 746 0 0 4019 0 --:--:-- --:--:-- --:--:-- 4032
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
[bmurch@optics0] ~ $ date; ll ./PM1ATTNR_NRT.A2022050.1215.061; cat ./PM1ATTNR_NRT.A2022050.1215.061
Mon Feb 21 17:43:38 EST 2022
-rw-rw-r-- 1 bmurch usfuser 746 Feb 21 17:43 ./PM1ATTNR_NRT.A2022050.1215.061

<!doctype html>
<html lang='en'>
<head>
<meta charset='utf-8'>
<title>ERROR @ Ocean Biology Distributed Active Archive Center (OB.DAAC)</title>
<meta name='viewport' content='width=device-width, initial-scale=1'>
</head>
<body link=white vlink=white alink=white style='background-color:#1C4960; color:white; font-size:175%'>
<br>
<hr color= #666699>
<center>
<h1>
<b>.:. ERROR .:.</b>
</h1>
<h2>Ocean Biology Distributed Active Archive Center (OB.DAAC)</h2>
<blockquote>We are sorry, but an error has occurred. Please use the back button to return to the previous page</blockquote>
<hr color= #666699>
</body>
</html>
<!-- IE needs 512+ bytes: [http]://blogs.msdn.com/b/ieinternals/archive/2010/08/19/http-error-pages-in-internet-explorer.aspx -->

From work IPv6:
[bmurch@optics0] ~ $ curl -v -b ~/.urs_cookies -c ~/.urs_cookies -L -n --interface 2607:fe50:0:6330::104 --retry 5 --retry-delay 2 --max-time 0 --output ./PM1ATTNR_NRT.A2022050.1215.061 https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/PM1ATTNR_NRT.A2022050.1215.061
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* About to connect() to oceandata.sci.gsfc.nasa.gov port 443 (#0)
* Trying 2001:4d0:2418:128::84...
* Name '2607:fe50:0:6330::104' family 10 resolved to '2607:fe50:0:6330::104' family 10
* Local port: 0
* Connected to oceandata.sci.gsfc.nasa.gov (2001:4d0:2418:128::84) port 443 (#0)
* Initializing NSS with certpath: sql:/etc/pki/nssdb
* CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
* SSL connection using TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256
* Server certificate:
* subject: CN=oceancolor.gsfc.nasa.gov
* start date: Jan 28 13:02:19 2022 GMT
* expire date: Apr 28 13:02:18 2022 GMT
* common name: oceancolor.gsfc.nasa.gov
* issuer: CN=R3,O=Let's Encrypt,C=US
* Server auth using Basic with user 'oo_processing'
> GET /cgi/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=322e1fd92e865bccf76fa5de7044791423ad0181
>
< HTTP/1.1 302 Found
< Server: nginx
< Date: Mon, 21 Feb 2022 22:45:41 GMT
< Transfer-Encoding: chunked
< Connection: keep-alive
< Location: /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061
< Content-Security-Policy: upgrade-insecure-requests; default-src 'self' 'unsafe-inline' 'unsafe-eval' data: oceancolor.gsfc.nasa.gov *.earthdata.nasa.gov *.google.com *.gstatic.com *.googleapis.com [link]googletagmanager.com www.google-analytics.com www.youtube.com s.ytimg.com stats.g.doubleclick.net dap.digitalgov.gov cdn.earthdata.nasa.gov api.ipify.org www.cloudflare.com maxcdn.bootstrapcdn.com platform.twitter.com;
< Strict-Transport-Security: max-age=31536000; includesubdomains; preload
< X-Frame-Options: SAMEORIGIN
<
* Ignoring the response-body
{ [data not shown]
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
* Issue another request to this URL: 'https://oceandata.sci.gsfc.nasa.gov/ob/getfile/PM1ATTNR_NRT.A2022050.1215.061'
* Found bundle for host oceandata.sci.gsfc.nasa.gov: 0x1ead140
* Re-using existing connection! (#0) with host oceandata.sci.gsfc.nasa.gov
* Connected to oceandata.sci.gsfc.nasa.gov (2001:4d0:2418:128::84) port 443 (#0)
* Server auth using Basic with user 'oo_processing'
> GET /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=322e1fd92e865bccf76fa5de7044791423ad0181
>
< HTTP/1.1 302 Found
< Server: nginx
< Date: Mon, 21 Feb 2022 22:45:41 GMT
< Transfer-Encoding: chunked
< Connection: keep-alive
< Location: https://urs.earthdata.nasa.gov/oauth/authorize?response_type=code&client_id=Z0u-MdLNypXBjiDREZ3roA&redirect_uri=https%3A%2F%2Foceandata.sci.gsfc.nasa.gov%2Fob%2Fgetfile%2Frestrict
< Expires: Mon, 01 Jan 1970 00:00:00 GMT
< Cache-Control: no-cache, must-revalidate, max-age=0, no-store
< Pragma: no-cache
* Replaced cookie app-obdaac="94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef" for ___domain oceandata.sci.gsfc.nasa.gov, path /, expire 0
< Set-Cookie: app-obdaac=94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef; path=/; secure
< Content-Security-Policy: upgrade-insecure-requests; default-src 'self' 'unsafe-inline' 'unsafe-eval' data: oceancolor.gsfc.nasa.gov *.earthdata.nasa.gov *.google.com *.gstatic.com *.googleapis.com [link]googletagmanager.com www.google-analytics.com www.youtube.com s.ytimg.com stats.g.doubleclick.net dap.digitalgov.gov cdn.earthdata.nasa.gov api.ipify.org www.cloudflare.com maxcdn.bootstrapcdn.com platform.twitter.com;
< Strict-Transport-Security: max-age=31536000; includesubdomains; preload
< X-Frame-Options: SAMEORIGIN
<
* Ignoring the response-body
{ [data not shown]
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
* Issue another request to this URL: 'https://urs.earthdata.nasa.gov/oauth/authorize?response_type=code&client_id=Z0u-MdLNypXBjiDREZ3roA&redirect_uri=https%3A%2F%2Foceandata.sci.gsfc.nasa.gov%2Fob%2Fgetfile%2Frestrict'
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* About to connect() to urs.earthdata.nasa.gov port 443 (#1)
* Trying 2001:4d0:241a:4081::89...
* Name '2607:fe50:0:6330::104' family 10 resolved to '2607:fe50:0:6330::104' family 10
* Local port: 0
0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0* Connected to urs.earthdata.nasa.gov (2001:4d0:241a:4081::89) port 443 (#1)
* CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
* SSL connection using TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
* Server certificate:
* subject: CN=urs.earthdata.nasa.gov,serialNumber=1958-07-29,businessCategory=Government Entity,O=NASA (National Aeronautics and Space Administration),incorporationCountry=US,L=Greenbelt,ST=Maryland,C=US
* start date: Aug 27 16:09:18 2021 GMT
* expire date: Sep 12 16:09:18 2022 GMT
* common name: urs.earthdata.nasa.gov
* issuer: CN=Entrust Certification Authority - L1M,OU="(c) 2014 Entrust, Inc. - for authorized use only",OU=See {link=entrust.net/legal-terms,O="Entrust], Inc.",C=US
* Server auth using Basic with user 'oo_processing'
> GET /oauth/authorize?response_type=code&client_id=Z0u-MdLNypXBjiDREZ3roA&redirect_uri=https%3A%2F%2Foceandata.sci.gsfc.nasa.gov%2Fob%2Fgetfile%2Frestrict HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: urs.earthdata.nasa.gov
> Accept: */*
> Cookie: _urs-gui_session=6419becbb7b823e3e02b8d287a977454; urs_user_already_logged=yes
>
< HTTP/1.1 302 Found
< Server: nginx/1.20.1
< Date: Mon, 21 Feb 2022 22:45:43 GMT
< Content-Type: text/html; charset=utf-8
< Transfer-Encoding: chunked
< Connection: keep-alive
< X-Frame-Options: SAMEORIGIN
< X-XSS-Protection: 1; mode=block
< X-Content-Type-Options: nosniff
< X-Download-Options: noopen
< X-Permitted-Cross-Domain-Policies: none
< Referrer-Policy: strict-origin-when-cross-origin
< Cache-Control: no-store
< Pragma: no-cache
< Expires: Fri, 01 Jan 1990 00:00:00 GMT
< Access-Control-Allow-Origin: null
< Access-Control-Allow-Credentials: true
< Access-Control-Allow-Methods: GET, POST
< Access-Control-Expose-Headers: true
< Location: [link] ://oceandata.sci.gsfc.nasa.gov/ob/getfile/restrict?code=12bb734de54e99e7eaff350343829323b2c9b6e3f7399669d10bf79cc0b56766
* Replaced cookie urs_user_already_logged="yes" for ___domain earthdata.nasa.gov, path /, expire 1645569943
< Set-Cookie: urs_user_already_logged=yes; ___domain=earthdata.nasa.gov; path=/; expires=Tue, 22 Feb 2022 22:45:43 GMT; secure; HttpOnly
* Replaced cookie _urs-gui_session="3fee1d5ad3ff155b441e7b5af5f0f262" for ___domain urs.earthdata.nasa.gov, path /, expire 1645569943
< Set-Cookie: _urs-gui_session=3fee1d5ad3ff155b441e7b5af5f0f262; path=/; expires=Tue, 22 Feb 2022 22:45:43 GMT; HttpOnly
< X-Request-Id: 79dc3171-d3bd-4081-ac94-a649498b66d9
< X-Runtime: 0.048580
< Strict-Transport-Security: max-age=31536000
<
* Ignoring the response-body
{ [data not shown]
0 0 0 191 0 0 90 0 --:--:-- 0:00:02 --:--:-- 161
* Connection #1 to host urs.earthdata.nasa.gov left intact
* Issue another request to this URL: '[link] ://oceandata.sci.gsfc.nasa.gov/ob/getfile/restrict?code=12bb734de54e99e7eaff350343829323b2c9b6e3f7399669d10bf79cc0b56766'
* Found bundle for host oceandata.sci.gsfc.nasa.gov: 0x1ead140
* Re-using existing connection! (#0) with host oceandata.sci.gsfc.nasa.gov
* Connected to oceandata.sci.gsfc.nasa.gov (2001:4d0:2418:128::84) port 443 (#0)
* Server auth using Basic with user 'oo_processing'
> GET /ob/getfile/restrict?code=12bb734de54e99e7eaff350343829323b2c9b6e3f7399669d10bf79cc0b56766 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef
>
< HTTP/1.1 302 Found
< Server: nginx
< Date: Mon, 21 Feb 2022 22:45:43 GMT
< Transfer-Encoding: chunked
< Connection: keep-alive
< Location: /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061
< X-Username: oo_processing
< Expires: Mon, 01 Jan 1970 00:00:00 GMT
< Cache-Control: no-cache, must-revalidate, max-age=0, no-store
< Pragma: no-cache
* Replaced cookie app-obdaac="94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef" for ___domain oceandata.sci.gsfc.nasa.gov, path /, expire 0
< Set-Cookie: app-obdaac=94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef; path=/; secure
< Content-Security-Policy: upgrade-insecure-requests; default-src 'self' 'unsafe-inline' 'unsafe-eval' data: oceancolor.gsfc.nasa.gov *.earthdata.nasa.gov *.google.com *.gstatic.com *.googleapis.com [link]googletagmanager.com www.google-analytics.com www.youtube.com s.ytimg.com stats.g.doubleclick.net dap.digitalgov.gov cdn.earthdata.nasa.gov api.ipify.org www.cloudflare.com maxcdn.bootstrapcdn.com platform.twitter.com;
< Strict-Transport-Security: max-age=31536000; includesubdomains; preload
< X-Frame-Options: SAMEORIGIN
<
* Ignoring the response-body
{ [data not shown]
0 0 0 0 0 0 0 0 --:--:-- 0:00:02 --:--:-- 0
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
* Issue another request to this URL: 'https://oceandata.sci.gsfc.nasa.gov/ob/getfile/PM1ATTNR_NRT.A2022050.1215.061'
* Found bundle for host oceandata.sci.gsfc.nasa.gov: 0x1ead140
* Re-using existing connection! (#0) with host oceandata.sci.gsfc.nasa.gov
* Connected to oceandata.sci.gsfc.nasa.gov (2001:4d0:2418:128::84) port 443 (#0)
* Server auth using Basic with user 'oo_processing'
> GET /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef
>
< HTTP/1.1 502 Bad Gateway
< Server: nginx
< Date: Mon, 21 Feb 2022 22:45:43 GMT
< Content-Type: text/html; charset=utf-8
< Content-Length: 746
< Connection: keep-alive
* Replaced cookie app-obdaac="94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef" for ___domain oceandata.sci.gsfc.nasa.gov, path /, expire 0
< Set-Cookie: app-obdaac=94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef; path=/; secure
<
{ [data not shown]
100 746 100 746 0 0 312 0 0:00:02 0:00:02 --:--:-- 312
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
Warning: Transient problem: HTTP error Will retry in 2 seconds. 5 retries
Warning: left.
Throwing away 746 bytes
* Found bundle for host oceandata.sci.gsfc.nasa.gov: 0x1ead140
* Re-using existing connection! (#0) with host oceandata.sci.gsfc.nasa.gov
* Connected to oceandata.sci.gsfc.nasa.gov (2001:4d0:2418:128::84) port 443 (#0)
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Server auth using Basic with user 'oo_processing'
> GET /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef
>
< HTTP/1.1 502 Bad Gateway
< Server: nginx
< Date: Mon, 21 Feb 2022 22:45:45 GMT
< Content-Type: text/html; charset=utf-8
< Content-Length: 746
< Connection: keep-alive
* Replaced cookie app-obdaac="94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef" for ___domain oceandata.sci.gsfc.nasa.gov, path /, expire 0
< Set-Cookie: app-obdaac=94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef; path=/; secure
<
{ [data not shown]
100 746 100 746 0 0 3978 0 --:--:-- --:--:-- --:--:-- 3989
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
Warning: Transient problem: HTTP error Will retry in 2 seconds. 4 retries
Warning: left.
Throwing away 746 bytes
* Found bundle for host oceandata.sci.gsfc.nasa.gov: 0x1ead140
* Re-using existing connection! (#0) with host oceandata.sci.gsfc.nasa.gov
* Connected to oceandata.sci.gsfc.nasa.gov (2001:4d0:2418:128::84) port 443 (#0)
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Server auth using Basic with user 'oo_processing'
> GET /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef
>
< HTTP/1.1 502 Bad Gateway
< Server: nginx
< Date: Mon, 21 Feb 2022 22:45:48 GMT
< Content-Type: text/html; charset=utf-8
< Content-Length: 746
< Connection: keep-alive
* Replaced cookie app-obdaac="94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef" for ___domain oceandata.sci.gsfc.nasa.gov, path /, expire 0
< Set-Cookie: app-obdaac=94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef; path=/; secure
<
{ [data not shown]
100 746 100 746 0 0 3771 0 --:--:-- --:--:-- --:--:-- 3786
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
Warning: Transient problem: HTTP error Will retry in 2 seconds. 3 retries
Warning: left.
Throwing away 746 bytes
* Found bundle for host oceandata.sci.gsfc.nasa.gov: 0x1ead140
* Re-using existing connection! (#0) with host oceandata.sci.gsfc.nasa.gov
* Connected to oceandata.sci.gsfc.nasa.gov (2001:4d0:2418:128::84) port 443 (#0)
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Server auth using Basic with user 'oo_processing'
> GET /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef
>
< HTTP/1.1 502 Bad Gateway
< Server: nginx
< Date: Mon, 21 Feb 2022 22:45:50 GMT
< Content-Type: text/html; charset=utf-8
< Content-Length: 746
< Connection: keep-alive
* Replaced cookie app-obdaac="94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef" for ___domain oceandata.sci.gsfc.nasa.gov, path /, expire 0
< Set-Cookie: app-obdaac=94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef; path=/; secure
<
{ [data not shown]
100 746 100 746 0 0 4000 0 --:--:-- --:--:-- --:--:-- 3989
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
Warning: Transient problem: HTTP error Will retry in 2 seconds. 2 retries
Warning: left.
Throwing away 746 bytes
* Found bundle for host oceandata.sci.gsfc.nasa.gov: 0x1ead140
* Re-using existing connection! (#0) with host oceandata.sci.gsfc.nasa.gov
* Connected to oceandata.sci.gsfc.nasa.gov (2001:4d0:2418:128::84) port 443 (#0)
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Server auth using Basic with user 'oo_processing'
> GET /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef
>
< HTTP/1.1 502 Bad Gateway
< Server: nginx
< Date: Mon, 21 Feb 2022 22:45:52 GMT
< Content-Type: text/html; charset=utf-8
< Content-Length: 746
< Connection: keep-alive
* Replaced cookie app-obdaac="94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef" for ___domain oceandata.sci.gsfc.nasa.gov, path /, expire 0
< Set-Cookie: app-obdaac=94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef; path=/; secure
<
{ [data not shown]
100 746 100 746 0 0 4215 0 --:--:-- --:--:-- --:--:-- 4238
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
Warning: Transient problem: HTTP error Will retry in 2 seconds. 1 retries
Warning: left.
Throwing away 746 bytes
* Found bundle for host oceandata.sci.gsfc.nasa.gov: 0x1ead140
* Re-using existing connection! (#0) with host oceandata.sci.gsfc.nasa.gov
* Connected to oceandata.sci.gsfc.nasa.gov (2001:4d0:2418:128::84) port 443 (#0)
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Server auth using Basic with user 'oo_processing'
> GET /ob/getfile/PM1ATTNR_NRT.A2022050.1215.061 HTTP/1.1
> Authorization: Basic b29fcHJvY2Vzc2luZzpJZzJpd2tzRkpVaHY=
> User-Agent: curl/7.29.0
> Host: oceandata.sci.gsfc.nasa.gov
> Accept: */*
> Cookie: app-obdaac=94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef
>
< HTTP/1.1 502 Bad Gateway
< Server: nginx
< Date: Mon, 21 Feb 2022 22:45:54 GMT
< Content-Type: text/html; charset=utf-8
< Content-Length: 746
< Connection: keep-alive
* Replaced cookie app-obdaac="94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef" for ___domain oceandata.sci.gsfc.nasa.gov, path /, expire 0
< Set-Cookie: app-obdaac=94ed0f980cc04ffbc2326ad6128a8b76e8f9e5ef; path=/; secure
<
{ [data not shown]
100 746 100 746 0 0 4052 0 --:--:-- --:--:-- --:--:-- 4076
* Connection #0 to host oceandata.sci.gsfc.nasa.gov left intact
[bmurch@optics0] ~ $ date; ll ./PM1ATTNR_NRT.A2022050.1215.061; cat ./PM1ATTNR_NRT.A2022050.1215.061
Mon Feb 21 17:45:57 EST 2022
-rw-rw-r-- 1 bmurch usfuser 746 Feb 21 17:45 ./PM1ATTNR_NRT.A2022050.1215.061

<!doctype html>
<html lang='en'>
<head>
<meta charset='utf-8'>
<title>ERROR @ Ocean Biology Distributed Active Archive Center (OB.DAAC)</title>
<meta name='viewport' content='width=device-width, initial-scale=1'>
</head>
<body link=white vlink=white alink=white style='background-color:#1C4960; color:white; font-size:175%'>
<br>
<hr color= #666699>
<center>
<h1>
<b>.:. ERROR .:.</b>
</h1>
<h2>Ocean Biology Distributed Active Archive Center (OB.DAAC)</h2>
<blockquote>We are sorry, but an error has occurred. Please use the back button to return to the previous page</blockquote>
<hr color= #666699>
</body>
</html>
<!-- IE needs 512+ bytes: [http]://blogs.msdn.com/b/ieinternals/archive/2010/08/19/http-error-pages-in-internet-explorer.aspx -->

<hr color= #666699>
</body>
</html>
<!-- IE needs 512+ bytes: [http]://blogs.msdn.com/b/ieinternals/archive/2010/08/19/http-error-pages-in-internet-explorer.aspx -->

I sent this to Chris Moellers last night while trying to figure this out:

However, it's unlikely that the "Warning: Transient problem: " is due to curl hitting a rate limit on your servers.

I say this because I was testing from my command line at home, when I saw this error occurring in my work processing, as they were happening. My work uses IPv6 ranges, so at work I forced IPv4 with a -4 flag. The same error. And I don't have ipv6 at home, so I would run it again immediately at home, and the same transient errors occur.

It seems unlikely that requests happening at the same time, from different networks, would experience the same issues. It's resulting in many of these errors. Sometimes they pick up again as I showed in the email. Sometimes, they do not and fail with the "oops something's wrong hit the back button" html being written to the outfile. And that causes everything to fail and a huge clean up is required. It is happening with anc, viirs, olci, and modis downloads. Moreover, it's only happening recently, and now frequently.

Cheers,
Brock

Re: anc file always returns as HTML

Posted: Tue Mar 22, 2022 1:31 pm America/New_York
by OB.DAACx - amscott
Hi Brock,

Based on the time your issue occurred, it was, indeed transient. It could have be due to backups running on our database, which creates a temporary lock. We are looking into ways to mitigate this delay in the future, but please be prepared to try your query again after an hour or so when this message occurs. Have you retrieved your data after your last post?

Re: anc file always returns as HTML

Posted: Tue Mar 22, 2022 4:34 pm America/New_York
by oo_processing
I was able to process the files when they moved from _NRT status to final anc status.
All times are UTC-04:00
Page 1 of 1

Powered by phpBB® Forum Software © phpBB Limited