Most files coming down as HTML

[oo_processing]

I am almost always being blocked on d/ling files and different machines. ( a couple have snuck through):

(machine A)
$ curl -b .urs_cookies_single -c .urs_cookies_single -L --retry 5 --retry-delay 2 --max-time 0 --output ./N202101412_MET_NCEPR2_6h.hdf https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N202101412_MET_NCEPR2_6h.hdf
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:01 --:--:--     0
  0     0    0 12248    0     0   7168      0 --:--:--  0:00:01 --:--:-- 57233
$ file ./N202101412_MET_NCEPR2_6h.hdf
./N202101412_MET_NCEPR2_6h.hdf: HTML document, ASCII text, with very long lines

(machine A)
$ curl -b .urs_cookies_single -c .urs_cookies_single -L --retry 5 --retry-delay 2 --max-time 0 --output ./PM1ATTNR.P2021013.1600.003 https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/PM1ATTNR.P2021013.1600.003
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:--  0:00:01 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:01 --:--:--     0
  0     0    0 12248    0     0   6811      0 --:--:--  0:00:01 --:--:--  6811
$ file ./PM1ATTNR.P2021013.1600.003
./PM1ATTNR.P2021013.1600.003:   HTML document, ASCII text, with very long lines

(machine B)
$ curl -b .urs_cookies_single -c .urs_cookies_single -L -n --interface 2607:fe50:0:6330::103 --retry 5 --retry-delay 2 --max-time 0 --output ./A2020309195500.L1A_LAC.bz2 https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/A2020309195500.L1A_LAC.bz2
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 213M 100  213M    0     0  47.9M      0  0:00:04  0:00:04 --:--:-- 85.9M
$ file A2020309195500.L1A_LAC.bz2
A2020309195500.L1A_LAC.bz2: bzip2 compressed data, block size = 100k
$ bunzip2 A2020309195500.L1A_LAC.bz2
$ file A2020309195500.L1A_LAC
A2020309195500.L1A_LAC: Hierarchical Data Format (version 4) data

And immediately next, this one fails (machine B)
$ curl -b .urs_cookies_single -c .urs_cookies_single -L --retry 5 --retry-delay 2 --max-time 0 --output ./PM1ATTNR.P2021013.1400.003 https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/PM1ATTNR.P2021013.1400.003
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  8422    0  8422    0     0   8446      0 --:--:-- --:--:-- --:--:--  8446
$ file ./PM1ATTNR.P2021013.1400.003
./PM1ATTNR.P2021013.1400.003: HTML document text
$ less ./PM1ATTNR.P2021013.1400.003
$ grep logged ./PM1ATTNR.P2021013.1400.003
      You are already logged in, and we are redirecting you back to the previous site.

attachment 1

attachment 2

attachment 3

[OB ODPS - jgwilding]

Have you tried adding the --netrc option to your command?  I ran your command and got the same HTML output, but adding the --netrc option brought down the actual data.

john

[oo_processing]

Thanks John,

I copied and pasted, and left out the -n
And then I had a disk fill...
And I was having connection issues yesterday, so I missed it.

Doah,
Long Weeked

[oo_processing]

John,

I'm having similar issues again, but with the -r flag. I posted here:
https://oceancolor.gsfc.nasa.gov/forum/oceancolor/topic_show.pl?tid=12950