IP blocked

[junzhao]

Hi there,

Since Dec 6, it seems that our access to the ocean color data archive and website is blocked. I confirm that we do have internet access.

When I run wget https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/A2018352054500.L0_LAC.bz2, what I got is

--2018-12-19 13:19:34--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/A2018352054500.L0_LAC.bz2
Resolving oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)... 2001:4d0:2418:128::84, xx.xxx.xx.xx
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|2001:4d0:2418:128::84|:443... failed: Connection timed out.
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|xx.xxx.xx.xx|:443... failed: Connection timed out.
Retrying.

--2018-12-19 13:23:56--  (try: 2)  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/A2018352054500.L0_LAC.bz2
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|2001:4d0:2418:128::84|:443... failed: Connection timed out.
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|xx.xxx.xx.xx|:443... failed: Connection timed out.
Retrying.

--2018-12-19 13:28:19--  (try: 3)  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/A2018352054500.L0_LAC.bz2
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|2001:4d0:2418:128::84|:443... failed: Connection timed out.

The computer kept retrying.

Our IP addresses are
xx.xxx.xx.xx
xx.xxx.xx.xx

I also tried to get access to the ocean color website via browser. It failed either.

Would you please check for me? Greatly appreciated.

Jun

[OB WebDev - norman]

Hi Jun,

You will need to provide a public IP address for us to check.
https://www.google.com/search?&q=what+is+my+ip

Please see the following for help diagnosing your problem.

https://oceancolor.gsfc.nasa.gov/forum/oceancolor/topic_show.pl?tid=6447

Regards,
Norman

[junzhao]

Hi Norman,

Thanks for your reply. The IP address is xx.xxx.xx.xx.

Following the link for diagnosis, what I got is as follows:

1. traceroute oceancolor.gsfc.nasa.gov

traceroute to oceancolor.gsfc.nasa.gov (xx.xxx.xx.xx), 30 hops max, 60 byte packets
1  xx.xxx.xx.xx (xx.xxx.xx.xx)  0.883 ms  0.920 ms  0.956 ms
2  xx.xxx.xx.xx (xx.xxx.xx.xx)  0.259 ms  0.288 ms  0.272 ms
3  xx.xxx.xx.xx (xx.xxx.xx.xx)  3.673 ms  3.601 ms  3.708 ms
4  xx.xxx.xx.xx (xx.xxx.xx.xx)  3.991 ms  4.713 ms  4.038 ms
5  xx.xxx.xx.xx (xx.xxx.xx.xx)  6.110 ms  6.297 ms  6.117 ms
6  xx.xxx.xx.xx (xx.xxx.xx.xx)  6.104 ms  5.786 ms  6.040 ms
7  xx.xxx.xx.xx (xx.xxx.xx.xx)  8.309 ms xx.xxx.xx.xx (xx.xxx.xx.xx)  8.435 ms xx.xxx.xx.xx (xx.xxx.xx.xx)  10.064 ms
8  xx.xxx.xx.xx.broad.dg.gd.dynamic.163data.com.cn (xx.xxx.xx.xx)  6.638 ms  9.343 ms xx.xxx.xx.xx.broad.dg.gd.dynamic.163data.com.cn (xx.xxx.xx.xx)  8.262 ms
9  xx.xxx.xx.xx (xx.xxx.xx.xx)  10.359 ms xx.xxx.xx.xx (xx.xxx.xx.xx)  9.600 ms xx.xxx.xx.xx (xx.xxx.xx.xx)  9.099 ms
10  xx.xxx.xx.xx (xx.xxx.xx.xx)  7.323 ms  6.832 ms  7.720 ms
11  xx.xxx.xx.xx (xx.xxx.xx.xx)  6.730 ms xx.xxx.xx.xx (xx.xxx.xx.xx)  9.614 ms xx.xxx.xx.xx (xx.xxx.xx.xx)  9.298 ms
12  xx.xxx.xx.xx (xx.xxx.xx.xx)  161.917 ms xx.xxx.xx.xx (xx.xxx.xx.xx)  171.485 ms  171.513 ms
13  xx.xxx.xx.xx (xx.xxx.xx.xx)  167.426 ms  167.387 ms xx.xxx.xx.xx (xx.xxx.xx.xx)  166.714 ms
14  xx.xxx.xx.xx (xx.xxx.xx.xx)  165.217 ms  170.014 ms  165.198 ms
15  dcx2-edge-01.inet.qwest.net (xx.xxx.xx.xx)  215.042 ms  216.263 ms  216.341 ms
16  xx.xxx.xx.xx (xx.xxx.xx.xx)  234.440 ms  237.327 ms  235.409 ms
17  xx.xxx.xx.xx (xx.xxx.xx.xx)  242.824 ms  238.145 ms  238.483 ms
18  * * *
19  * * *
20  * * *
21  * * *
22  * * *
23  * * *
24  * * *
25  * * *
26  * * *
27  * * *
28  * * *
29  * * *
30  * * *

2. wget -d https://oceancolor.gsfc.nasa.gov

DEBUG output created by Wget 1.17.1 on linux-gnu.

Reading HSTS entries from /root/.wget-hsts
URI encoding = 釻TF-8?
--2018-12-20 16:28:47--  https://oceancolor.gsfc.nasa.gov/
Resolving oceancolor.gsfc.nasa.gov (oceancolor.gsfc.nasa.gov)... 2001:4d0:2418:128::44, xx.xxx.xx.xx
Caching oceancolor.gsfc.nasa.gov => 2001:4d0:2418:128::44 xx.xxx.xx.xx
Connecting to oceancolor.gsfc.nasa.gov (oceancolor.gsfc.nasa.gov)|2001:4d0:2418:128::44|:443... Closed fd 3
failed: Connection timed out.
Connecting to oceancolor.gsfc.nasa.gov (oceancolor.gsfc.nasa.gov)|xx.xxx.xx.xx|:443... Closed fd 3
failed: Connection timed out.
Releasing 0x000055fee9363420 (new refcount 1).
Retrying.

--2018-12-20 16:33:09--  (try: 2)  https://oceancolor.gsfc.nasa.gov/
Found oceancolor.gsfc.nasa.gov in host_name_addresses_map (0x55fee9363420)
Connecting to oceancolor.gsfc.nasa.gov (oceancolor.gsfc.nasa.gov)|2001:4d0:2418:128::44|:443... Closed fd 3
failed: Connection timed out.
Connecting to oceancolor.gsfc.nasa.gov (oceancolor.gsfc.nasa.gov)|xx.xxx.xx.xx|:443...

It keep trying.

Thanks.

Jun

[OB WebDev - norman]

Jun,

Our systems folks say that "xx.xxx.xx.xx was temporarily
blocked yesterday. They were automatically unblocked this
morning at 5am."

If you are using accelerators or running aggressive scripts, you
may wish to tune them so as to avoid recurrence of the blocks.

Regards,
Norman

[junzhao]

Hi Norman,

The issue remained. We just used codes to download data using wget.

I tried the command line to download data. Also tried to get data from the browser. But no success. Apparently the ip is still blocked.

Please check the following IP addresses:
xx.xxx.xx.xx
xx.xxx.xx.xx.

Please help this out. Thank you very much.

Jun

[OB WebDev - norman]

Jun,

The following from our system administrators:

     Jun's ips were on multiple block lists. I removed the entries and
     Jun's ips are now connectiong to oceandata according to the logs.

     xx.xxx.xx.xx
     xx.xxx.xx.xx

You may get blocked again if you don't correct whatever behavior
caused the blocks in the first place.

Norman

[junzhao]

Hi Norman,

I forgot to stop connecting to oceandata before you removed the entries. The issue remained.

I killed all processes that connect to oceandata.

Please help this out. Sorry for any inconvenience caused.

Thanks in advance.

Jun

[pfsmith]

Jun,

I checked our firewall logs and have not seen any blocks for those IPs since 12/23.  The problem may be upstream of our servers. Unfortunately we are subject to a partial government shutdown, so our normal ways of looking into the problem from our end are unavailable.  Sorry.

[junzhao]

Dear Smith,

Seems that the partial government shutdown is over now. Can you check if our IPs are still in the blocked list?

Thank you very much.

Jun

[pfsmith]

Jun,
A check shows no blocks at our end.  We saw successful accesses from xx.xxx.xx.xx on 2/8/2019.

Paul