ocssw installation

[mankeshwar_167]

Hi all,

As asked I updated my python to 2.7.13 on the mac and restarted the computer. I can only use the GUI as I have no programing experience and now when I try installing the aqua processor, the installation does not proceed above one percent and I get the following error.

execution exception: java.io.IOException: install_ocssw.py failed with exit code 1.
Check log for more details.
Installing bundles.sha256sum (1 of 13)
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:01 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:02 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:03 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:04 --:--:--     0
  0     0    0     0    0     0      0      0 --:--:--  0:00:05 --:--:--     0curl: (35) Server aborted the SSL handshake
Error - Executing command "cd /Applications/seadas-7.4/ocssw; curl -O --retry 5 --retry-delay 5 https://oceandata.sci.gsfc.nasa.gov/ocssw/bundles.sha256sum"
Bundle checksum file (bundles.sha256sum) not downloaded

please help me figure this out.
Thank you

[gnwiii]

The installer uses a program called "curl" (for "Copy URL") that is failing.   Even with the right software it sometimes takes multiple attempts to finish the installation -- have you tried more than once?  Some site configurations are not compatible with NASA's servers, so you may need to work with your IT people.

Sorry if you posted details previously, but I missed the macOS version you are using.   El Capitan has "/usr/bin/curl " (curl 7.43.0 (x86_64-apple-darwin15.0) libcurl/7.43.0 SecureTransport zlib/1.2.5) is able to run the download that failed for you.

You don't need programming experience to use the macOS command-line.   Our lab (at the Bedford Institute of Oceanography in Nova Scotia) has done many 1 to 2 weeks long Ocean Colour workshops with lectures and "practicals".  The practicals start with an afternoon of learning some basic command-line tools (they are essentially the same for both linux and macOS).  Although we often have participants who come to the workshops thinking they can't use the command line and can't write programs, no one has ever failed to master the basics, and many wrote simple code to compute novel products before the workshop was over.   Although a workshop environment can be more efficient than learning on your own, there are many excellent online resources for individual study.  Have a look at Intro to the OS X Command Line (video) by James Stewart and then linuxcommand.org.

These references mention some advantages of command-line tools, but for the forums, using the command-line makes it easy to paste detailed error messages into a forum post.  For starters, you can try opening a terminal window on the mac and typing the lines folwoing the "$ " prompt below.  I will show the output from an El Capitan system where OCSSW installs are working, but you don't have to have an identical configuration to run the OCSSW installs:

$ which python
/opt/local/bin/python
$ python --version
Python 2.7.14
$ which curl
/opt/local/bin/curl
$ curl --version
curl 7.55.1 (x86_64-apple-darwin15.6.0) libcurl/7.55.1 OpenSSL/1.0.2l zlib/1.2.11
Release-Date: 2017-08-14
Protocols: dict file ftp ftps gopher http https imap imaps pop3 pop3s rtsp smb smbs smtp smtps telnet tftp
Features: AsynchDNS IPv6 Largefile NTLM NTLM_WB SSL libz TLS-SRP UnixSockets HTTPS-proxy


[mankeshwar_167]

Thank you!
The command line seems a little less intimidating now and I will check out the tutorial too :) Also Im using El capitan
I tried the steps and the python version continues to show 2.7 and has not been updated although I did restart the mac after installation.

Mahi:~ Mahi$
Mahi:~ Mahi$ which python
/Library/Frameworks/Python.framework/Versions/2.7/bin/python
Mahi:~ Mahi$ which curl
/Users/Mahi/anaconda/bin/curl
Mahi:~ Mahi$

And id really be interested in attending one of the workshops you mentioned, can you tell me where I can get more information about them?

Mahi

[gnwiii]

First, the python and curl versions.    You have at least two 3rd-party Python packages.   "/Library/Frameworks/Python.framework/Versions/2.7/bin/python" is provided as explained in Using Python (2.7) on a Macintosh.   With a normal install of this package,
you should get:
$ which python
/usr/local/bin/python
$ python --version
Python 2.7.14
The installer creates /usr/local/bin/python as a "symbolic link" to  "/Library/Frameworks/Python.framework/Versions/2.7/bin/python". 

I'm not sure why you are getting the longer path, and it is tricky to manage multiple python installations.  I don't think the python.org package works with
the OCSSW scripts, so you need to:

1. check that the anaconda package will work

2. ensure that ""which python finds anaconda python 2.7.

The Anaconda Python package provides  "/Users/Mahi/anaconda/bin/curl".   Anaconda's python 2.7 is known to work with the OCSSW software.  I tried anaconda curl here and it  works where your example failed:


$ ~/anaconda/bin/python --version
Python 2.7.13 :: Continuum Analytics, Inc.
$ ~/anaconda/bin/curl --version
curl 7.52.1 (x86_64-apple-darwin13.4.0) libcurl/7.52.1 OpenSSL/1.0.2l zlib/1.2.8
Protocols: dict file ftp ftps gopher http https imap imaps pop3 pop3s rtsp smb smbs smtp smtps telnet tftp
Features: IPv6 Largefile NTLM NTLM_WB SSL libz TLS-SRP UnixSockets HTTPS-proxy
$ ~/anaconda/bin/curl -O --retry 5 --retry-delay 5 https://oceandata.sci.gsfc.nasa.gov/ocssw/bundles.sha256sum
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  2736  100  2736    0     0  11860      0 --:--:-- --:--:-- --:--:-- 12106


To check the versions of  your python.org and anaconda pythons:


$ /Library/Frameworks/Python.framework/Versions/2.7/bin/python2.7 --version
Python 2.7.14
/Library/Frameworks/Python.framework/Versions/2.7/bin/python2.7 -c 'import ssl ; print ssl.OPENSSL_VERSION'
OpenSSL 0.9.8zh 14 Jan 2016


Unfortunately, the python2.7 from python.org appears to link against Apple's obsolete OpenSSL library, so doesn't work with the OCSSW scripts.  If you don't have other Python applications that require a particular version, I recommend anaconda because it is used by other OCSSW users and because it can provide a number of useful 3rd party tools for working with NetCDF4-CF data.  

The anaconda installer should have added the line:
export PATH="/Users/Mahi/anaconda/bin:$PATH" to the end of the file "/Users/Mahi/.profile"
There may be a"comment" symbol ("#") in front of this line.  If so, removing it and then logging out and back end should  give:

$ which python
/Users/Mahi/anaconda/bin/python
python --version
Python 2.7.13 :: Continuum Analytics, Inc.

As for workshops (and short courses), look for announcements in these forums and at the IOCCG page.

[jianwei.wei]

Hi,
I just re-installed SeaDAS 7.4 on our UBUNTU 12 server. But when i tried to install the ocssw, I received the following messages. Any advice what is going on?
The current git version is 2.14.2; Python is 2.7.3; and I have downloaded all the bundles to the hard disk beforehand.

Thank you
Jianwei
------------------

$ ./install_ocssw.py

Installing bundles.sha256sum (1 of 9)
--2017-10-05 17:06:27--  https://oceandata.sci.gsfc.nasa.gov/ocssw/bundles.sha256sum
Resolving oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)... xx.xxx.xx.xx, 2001:4d0:2418:128::84
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2736 (2.7K) [application/octet-stream]
Saving to: `bundles.sha256sum'

100%[======================================>] 2,736       --.-K/s   in 0s     

2017-10-05 17:06:27 (1.03 GB/s) - `bundles.sha256sum' saved [2736/2736]

Installing common (2 of 9)
fatal: unable to access 'https://oceandata.sci.gsfc.nasa.gov/ocssw/common.git/': gnutls_handshake() failed: A TLS fatal alert has been received.
Error - Could not run "cd /mnt/data0/seadas-7.4/ocssw/run/data/common; git fetch -q > /dev/null"

[OB.DAACx - SeanBailey]

Older systems with git built agains GNUTLS will have issues.  See this thread for some tips:
https://oceancolor.gsfc.nasa.gov/forum/oceancolor/topic_show.pl?pid=27714

[gnwiii]

You may find it better use of your time to upgrade the system to a current distribution such as Ubuntu 16.04 LTS which should work without the need to install additonal packages and will be getting offical updaes from Ubuntu for a few more years.  

The link in Sean's post should help with the git problem, but you will probably have problems with Ubuntu's python because it uses the obsolete system libraries.  If anaconda python2 runs on your system it should work (because anaconda provides newer versions of the suppporting libraries).