Skip to end of metadata
Go to start of metadata

Marine Integrations Camel-Based Prototype Installation and Execution Instructions

Install CentOS 6.2

http://mirror.symnds.com/distributions/CentOS-vault/6.2/isos/x86_64/CentOS-6.2-x86_64-LiveCD.iso

All future steps should occur in the CentOS 6.2 environment.

Install dependencies needed for building Python 2.7

sudo yum install gcc gcc-c++

sudo yum install swig

sudo yum install openssl-devel

cd /tmp

wget http://dl.fedoraproject.org/pub/epel/6/x86_64/udunits2-2.1.19-1.el6.x86_64.rpm

sudo rpm -ivh udunits2-2.1.19-1.el6.x86_64.rpm

cd /tmp

wgethttp://dl.fedoraproject.org/pub/epel/6/x86_64/udunits2-devel-2.1.19-1.el6.x86_64.rpm

sudo rpm -ivh udunits2-devel-2.1.19-1.el6.x86_64.rpm

sudo ln -s /usr/include/udunits2/* /usr/include/

Download, build and install Python 2.7

wget --no-check-certificate http://python.org/ftp/python/2.7.6/Python-2.7.6.tar.xz

tar xf Python-2.7.6.tar.xz

cd Python-2.7.6

./configure --prefix=/usr/local --enable-unicode=ucs4 --enable-shared LDFLAGS="-Wl,-rpath /usr/local/lib"

make

sudo make altinstall

Download and install Python distribute

cd /tmp

wget --no-check-certificate http://pypi.python.org/packages/source/d/distribute/distribute-0.6.35.tar.gz

tar xf distribute-0.6.35.tar.gz

cd distribute-0.6.35

sudo /usr/local/bin/python2.7 setup.py install

Download and install PIP

cd /tmp

wget --no-check-certificate https://bootstrap.pypa.io/get-pip.py
sudo /usr/local/bin/python2.7 get-pip.py

TEMP

pip install CherryPy==3.1.2
pip install coverage==3.7.1
pip install CProfileV==0.1.2
pip install docopt==0.6.2
pip install gdata==2.0.18
pip install h5py==2.3.1
pip install logilab-common==0.63.0
pip install mock==1.0.1
pip install msgpack-python==0.1.13
pip install nose==1.1.2
pip install ntplib==0.3.2
pip install numpy==1.5.0
pip install pylint==1.3.1
pip install python-dateutil==2.2
pip install PyYAML==3.10
pip install Shapely==1.2.16
pip install simplejson==3.6.0

TEMP

Update Settings to Use Python 2.7

Edit ~/.bashrc and add to the bottom:

alias python=/usr/local/bin/python2.7

alias pip=/usr/local/bin/pip2.7

alias easy_install=/usr/local/bin/easy_install-2.7

Install Dependent Python Modules

sudo /usr/local/bin/pip2.7 install numpy==1.8.1

sudo /usr/local/bin/pip2.7 install msgpack_python==0.1.13

sudo /usr/local/bin/pip2.7 install PyYAML==3.10

sudo /usr/local/bin/pip2.7 install ntplib==0.3.2

sudo /usr/local/bin/pip2.7 install simplejson==3.6.0

sudo /usr/local/bin/pip2.7 install nose==1.3.3

Download and Install JDK 8

Download jdk 8 linux x64 rpm from

http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html

sudo rpm -ivh jdk-8u11-linux-x64.rpm

Update to include jdk8 java in path:

sudo vi /etc/profile.d/jdk.sh

export JAVA_HOME=/usr/java/jdk1.8.0_11

export PATH=${JAVA_HOME}/bin:${PATH}

cd /tmp

wgethttp://apache.mirrors.lucidnetworks.net/maven/maven-3/3.2.2/binaries/apache-maven-3.2.2-bin.zip

cd /usr/local

sudo unzip /tmp/apache-maven-3.2.2-bin.zip

Update to include maven in path:

sudo vi /etc/profile.d/maven.sh

export M2_HOME=/usr/local/apache-maven-3.2.2

export PATH=${M2_HOME}/bin:${PATH}

logout and login to gain PATH changes

Download and Install JEP

cd /tmp

wget http://downloads.sourceforge.net/project/jepp/jep/3.1/jep-3.1.0.tar.gz?r=http%3A%2F%2Fsourceforge.net%2Fprojects%2Fjepp%2F&ts=1407105252&use_mirror=tcpdiag

sudo tar xvzf jep-3.1.0.tar.gz

sudo su -

export JAVA_HOME=/usr/java/jdk1.8.0_11

cd /tmp/jep-3.1.0

/usr/local/bin/python2.7 setup.py install

exit

cd /usr/local/lib/jep/

mvn install:install-file -Dfile=jep.jar -DgroupId=jep -DartifactId=jep -Dversion=3.1 -Dpackaging=jar

Download and Install the QPID Broker Server and Run It

cd /tmp

wget http://www.dsgnwrld.com/am/qpid/0.28/qpid-java-broker-0.28.tar.gz

tar xvzf qpid-java-broker-0.28.tar.gz

cd qpid-java-broker-0.28

./bin/qpid-server

Extract the Java and Python Prototype Tar Balls

cd /tmp

tar xvzf ooi-mi-prototype-python.tgz

tar xvzf ooi-mi-prototype-java.tgz

Clean the Java Project and Run the Java App

cd /tmp/ooi-mi-prototype-java

mvn clean install

export LD_LIBRARY_PATH=/usr/local/lib:/usr/local/lib/python2.7/site-packages

export LD_PRELOAD=/usr/local/lib/libpython2.7.so

mvn compile exec:java -Djava.library.path=/usr/local/lib/python2.7/site-packages  -Dexec.mainClass=ooi.mi.dataset.Main | tee /tmp/prototype.out 2>&1

After a large amount of debug statements, you should see the following every 3 seconds:

DEBUG [Camel (camelContextObj) thread #3 - [file://target/wfp_eng_wfp_sio_mule]] (GenericFileConsumer.java:118) - Took 0.001 seconds to poll: target/wfp_eng_wfp_sio_mule

DEBUG [Camel (camelContextObj) thread #1 - [file://target/moas_gl_adcpa]] (GenericFileConsumer.java:118) - Took 0.001 seconds to poll: target/moas_gl_adcpa

DEBUG [Camel (camelContextObj) thread #2 - [file://target/ctdpf_ckl_mmp_cds]] (GenericFileConsumer.java:118) - Took 0.000 seconds to poll: target/ctdpf_ckl_mmp_cds

Login to the QPID Broker

firefox

Enter URL “http://localhost:8080

Login using username admin and password admin

Deploy Sample Files to be Harvested

cd /tmp

cp ooi-mi-prototype-python/mi/dataset/driver/WFP_ENG/wfp/resource/wfp_eng_wfp_sio_mule_small.DAT ooi-mi-prototype-java/target/wfp_eng_wfp_sio_mule/node58p1.dat

cp ooi-mi-prototype-python/mi/dataset/driver/ctdpf_ckl/mmp_cds/resource/ctd_1_20131124T005004_458.mpk ooi-mi-prototype-java/target/ctdpf_ckl_mmp_cds/

cp ooi-mi-prototype-python/mi/dataset/driver/moas/gl/adcpa/resource/LB180210_50.PD0 ooi-mi-prototype-java/target/moas_gl_adcpa/

View QPID Broker Queues

Refresh the firefox QPID admin console window, then browse to:

ooi-mi-prototype-python.tgz

Enter labels to add to this page:
Please wait 
Looking for a label? Just start typing.