Skip to end of metadata
Go to start of metadata

Marine Integrations Camel-Based Prototype Installation and Execution Instructions

Install CentOS 6.2

All future steps should occur in the CentOS 6.2 environment.

Install dependencies needed for building Python 2.7

sudo yum install gcc gcc-c++

sudo yum install swig

sudo yum install openssl-devel

cd /tmp


sudo rpm -ivh udunits2-2.1.19-1.el6.x86_64.rpm

cd /tmp


sudo rpm -ivh udunits2-devel-2.1.19-1.el6.x86_64.rpm

sudo ln -s /usr/include/udunits2/* /usr/include/

Download, build and install Python 2.7

wget --no-check-certificate

tar xf Python-2.7.6.tar.xz

cd Python-2.7.6

./configure --prefix=/usr/local --enable-unicode=ucs4 --enable-shared LDFLAGS="-Wl,-rpath /usr/local/lib"


sudo make altinstall

Download and install Python distribute

cd /tmp

wget --no-check-certificate

tar xf distribute-0.6.35.tar.gz

cd distribute-0.6.35

sudo /usr/local/bin/python2.7 install

Download and install PIP

cd /tmp

wget --no-check-certificate
sudo /usr/local/bin/python2.7


pip install CherryPy==3.1.2
pip install coverage==3.7.1
pip install CProfileV==0.1.2
pip install docopt==0.6.2
pip install gdata==2.0.18
pip install h5py==2.3.1
pip install logilab-common==0.63.0
pip install mock==1.0.1
pip install msgpack-python==0.1.13
pip install nose==1.1.2
pip install ntplib==0.3.2
pip install numpy==1.5.0
pip install pylint==1.3.1
pip install python-dateutil==2.2
pip install PyYAML==3.10
pip install Shapely==1.2.16
pip install simplejson==3.6.0


Update Settings to Use Python 2.7

Edit ~/.bashrc and add to the bottom:

alias python=/usr/local/bin/python2.7

alias pip=/usr/local/bin/pip2.7

alias easy_install=/usr/local/bin/easy_install-2.7

Install Dependent Python Modules

sudo /usr/local/bin/pip2.7 install numpy==1.8.1

sudo /usr/local/bin/pip2.7 install msgpack_python==0.1.13

sudo /usr/local/bin/pip2.7 install PyYAML==3.10

sudo /usr/local/bin/pip2.7 install ntplib==0.3.2

sudo /usr/local/bin/pip2.7 install simplejson==3.6.0

sudo /usr/local/bin/pip2.7 install nose==1.3.3

Download and Install JDK 8

Download jdk 8 linux x64 rpm from

sudo rpm -ivh jdk-8u11-linux-x64.rpm

Update to include jdk8 java in path:

sudo vi /etc/profile.d/

export JAVA_HOME=/usr/java/jdk1.8.0_11

export PATH=${JAVA_HOME}/bin:${PATH}

cd /tmp


cd /usr/local

sudo unzip /tmp/

Update to include maven in path:

sudo vi /etc/profile.d/

export M2_HOME=/usr/local/apache-maven-3.2.2

export PATH=${M2_HOME}/bin:${PATH}

logout and login to gain PATH changes

Download and Install JEP

cd /tmp


sudo tar xvzf jep-3.1.0.tar.gz

sudo su -

export JAVA_HOME=/usr/java/jdk1.8.0_11

cd /tmp/jep-3.1.0

/usr/local/bin/python2.7 install


cd /usr/local/lib/jep/

mvn install:install-file -Dfile=jep.jar -DgroupId=jep -DartifactId=jep -Dversion=3.1 -Dpackaging=jar

Download and Install the QPID Broker Server and Run It

cd /tmp


tar xvzf qpid-java-broker-0.28.tar.gz

cd qpid-java-broker-0.28


Extract the Java and Python Prototype Tar Balls

cd /tmp

tar xvzf ooi-mi-prototype-python.tgz

tar xvzf ooi-mi-prototype-java.tgz

Clean the Java Project and Run the Java App

cd /tmp/ooi-mi-prototype-java

mvn clean install

export LD_LIBRARY_PATH=/usr/local/lib:/usr/local/lib/python2.7/site-packages

export LD_PRELOAD=/usr/local/lib/

mvn compile exec:java -Djava.library.path=/usr/local/lib/python2.7/site-packages  -Dexec.mainClass=ooi.mi.dataset.Main | tee /tmp/prototype.out 2>&1

After a large amount of debug statements, you should see the following every 3 seconds:

DEBUG [Camel (camelContextObj) thread #3 - [file://target/wfp_eng_wfp_sio_mule]] ( - Took 0.001 seconds to poll: target/wfp_eng_wfp_sio_mule

DEBUG [Camel (camelContextObj) thread #1 - [file://target/moas_gl_adcpa]] ( - Took 0.001 seconds to poll: target/moas_gl_adcpa

DEBUG [Camel (camelContextObj) thread #2 - [file://target/ctdpf_ckl_mmp_cds]] ( - Took 0.000 seconds to poll: target/ctdpf_ckl_mmp_cds

Login to the QPID Broker


Enter URL “http://localhost:8080

Login using username admin and password admin

Deploy Sample Files to be Harvested

cd /tmp

cp ooi-mi-prototype-python/mi/dataset/driver/WFP_ENG/wfp/resource/wfp_eng_wfp_sio_mule_small.DAT ooi-mi-prototype-java/target/wfp_eng_wfp_sio_mule/node58p1.dat

cp ooi-mi-prototype-python/mi/dataset/driver/ctdpf_ckl/mmp_cds/resource/ctd_1_20131124T005004_458.mpk ooi-mi-prototype-java/target/ctdpf_ckl_mmp_cds/

cp ooi-mi-prototype-python/mi/dataset/driver/moas/gl/adcpa/resource/LB180210_50.PD0 ooi-mi-prototype-java/target/moas_gl_adcpa/

View QPID Broker Queues

Refresh the firefox QPID admin console window, then browse to:


Enter labels to add to this page:
Please wait 
Looking for a label? Just start typing.