Skip to content

How to set up dcc data and dcc portal on cumulus

Kevin Hartmann edited this page Jun 6, 2019 · 1 revision

How to set up cumulus

  1. Set up the server on cumulus using the web api at https:///cumulus.oicr.on.ca/
    a. Create a cumulus server with running Debian 9.
    b. Give it the "microservice" security policy (ie. allow ports 8080, 8443, etc.)
    c. Give it a floating IP address, and put the hostname & IP address into your /etc/hosts file
    d. eg. `echo 10.30.134.150 test-hdfs >> /etc/hosts``
    e. Create a key for server, copy the private key into a file eg. ~/ssh/hdfs
  1. Set a variable hostname with the name of the host hostname=test-hdfs
  2. Set variable keyfile with the location of the private key file in step 0. keyfile=~/ ssh/test-hdfs
  3. Log in using ssh:ssh -i ${keyfile} debian@${hostname}
  4. Install mongodb: sudo apt install mongodb, Y
  5. Install Java sudo apt install openjdk-8-jre, Y
  6. exit
  7. Download & build portal server locally, copy tarball to cumulus
git clone [email protected]:icgc-dcc/dcc-portal
cd dcc-portal
mvn clean package
cd dcc-portal-server
scp -i ${keyfile} target/*.tar.gz debian@${hostname}:.
  1. Download & build download server, copy it to cumulus
git clone [email protected]:icgc-dcc/dcc-download
cd dcc-download
mvn clean package
cd dcc-download-server
scp -i ${keyfile} target/*.tar.gz debian@${hostname}:.
  1. Log into the server: ssh -i ${keyfile} debian@${hostname}
  2. Untar files
for t in *.tar.gz
    do tar xf $t && rm $t
done
  1. Make symlinks
ln -s dcc-download-server* download
ln -s dcc-portal-server* portal'
  1. Start the services
export HADOOP_USER_NAME=hdfs
cd download
bin/dcc-download-server start
cd
cd portal
bin/dcc-portal-server start
  1. Go to the web site in the browser (& accept the self-signed certificate) eg. firefox $hostname:8080/releases
Clone this wiki locally