Skip to content

capstone-coal/coal-sds

Folders and files

NameName
Last commit message
Last commit date

Latest commit

954eec3 · Dec 4, 2018

History

34 Commits
Dec 4, 2018
Dec 4, 2018
Oct 19, 2018
Dec 4, 2018
Dec 4, 2018
Dec 4, 2018
Dec 4, 2018
Mar 9, 2017
Feb 8, 2018
Dec 4, 2018
Mar 9, 2017
Mar 9, 2017
Feb 23, 2018
Dec 4, 2018
Dec 4, 2018

Repository files navigation

coal-sds

An Apache OODT-powered Science Data System (SDS) for COAL.

Introduction

coal-sds is an end-to-end SDS capable of managing the data lifecycle (aquisition, cataloging, archival, retrieval, processing, etc.) required for COAL. The Apache OODT-poweredSDS itself consists of several components which when run as services, allow users to really explore COAL in its entirety.

Requirements

  • Java Development Kit (JDK) 1.8+
  • JAVA_HOME set
  • MAVEN and Prerequisite POM File

Installation

Build OODT

Place the complete coal-sds file inside of your EC2 instance.

$ mvn clean package -Pfm-solr-catalog -DskipTests

Typically efficient and effective cataloguing is achieved by passing the -Pfm-solr-catalog option as this allows all data flowing into the SDS to be persisted into Apache Solr.

Deploy OODT

$ mkdir /usr/local/coal-sds-deploy
$ tar -zxvf distribution/target/coal-sds-distribution-*-bin.tar.gz -C /usr/local/coal-sds-deploy/

If you experience issues with permissions, you may need to include sudo in front of those commands.

NOTE: For other build configurations, add the following arguments: (default) : bin, crawler, data, extensions, filemgr (Lucene), logs, pcs, resmgr, tomcat, workflow, pge

-Pfm-solr-catalog : default components, filemgr (Solr), solr, tomcat/webapps/solr

Basic COAL-SDS File Management

See Basic File Management COAL SDS

License

coal-sds is licensed permissively under the Apache License v2.0 a copy of which ships with this code.