AmiGO2 install: Difference between revisions
No edit summary |
|||
Line 1: | Line 1: | ||
== GOLR install: == | == GOLR install: == | ||
Install the 3.6 version of SOLR | |||
===SOLR=== | ===SOLR=== | ||
Line 54: | Line 38: | ||
Had to modify that script as follows to make it work on CentOS: | Had to modify that script as follows to make it work on CentOS: | ||
[elserj@palea amigo]$ diff /etc/init.d/solr /etc/init.d/solr.org | |||
16,19d15 | 16,19d15 | ||
< # Source function library. | < # Source function library. | ||
Line 61: | Line 45: | ||
< | < | ||
24c20 | 24c20 | ||
< daemon "cd /data/www/planteome_dev/SOLR/example; java -jar start.jar &> /var/log/solr/solr.log &" | < daemon "cd /data/www/planteome_dev/SOLR/example; java -jar /data/www/planteome_dev/SOLR/example/start.jar &> /var/log/solr/solr.log &" | ||
--- | --- | ||
> daemon --chdir='/data/www/plantome_dev/example' --command "java -jar start.jar" --respawn --output=/var/log/solr/solr.log --name=solr --verbose | > daemon --chdir='/data/www/plantome_dev/example' --command "java -jar start.jar" --respawn --output=/var/log/solr/solr.log --name=solr --verbose | ||
40c36 | 40c36 | ||
< ps -aef | grep | < ps -aef | grep -v planteome_dev2 | grep planteome_dev | grep -v grep | awk '{print $2}' | xargs -i++ kill -9 ++ | ||
--- | --- | ||
> daemon --stop --name=solr --verbose | > daemon --stop --name=solr --verbose | ||
At this point, SOLR is now running. Next is to load data to it. | At this point, SOLR is now running. Next is to load data to it. | ||
==AmiGO2 install== | ==AmiGO2 install== | ||
Copy the example amigo.yaml file and make the following changes: | |||
<pre> | |||
[elserj@palea conf]$ diff amigo.yaml examples/amigo.yaml.localhost-planteome | |||
<pre>[elserj@palea conf]$ diff amigo.yaml . | |||
5c5 | 5c5 | ||
< value: http://planteome.org/amigo/cgi-bin/crop-amigo | < value: http://planteome.org/amigo/cgi-bin/crop-amigo/go.cgi | ||
--- | --- | ||
> value: http://amigo1.geneontology.org/cgi-bin/amigo | > value: http://amigo1.geneontology.org/cgi-bin/amigo | ||
17c17 | 17c17 | ||
< value: /data/www/ | < value: /data/www/planteome_dev2/amigo/perl/bin | ||
--- | --- | ||
> value: /home/sjcarbon/local/src/git/amigo/perl/bin | > value: /home/sjcarbon/local/src/git/amigo/perl/bin | ||
21c21 | 21c21 | ||
< value: http:// | < value: http://test.planteome.org | ||
--- | --- | ||
> value: http://localhost:9999 | > value: http://localhost:9999 | ||
32a33,37 | |||
< value: http:// | > - model_annotation | ||
> - noctua_model_meta | |||
> - family | |||
> - general | |||
> - bbop_term_ac | |||
40c45 | |||
< value: http://galaxy.planteome.org/ | |||
--- | --- | ||
> value: http:// | > value: http://galaxy.berkeleybop.org/ | ||
42c47 | |||
< value: /data/www/ | < comment: 'The public URL of the GOlr server (including slash); this is the one called by AmiGO resource, JS, etc.' | ||
--- | |||
> comment: The public URL of the GOlr server (including slash); this is the one called by AmiGO resource, JS, etc. | |||
44c49 | |||
< value: http://test.planteome.org/solr/ | |||
--- | |||
> value: http://dev.planteome.org/solr/ | |||
48c53 | |||
< value: http://noctua.planteome.org/ | |||
--- | |||
> value: http://noctua.berkeleybop.org/ | |||
52c57 | |||
< value: /data/www/planteome_dev2/amigo | |||
--- | --- | ||
> value: /home/sjcarbon/local/src/git/amigo | > value: /home/sjcarbon/local/src/git/amigo | ||
56c61 | |||
< value: planteome | < value: test.planteome.org | ||
--- | --- | ||
> value: localhost | > value: localhost | ||
60c65 | |||
< value: /data/www/ | < value: /data/www/planteome_dev2/amigo/static | ||
--- | --- | ||
> value: /home/sjcarbon/local/src/git/amigo/static | > value: /home/sjcarbon/local/src/git/amigo/static | ||
64c69 | |||
< value: http:// | < value: http://test.planteome.org/static | ||
--- | --- | ||
> value: http://localhost:9999/static | > value: http://localhost:9999/static | ||
68c73 | |||
< value: 'all|[ | < value: 'all|[PGTE]O:[0-9]{7}' | ||
--- | --- | ||
> value: 'all|GO:[0-9]{7}' | > value: 'all|GO:[0-9]{7}' | ||
76c81 | |||
< value: | < value: 1.0 | ||
--- | --- | ||
> value: | > value: 2.3.2 | ||
78c83 | |||
< | < comment: 'Please enter the full path to readable/writable directory that will be used for things like temporary files, logs (if enabled), and the golr_timestamp.log file.' | ||
--- | --- | ||
> | > comment: Please enter the full path to readable/writable directory that will be used for things like temporary files, logs (if enabled), and the golr_timestamp.log file. | ||
89,91c94,98 | |||
< | < - file:///data/www/planteome_dev/amigo/associations/eo-associations/eo_diversity_arabidopsis.assoc | ||
< - file:///data/www/planteome_dev/amigo/associations/po-associations/po_anatomy_gene_arabidopsis_tair.assoc | |||
< - file:///data/www/planteome_dev/amigo/associations/to-associations/to_diversity_arabidopsis.assoc | |||
--- | --- | ||
> value: / | > - http://www.geneontology.org/gene-associations/gene_association.mgi.gz | ||
> - http://www.geneontology.org/gene-associations/gene_association.goa_human.gz | |||
> - http://www.geneontology.org/gene-associations/gene_association.goa_ref_human.gz | |||
> - http://www.geneontology.org/gene-associations/gene_association.goa_uniprot_noiea.gz | |||
> - http://www.geneontology.org/gene-associations/gene_association.reactome.gz | |||
96,99c103,110 | |||
< - /data/www/planteome_dev/amigo/metadata/ont-config.yaml | |||
< - /data/www/planteome_dev/amigo/metadata/bio-config.yaml | |||
< - /data/www/planteome_dev/amigo/metadata/ann-config.yaml | |||
< - /data/www/planteome_dev/amigo/metadata/general-config.yaml | |||
--- | |||
> - '~/local/src/git/amigo/metadata/ont-config.yaml' | |||
> - '~/local/src/git/amigo/metadata/bio-config.yaml' | |||
> - '~/local/src/git/amigo/metadata/ann-config.yaml' | |||
> - '~/local/src/git/amigo/metadata/general-config.yaml' | |||
> - '~/local/src/git/amigo/metadata/model-ann-config.yaml' | |||
> - '~/local/src/git/amigo/metadata/noctua-model-meta-config.yaml' | |||
> - '~/local/src/git/amigo/metadata/protein-family-config.yaml' | |||
> - '~/local/src/git/amigo/metadata/ann_ev_agg-config.yaml' | |||
103c114 | |||
< value: /data/www/planteome_dev2/amigo/metadata/ont-config.yaml | |||
--- | |||
> value: '~/local/src/git/amigo/metadata/ont-config.yaml' | |||
107c118 | |||
< value: /data/www/planteome_dev2/noctua-models/models/ | |||
--- | |||
> value: '~/local/src/git/noctua-models/models/' | |||
112c123 | |||
< - file:///data/www/planteome_dev2/amigo/ontology_files/planteome.owl | |||
--- | |||
> - http://purl.obolibrary.org/obo/go/extensions/go-plus.owl | |||
120c131 | |||
< value: 20G | |||
--- | |||
> value: 3G | |||
</pre> | </pre> | ||
Now to run <pre> | Now to run <pre>npm install</pre> | ||
===Configure Apache2=== | ===Configure Apache2=== | ||
Line 250: | Line 214: | ||
<pre>ftp://ftp.pbone.net/mirror/ftp.pramberger.at/systems/linux/contrib/rhel6/x86_64/mod_macro-1.1.11-2.el6.pp.x86_64.rpm | <pre>ftp://ftp.pbone.net/mirror/ftp.pramberger.at/systems/linux/contrib/rhel6/x86_64/mod_macro-1.1.11-2.el6.pp.x86_64.rpm | ||
sudo rpm -Uvih mod_macro-1.1.11-2.el6.pp.x86_64.rpm</pre> | sudo rpm -Uvih mod_macro-1.1.11-2.el6.pp.x86_64.rpm</pre> | ||
The log files need to be created or else Apache will not start: | |||
<pre>mkdir log | |||
touch log/access.log | |||
touch log/error.log | |||
sudo chown root: log/*.log | |||
</pre> | |||
The proxy settings are to make it so the Server is able to talk to the SOLR data. | The proxy settings are to make it so the Server is able to talk to the SOLR data. | ||
Line 257: | Line 229: | ||
Note that this cannot go in it's own VirtualHost section as it will error because of a VirtualHost inside a VirtualHost | Note that this cannot go in it's own VirtualHost section as it will error because of a VirtualHost inside a VirtualHost | ||
===Run amigo2 installer=== | |||
<pre>./node_modules/.bin/gulp install</pre> | |||
===Load ontologies=== | |||
<pre> | <pre>./node_modules/.bin/gulp load-ontology</pre> | ||
===Load associations=== | |||
<pre>./node_modules/.bin/gulp load-gafs</pre> | |||
At this point Amigo2 appears to be working. | At this point Amigo2 appears to be working. | ||
Line 273: | Line 244: | ||
==Notes from older install that may still be relevant== | |||
At one point from doing an older install, it needed a missing yui-compressor, so need to get that installed. (May no longer be relevant) | |||
<pre> | |||
sudo mkdir /usr/local/share/yui-compressor | |||
sudo chown elserj: /usr/local/share/yui-compressor | |||
cd /usr/local/share/yui-compressor | |||
wget https://github.com/downloads/yui/yuicompressor/yuicompressor-2.4.7.zip | |||
unzip yuicompressor-2.4.7.zip | |||
</pre> | |||
Create the following script in /usr/local/bin/yui-comprssor | |||
<pre> | |||
#!/bin/sh | |||
# Quick and dirty front-end script to the yui-compressor that emulates | |||
# /usr/bin/yuicompressor script from Ubuntu release | |||
# | |||
JAVA_HOME=/usr/java/default | |||
YUI_JAR=/usr/local/share/yui-compressor/yuicompressor-2.4.7/build/yuicompressor-2.4.7.jar | |||
# Run YUI Compressor | |||
/usr/bin/java -jar $YUI_JAR "$@" | |||
</pre> | |||
Make it executable with <pre>sudo chmod +x /usr/local/bin/yui-compressor</pre> | |||
Again, earlier install had a missing perl module. Installed the following via cpan: | |||
<pre>CGI::Application::Plugin::Forward</pre> | |||
<pre>CGI::Application::Dispatch</pre> | |||
'''This page will be updated as I progress.''' | '''This page will be updated as I progress.''' |
Revision as of 22:57, 12 November 2015
GOLR install:
Install the 3.6 version of SOLR
SOLR
Grab the 3.6 version of SOLR from apache and unpack:
wget http://archive.apache.org/dist/lucene/solr/3.6.2/apache-solr-3.6.2.tgz tar zxvf apache-solr-3.6.2.tgz
Pull down the latest version of AmiGO:
cd /data/www/planteome_dev git clone https://github.com/geneontology/amigo.git amigo
Go back to the SOLR directory and replace the config with those from GOLR:
cd /data/www/planteome_dev/SOLR/example/solr/conf cp schema.xml schema.xml.org cp solrconfig.xml solrconfig.xml.org cp /data/www/planteome_dev/amigo/golr/solr/conf/s* ./
I don't see any edits that need to be made at this point. I think when we move to additional ontologies, we will have to modify schema.xml to account for new relationship types. Cross that bridge when we get there.
Start SOLR(GOLR):
cd ../../ (be in the example directory) java -jar start.jar
Now that it seems to be starting up fine, daemonise it so that it runs at a service at boot (Note that any service needs to be okayed by Chris before started):
Add the init.d script as outlined on this page
Had to modify that script as follows to make it work on CentOS:
[elserj@palea amigo]$ diff /etc/init.d/solr /etc/init.d/solr.org 16,19d15 < # Source function library. < [ -f /etc/rc.d/init.d/functions ] || exit 0 < . /etc/rc.d/init.d/functions < 24c20 < daemon "cd /data/www/planteome_dev/SOLR/example; java -jar /data/www/planteome_dev/SOLR/example/start.jar &> /var/log/solr/solr.log &" --- > daemon --chdir='/data/www/plantome_dev/example' --command "java -jar start.jar" --respawn --output=/var/log/solr/solr.log --name=solr --verbose 40c36 < ps -aef | grep -v planteome_dev2 | grep planteome_dev | grep -v grep | awk '{print $2}' | xargs -i++ kill -9 ++ --- > daemon --stop --name=solr --verbose
At this point, SOLR is now running. Next is to load data to it.
AmiGO2 install
Copy the example amigo.yaml file and make the following changes:
[elserj@palea conf]$ diff amigo.yaml examples/amigo.yaml.localhost-planteome 5c5 < value: http://planteome.org/amigo/cgi-bin/crop-amigo/go.cgi --- > value: http://amigo1.geneontology.org/cgi-bin/amigo 17c17 < value: /data/www/planteome_dev2/amigo/perl/bin --- > value: /home/sjcarbon/local/src/git/amigo/perl/bin 21c21 < value: http://test.planteome.org --- > value: http://localhost:9999 32a33,37 > - model_annotation > - noctua_model_meta > - family > - general > - bbop_term_ac 40c45 < value: http://galaxy.planteome.org/ --- > value: http://galaxy.berkeleybop.org/ 42c47 < comment: 'The public URL of the GOlr server (including slash); this is the one called by AmiGO resource, JS, etc.' --- > comment: The public URL of the GOlr server (including slash); this is the one called by AmiGO resource, JS, etc. 44c49 < value: http://test.planteome.org/solr/ --- > value: http://dev.planteome.org/solr/ 48c53 < value: http://noctua.planteome.org/ --- > value: http://noctua.berkeleybop.org/ 52c57 < value: /data/www/planteome_dev2/amigo --- > value: /home/sjcarbon/local/src/git/amigo 56c61 < value: test.planteome.org --- > value: localhost 60c65 < value: /data/www/planteome_dev2/amigo/static --- > value: /home/sjcarbon/local/src/git/amigo/static 64c69 < value: http://test.planteome.org/static --- > value: http://localhost:9999/static 68c73 < value: 'all|[PGTE]O:[0-9]{7}' --- > value: 'all|GO:[0-9]{7}' 76c81 < value: 1.0 --- > value: 2.3.2 78c83 < comment: 'Please enter the full path to readable/writable directory that will be used for things like temporary files, logs (if enabled), and the golr_timestamp.log file.' --- > comment: Please enter the full path to readable/writable directory that will be used for things like temporary files, logs (if enabled), and the golr_timestamp.log file. 89,91c94,98 < - file:///data/www/planteome_dev/amigo/associations/eo-associations/eo_diversity_arabidopsis.assoc < - file:///data/www/planteome_dev/amigo/associations/po-associations/po_anatomy_gene_arabidopsis_tair.assoc < - file:///data/www/planteome_dev/amigo/associations/to-associations/to_diversity_arabidopsis.assoc --- > - http://www.geneontology.org/gene-associations/gene_association.mgi.gz > - http://www.geneontology.org/gene-associations/gene_association.goa_human.gz > - http://www.geneontology.org/gene-associations/gene_association.goa_ref_human.gz > - http://www.geneontology.org/gene-associations/gene_association.goa_uniprot_noiea.gz > - http://www.geneontology.org/gene-associations/gene_association.reactome.gz 96,99c103,110 < - /data/www/planteome_dev/amigo/metadata/ont-config.yaml < - /data/www/planteome_dev/amigo/metadata/bio-config.yaml < - /data/www/planteome_dev/amigo/metadata/ann-config.yaml < - /data/www/planteome_dev/amigo/metadata/general-config.yaml --- > - '~/local/src/git/amigo/metadata/ont-config.yaml' > - '~/local/src/git/amigo/metadata/bio-config.yaml' > - '~/local/src/git/amigo/metadata/ann-config.yaml' > - '~/local/src/git/amigo/metadata/general-config.yaml' > - '~/local/src/git/amigo/metadata/model-ann-config.yaml' > - '~/local/src/git/amigo/metadata/noctua-model-meta-config.yaml' > - '~/local/src/git/amigo/metadata/protein-family-config.yaml' > - '~/local/src/git/amigo/metadata/ann_ev_agg-config.yaml' 103c114 < value: /data/www/planteome_dev2/amigo/metadata/ont-config.yaml --- > value: '~/local/src/git/amigo/metadata/ont-config.yaml' 107c118 < value: /data/www/planteome_dev2/noctua-models/models/ --- > value: '~/local/src/git/noctua-models/models/' 112c123 < - file:///data/www/planteome_dev2/amigo/ontology_files/planteome.owl --- > - http://purl.obolibrary.org/obo/go/extensions/go-plus.owl 120c131 < value: 20G --- > value: 3G
Now to run
npm install
Configure Apache2
The Apache config file needs to be modified
[elserj@palea amigo]$ diff amigo2-apache-local.conf conf/amigo2-apache.conf 2,4c2,3 < <VirtualHost *:80> < ServerAdmin elserj@science.oregonstate.edu < ServerName dev.planteome.org --- > <VirtualHost *:9999> > ServerAdmin sjcarbon@localhost 8c7 < DocumentRoot /data/www/planteome_dev/amigo --- > DocumentRoot /home/sjcarbon/local/src/git/amigo 11c10 < <Directory /data/www/planteome_dev/amigo/static> --- > <Directory /home/sjcarbon/local/src/git/amigo/static> 20c19 < ScriptAlias /$binnm /data/www/planteome_dev/amigo/perl/bin/$binnm --- > ScriptAlias /$binnm /home/sjcarbon/local/src/git/amigo/perl/bin/$binnm 48,59c47,48 < < ProxyRequests Off < <Proxy *> < Order deny,allow < Allow from 192.168.1.52 < </Proxy> < < ProxyPass /solr http://localhost:8983/solr < ProxyPassReverse /solr http://localhost:8983/solr < < ErrorLog /data/www/planteome_dev/amigo/log/error.log < ScriptLog /data/www/planteome_dev/amigo/log/cgi.log --- > ErrorLog /var/log/apache2/error.log > ScriptLog /var/log/apache2/cgi.log 65c54 < CustomLog /data/www/planteome_dev/amigo/log/access.log combined --- > CustomLog /var/log/apache2/access.log combined
For this to work, the mod_macro module for Apache must be installed. I found it as a downloadable rpm, so I installed it that way:
ftp://ftp.pbone.net/mirror/ftp.pramberger.at/systems/linux/contrib/rhel6/x86_64/mod_macro-1.1.11-2.el6.pp.x86_64.rpm sudo rpm -Uvih mod_macro-1.1.11-2.el6.pp.x86_64.rpm
The log files need to be created or else Apache will not start:
mkdir log touch log/access.log touch log/error.log sudo chown root: log/*.log
The proxy settings are to make it so the Server is able to talk to the SOLR data.
I changed the /etc/httpd/conf/httpd.conf file to have the following line for the dev.planteome.org section
Include /data/www/planteome_dev/amigo/amigo2-apache-local.conf
Note that this cannot go in it's own VirtualHost section as it will error because of a VirtualHost inside a VirtualHost
Run amigo2 installer
./node_modules/.bin/gulp install
Load ontologies
./node_modules/.bin/gulp load-ontology
Load associations
./node_modules/.bin/gulp load-gafs
At this point Amigo2 appears to be working.
Notes from older install that may still be relevant
At one point from doing an older install, it needed a missing yui-compressor, so need to get that installed. (May no longer be relevant)
sudo mkdir /usr/local/share/yui-compressor sudo chown elserj: /usr/local/share/yui-compressor cd /usr/local/share/yui-compressor wget https://github.com/downloads/yui/yuicompressor/yuicompressor-2.4.7.zip unzip yuicompressor-2.4.7.zip
Create the following script in /usr/local/bin/yui-comprssor
#!/bin/sh # Quick and dirty front-end script to the yui-compressor that emulates # /usr/bin/yuicompressor script from Ubuntu release # JAVA_HOME=/usr/java/default YUI_JAR=/usr/local/share/yui-compressor/yuicompressor-2.4.7/build/yuicompressor-2.4.7.jar # Run YUI Compressor /usr/bin/java -jar $YUI_JAR "$@"
Make it executable with
sudo chmod +x /usr/local/bin/yui-compressor
Again, earlier install had a missing perl module. Installed the following via cpan:
CGI::Application::Plugin::Forward
CGI::Application::Dispatch
This page will be updated as I progress.