From Fedora Project Wiki

No edit summary
 
(9 intermediate revisions by 2 users not shown)
Line 7: Line 7:
= Deploying ResultsDB as Apache2/wsgi application =
= Deploying ResultsDB as Apache2/wsgi application =


Install apache and mod_wsgi
Make all the steps as 'root', if not specified otherwise.
  yum install httpd mod_wsgi
 
Install apache and mod_wsgi using [[dnf|DNF]] or [[yum|YUM]]:
  dnf|yum install httpd mod_wsgi


Install and configure mysql
Install and configure mysql
  yum install mysql-server
  dnf|yum install mysql-server mysql-devel git
  chkconfig mysqld on
  chkconfig mysqld on
  service mysqld start
  service mysqld start
Line 24: Line 26:


Setup base virtualenv  
Setup base virtualenv  
  yum install python-pycurl python-fedora MySQL-python python-virtualenv gcc
  dnf|yum install python-pycurl python-fedora MySQL-python python-virtualenv gcc libcurl-devel
  mkdir -p /usr/local/pythonenv
  mkdir -p /usr/local/pythonenv
  cd /usr/local/pythonenv
  cd /usr/local/pythonenv
  virtualenv resultsdb
  virtualenv --system-site-packages resultsdb
  chown -R apache:apache resultsdb
  chown -R apache:apache resultsdb


Line 37: Line 39:
  git clone git://git.fedorahosted.org/ResultsDB.git resultsdb
  git clone git://git.fedorahosted.org/ResultsDB.git resultsdb
  source /usr/local/pythonenv/resultsdb/bin/activate
  source /usr/local/pythonenv/resultsdb/bin/activate
  easy_install -i http://www.turbogears.org/2.1/downloads/current/index tg.devtools
  easy_install -i http://www.turbogears.org/2.1/downloads/2.1.5/index tg.devtools
  cd /usr/local/pythonenv/git/resultsdb/resultsdb/
  cd /usr/local/pythonenv/git/resultsdb/resultsdb/
  python setup.py develop
  python setup.py develop
Edit the 'development.ini' file adding the password defined above
sqlalchemy.url=mysql://resultsdb:'TOP_SECRET_PASSWORD'@localhost:3306/resultsdb
Then
paster setup-app development.ini
  exit
  exit
  source /usr/local/pythonenv/resultsdb/bin/activate
  source /usr/local/pythonenv/resultsdb/bin/activate
Line 117: Line 123:


= Developer Setup =
= Developer Setup =
Make all the steps as a non-root user, if not specified otherwise.


Install and configure mysql
Install and configure mysql
  yum install mysql-server
  sudo dnf|yum install mysql-server
  chkconfig mysqld on
  sudo chkconfig mysqld on
  service mysqld start
  sudo service mysqld start
  /usr/bin/mysqladmin -u root password 'new-password'
  sudo /usr/bin/mysqladmin -u root password 'new-password'


  mysql -u root -p
  mysql -u root -p
Line 132: Line 140:


Prepare virtualenv environment
Prepare virtualenv environment
  yum install gcc sqlite-devel python-virtualenv
  sudo dnf|yum install gcc sqlite-devel python-virtualenv


  virtualenv --system-site-packages tg2env
  virtualenv --system-site-packages tg2env
  cd tg2env
  cd tg2env
  source bin/activate
  source bin/activate
  easy_install -i http://www.turbogears.org/2.1/downloads/current/index tg.devtools
  easy_install -i http://www.turbogears.org/2.1/downloads/2.1.5/index tg.devtools


Download ResultsDB from GIT
Download ResultsDB from GIT
Line 144: Line 152:


Install dependencies and setup the application
Install dependencies and setup the application
  yum install python-pycurl python-fedora MySQL-python
  sudo dnf|yum install python-pycurl python-fedora MySQL-python
  python setup.py develop
  python setup.py develop
  paster setup-app development.ini
  paster setup-app development.ini
Also, don't forget to populate the 'Testcase' table. If you intend to use ResultsDB with AutoQA, this should be enough:
INSERT INTO `Testcase`(`name`, `url`) VALUES ("not specified","https://fedoraproject.org/wiki/User:Jskladan/Sandbox:EMPTY_Testcase_Metadata")


== ResultsDB ==
== ResultsDB ==
Line 179: Line 191:
  deactivate
  deactivate


[[Category:ResultsDB]] [[Category:AutoQA]]
[[Category:ResultsDB_Legacy]]
[[Category:AutoQA]]

Latest revision as of 13:56, 5 October 2015

This article describes the installation process of ResultsDB to be used together with AutoQA.

Prerequisities

Installed Fedora 14+ or RHEL 6, preferably in a virtual environment.

Deploying ResultsDB as Apache2/wsgi application

Make all the steps as 'root', if not specified otherwise.

Install apache and mod_wsgi using DNF or YUM:

dnf|yum install httpd mod_wsgi

Install and configure mysql

dnf|yum install mysql-server mysql-devel git
chkconfig mysqld on
service mysqld start
/usr/bin/mysqladmin -u root password 'new-password'
mysql -u root -p
create database resultsdb;
grant usage on *.* to resultsdb@localhost identified by 'TOP_SECRET_PASSWORD';
grant all privileges on resultsdb.* to resultsdb@localhost;
exit

Setup base virtualenv

dnf|yum install python-pycurl python-fedora MySQL-python python-virtualenv gcc libcurl-devel
mkdir -p /usr/local/pythonenv
cd /usr/local/pythonenv
virtualenv --system-site-packages resultsdb
chown -R apache:apache resultsdb

Clone the resultsdb git & initialize the base virtualenv

mkdir git
chown apache:apache git
sudo -u apache bash
cd git
git clone git://git.fedorahosted.org/ResultsDB.git resultsdb
source /usr/local/pythonenv/resultsdb/bin/activate
easy_install -i http://www.turbogears.org/2.1/downloads/2.1.5/index tg.devtools
cd /usr/local/pythonenv/git/resultsdb/resultsdb/
python setup.py develop

Edit the 'development.ini' file adding the password defined above

sqlalchemy.url=mysql://resultsdb:'TOP_SECRET_PASSWORD'@localhost:3306/resultsdb

Then

paster setup-app development.ini
exit
source /usr/local/pythonenv/resultsdb/bin/activate

Install modwsgi deploy helper tool

cd ~/
easy_install bzr
mkdir modwsgideploy
cd modwsgideploy
bzr branch http://bazaar.launchpad.net/~mcfletch/modwsgideploy/parameterized/
cd parameterized/trunk
python setup.py develop

Prepare the actual deployment data

mkdir /usr/local/turbogears
cd /usr/local/pythonenv/git/resultsdb/resultsdb/
cp -r ../resultsdb /usr/local/turbogears/
paster make-config resultsdb production.ini
mv production.ini /usr/local/turbogears/resultsdb
mkdir /usr/local/turbogears/resultsdb/python-eggs
cd /usr/local/pythonenv/
chown -R apache:apache resultsdb

Use the modwsgi_deploy tool to create apache config files

cd /usr/local/turbogears/resultsdb
paster modwsgi_deploy --logging -b /usr/local/pythonenv/resultsdb 

Apacheuser needs to own the deployed directory & files

chown -R apache:apache /usr/local/turbogears/resultsdb

And we need to setup the links in virtualenv correctly for the /usr/local/turbogears/resultsdb

cd  /usr/local/turbogears/resultsdb
python setup.py develop
deactivate


Config files

Copy apache config file

cp /usr/local/turbogears/resultsdb/apache/resultsdb /etc/httpd/conf.d/resultsdb.conf

Edit /usr/local/turbogears/resultsdb/production.ini

[Default] -> debug = false
[app:main] -> full_stack = false
[app:main] -> set debug = false
[app:main] -> sqlalchemy.url = mysql://resultsdb:TOP_SECRET_PASSWORD@localhost:3306/resultsdb

<http://stackoverflow.com/questions/3579850/mod-wsgi-not-working-with-pinax-of-django>

add "WSGISocketPrefix /var/run/wsgi" (without quotes) to /etc/httpd/conf.d/wsgi.conf

Change /etc/httpd/conf.d/resultsdb.conf

Original line:
    WSGIScriptAlias /resultsdb/ /usr/local/turbogears/resultsdb/apache/resultsdb.wsgi
Change line to (notice the deleted slash at the end of the originally '/resultsdb/'):
    WSGIScriptAlias /resultsdb /usr/local/turbogears/resultsdb/apache/resultsdb.wsgi

Change /usr/local/turbogears/resultsdb/apache/resultsdb.wsgi (sometimes, the line is already OK, so just leave it there :))

Original line:
    site.addsitedir('/usr/local/pythonenv/resultsdb/resultsdb/lib/python2.6/site-packages')
Changed line:
    site.addsitedir('/usr/local/pythonenv/resultsdb/lib/python2.6/site-packages')

Restart the httpd service, and try to access http://url.of.your.server/resultsdb/ you should see the ResultsDB's "man" page.


Populating MySQL database

source /usr/local/pythonenv/resultsdb/bin/activate
cd /usr/local/turbogears/resultsdb
paster setup-app production.ini
deactivate


Also, don't forget to populate the 'Testcase' table. If you intend to use ResultsDB with AutoQA, this should be enough:

INSERT INTO Testcase(name, url) VALUES ("not specified","https://fedoraproject.org/wiki/User:Jskladan/Sandbox:EMPTY_Testcase_Metadata")

Developer Setup

Make all the steps as a non-root user, if not specified otherwise.

Install and configure mysql

sudo dnf|yum install mysql-server
sudo chkconfig mysqld on
sudo service mysqld start
sudo /usr/bin/mysqladmin -u root password 'new-password'
mysql -u root -p
create database resultsdb;
grant usage on *.* to resultsdb@localhost identified by '9zWyNtmBmHcUe6Yn';
grant all privileges on resultsdb.* to resultsdb@localhost;
exit

Prepare virtualenv environment

sudo dnf|yum install gcc sqlite-devel python-virtualenv
virtualenv --system-site-packages tg2env
cd tg2env
source bin/activate
easy_install -i http://www.turbogears.org/2.1/downloads/2.1.5/index tg.devtools

Download ResultsDB from GIT

git clone git://git.fedorahosted.org/ResultsDB.git resultsdb
cd resultsdb/resultsdb

Install dependencies and setup the application

sudo dnf|yum install python-pycurl python-fedora MySQL-python
python setup.py develop
paster setup-app development.ini

Also, don't forget to populate the 'Testcase' table. If you intend to use ResultsDB with AutoQA, this should be enough:

INSERT INTO Testcase(name, url) VALUES ("not specified","https://fedoraproject.org/wiki/User:Jskladan/Sandbox:EMPTY_Testcase_Metadata")

ResultsDB

Start the ResultsDB instance in screen

screen -S resultsdb
paster serve development.ini --reload

Turbogears welcome screen should be now visible on http://localhost:8081. Either press Ctrl+ad to send screen to background, or open another terminal.

Test the XMLRPC interface

python
import xmlrpclib
s = xmlrpclib.ServerProxy("http://localhost:8081/xmlrpc", allow_none = 1)
s.get_metadata("https://fedoraproject.org/wiki/User:Jskladan/Sandbox:Rpmlint_Testcase_Metadata")

Expected result:

{'required_keyval': ['pkg_name', 'envr', 'arch', 'owner']}

Exit Python shell

exit()

Stop the application

If you used the screen terminal to run ResultsDB, reattach it using

screen -r resultsdb

or switch to the terminal window in which you started the application.


Press Ctrl+c to kill the running Turbogears application. Then stop the virtualenv

deactivate