Home

hgcalsim Wiki

Setting up a luigi scheduler on OpenStack

The following steps explain how to setup a luigi scheduler on a CERN OpenStack instance. The process runs inside a docker container and consists of a simple nginx server that handles basic authentication and forwards requests to the luigi scheduler.

1. Setup an instance on OpenStack with the latest CC7 image. For details on creating instances, see the CERN cloud documentation.
2. Setup docker:

yum -y update
yum install -y screen httpd-tools
bash <(curl -s https://gist.githubusercontent.com/riga/8435d647c040cadfbfc8053286b2468d/raw/93311a1bb911064531d1f71702806d814ecc0687/setup_docker.sh)

3. Open port 80 in the firewall:

setsebool -P httpd_can_network_connect 1
firewall-cmd --permanent --add-port=80/tcp
firewall-cmd --reload

4. Create a custom htpasswd file that contains user and password information to access the scheduler:

htpasswd -n -b the_user the_password > htpasswd

5. Start the docker container:

docker run --rm -ti -p 80:80 -v $PWD/htpasswd:/luigi/htpasswd riga/luigid-nginx

Click here for more info on how to configure the container using the docker run command.