Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Irods and davrods: bigger update #3 #612

Merged
merged 23 commits into from
Sep 2, 2022

Conversation

scimerman
Copy link
Contributor

  1. irods upgraded to v4.3.0
    • added unixODBC-devel, python3-devel and gcc-c++ packages so that pyodbc can be built when installed with pip
    • rewrite database_connect.py to use generic/internal irods configuration values (moved to files, as it should work with "native" settings and we will not need our ansible variables anymore - created upstream pull request)
    • (PR Update: exclude irods from updates #610, already accepted) prevented accidental upgrades with yum update
    • fixed postgresql to use same psql command for remote and local database query
  2. replaced certificate with the latest one
  3. updated variables to better reflect where they are used but most important, also where they are stored (V for vault)
  4. davrods
    • improved security with increased cryptographic protocol level, allowed TLS v1.2 and higher only.
    • added handlers for rebuild if any of the files change
  5. davrods docker
    • fix: the rebuilt to work even if there was old image running
    • improve: davrods docker prunes unused images (storage reclaim)
    • fix/improve: updated docker-py to support the python 3, as the 2 was problematic for deploy (and of course, it is outdated ... )

Tested on irods-test ✔️ , deployed on irods-catalogus ✔️
Irods iput, irm tested ✔️ , davrods access tested ✔️
Checked with lattest ansible-lint (6.4.0) ✔️

@scimerman scimerman requested a review from pneerincx August 10, 2022 14:04
group_vars/irods.yml Outdated Show resolved Hide resolved
Comment on lines +12 to 20
# - name: Upgrade pip to latest version
# ansible.builtin.command: pip3 install -U pip
# become: true
- name: Upgrade pip3 to latest version
ansible.builtin.pip:
name: pip
state: latest
executable: pip3
become: true
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This will overwrite the version installed with the RPM using ansible.builtin.yum. Hence this cannot be "frozen" using the Pulp repos and could break other Python3 RPMs. Is this necessary? Or is the python3-pip RPM installed with ansible.builtin.yum good enough?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are a few other Python packages installed with pip3 and without version control:

  1. Install docker-py (supported by python 3)
  2. Install pyodbc with pip3
    Can those be deployed in a python virtual environment for iRODS as opposed to in the default location affecting all Python code on the server?

Copy link
Contributor

@pneerincx pneerincx left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work! Some small questions/comments: see inline.

@scimerman scimerman requested a review from pneerincx September 2, 2022 09:02
ansible.builtin.command: sudo python /var/lib/irods/scripts/setup_irods.py --json_configuration_file=/root/unattended_install.json
when: database_tables.stdout_lines | default([]) | length > 0 and database_tables.stdout is search(".*No relations found.*")
ansible.builtin.command: 'python /var/lib/irods/scripts/setup_irods.py --json_configuration_file=/{{ ir_service_account_home }}/unattended_install.json'
# when: database_tables.stdout_lines | default([]) | length > 0 and database_tables.stdout is search(".*No relations found.*")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this as intended or was the when commented out for testing purposes?

@pneerincx pneerincx merged commit 10eca2a into rug-cit-hpc:develop Sep 2, 2022
@scimerman scimerman deleted the irods_and_davrods branch September 2, 2022 14:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants