gitlab_runner is not idempotent on first run after runner creation #5907

cfiehe · 2023-01-28T11:41:03Z

Summary

On the first run after a GitLab runner creation, Ansible reports a change, although the configuration has not changed in the meanwhile. All subsequent runs on the other hand are idempotent.

Issue Type

Bug Report

Component Name

gitlab_runner

Ansible Version

ansible [core 2.14.1]
  config file = None
  configured module search path = ['/home/ansible/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
  ansible python module location = /home/ansible/.local/lib/python3.10/site-packages/ansible
  ansible collection location = /home/ansible/.ansible/collections:/usr/share/ansible/collections
  executable location = /home/ansible/.local/bin/ansible
  python version = 3.10.6 (main, Nov 14 2022, 16:10:14) [GCC 11.3.0] (/usr/bin/python3)
  jinja version = 3.0.3
  libyaml = True

Community.general Version

Collection        Version
----------------- -------
community.general 6.3.0

Configuration

CONFIG_FILE() = None

OS / Environment

Ubuntu 22.04

Steps to Reproduce

Just create a GitLab runner and re-execute the playbook.

- name: Test playbook
  hosts: localhost
  become: false
  gather_facts: false
  tasks:
    - name: Ensure GitLab runner
      community.general.gitlab_runner:
        api_url: https://git.mycompany.com/
        api_token: "{{ gitlab_runner_api_token }}"
        registration_token: "{{ gitlab_runner_registration_token }}"
        name: Test GitLab Runner
        state: present
        project: loc/test

Expected Results

Ansible should report no change on subsequent runs when the runner configuration has not changed.

Actual Results

$ ansible-playbook test-gitlab-runner.yml -vvvv
ansible-playbook [core 2.14.1]
  config file = /home/ansible/automation/projects/provisioning/ansible.cfg
  configured module search path = ['/home/ansible/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
  ansible python module location = /home/ansible/.local/lib/python3.10/site-packages/ansible
  ansible collection location = /home/ansible/automation/projects/provisioning/collections
  executable location = /home/ansible/.local/bin/ansible-playbook
  python version = 3.10.6 (main, Nov 14 2022, 16:10:14) [GCC 11.3.0] (/usr/bin/python3)
  jinja version = 3.0.3
  libyaml = True
Using /home/ansible/automation/projects/provisioning/ansible.cfg as config file
setting up inventory plugins
host_list declined parsing /etc/ansible/hosts as it did not pass its verify_file() method
Skipping due to inventory source not existing or not being readable by the current user
script declined parsing /etc/ansible/hosts as it did not pass its verify_file() method
auto declined parsing /etc/ansible/hosts as it did not pass its verify_file() method
Skipping due to inventory source not existing or not being readable by the current user
yaml declined parsing /etc/ansible/hosts as it did not pass its verify_file() method
Skipping due to inventory source not existing or not being readable by the current user
ini declined parsing /etc/ansible/hosts as it did not pass its verify_file() method
Skipping due to inventory source not existing or not being readable by the current user
toml declined parsing /etc/ansible/hosts as it did not pass its verify_file() method
[WARNING]: No inventory was parsed, only implicit localhost is available
[WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all'
Loading collection community.general from /home/ansible/automation/projects/provisioning/collections/ansible_collections/community/general
Loading callback plugin default of type stdout, v2.0 from /home/ansible/.local/lib/python3.10/site-packages/ansible/plugins/callback/default.py
Loading collection ansible.posix from /home/ansible/.local/lib/python3.10/site-packages/ansible_collections/ansible/posix
Skipping callback 'default', as we already have a stdout callback.
Skipping callback 'minimal', as we already have a stdout callback.
Skipping callback 'oneline', as we already have a stdout callback.
Loading callback plugin ansible.posix.profile_tasks of type aggregate, v2.0 from /home/ansible/.local/lib/python3.10/site-packages/ansible_collections/ansible/posix/plugins/callback/profile_tasks.py

PLAYBOOK: test-gitlab-runner.yml ***************************************************************************************************************************************************
Positional arguments: test-gitlab-runner.yml
verbosity: 4
connection: smart
timeout: 60
become_method: sudo
tags: ('all',)
inventory: ('/etc/ansible/hosts',)
forks: 5
1 plays in test-gitlab-runner.yml

PLAY [Test playbook] ***************************************************************************************************************************************************************

TASK [Ensure GitLab runner] ********************************************************************************************************************************************************
task path: /home/ansible/automation/projects/provisioning/test-gitlab-runner.yml:7
Saturday 28 January 2023  12:34:22 +0100 (0:00:00.053)       0:00:00.053 ******
<127.0.0.1> ESTABLISH LOCAL CONNECTION FOR USER: ansible
<127.0.0.1> EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /tmp/.ansible-$USER/tmp `"&& mkdir "` echo /tmp/.ansible-$USER/tmp/ansible-tmp-1674905662.979175-3040807-195011873830039 `" && echo ansible-tmp-1674905662.979175-3040807-195011873830039="` echo /tmp/.ansible-$USER/tmp/ansible-tmp-1674905662.979175-3040807-195011873830039 `" ) && sleep 0'
Using module file /home/ansible/automation/projects/provisioning/collections/ansible_collections/community/general/plugins/modules/gitlab_runner.py
<127.0.0.1> PUT /home/ansible/.ansible/tmp/ansible-local-3040798bs03wu04/tmpq8stvhl6 TO /tmp/.ansible-ansible/tmp/ansible-tmp-1674905662.979175-3040807-195011873830039/AnsiballZ_gitlab_runner.py
<127.0.0.1> EXEC /bin/sh -c 'chmod u+x /tmp/.ansible-ansible/tmp/ansible-tmp-1674905662.979175-3040807-195011873830039/ /tmp/.ansible-ansible/tmp/ansible-tmp-1674905662.979175-3040807-195011873830039/AnsiballZ_gitlab_runner.py && sleep 0'
<127.0.0.1> EXEC /bin/sh -c '/usr/bin/python3 /tmp/.ansible-ansible/tmp/ansible-tmp-1674905662.979175-3040807-195011873830039/AnsiballZ_gitlab_runner.py && sleep 0'
<127.0.0.1> EXEC /bin/sh -c 'rm -f -r /tmp/.ansible-ansible/tmp/ansible-tmp-1674905662.979175-3040807-195011873830039/ > /dev/null 2>&1 && sleep 0'
changed: [localhost] => {
    "changed": true,
    "invocation": {
        "module_args": {
            "access_level": "ref_protected",
            "active": true,
            "api_job_token": null,
            "api_oauth_token": null,
            "api_password": null,
            "api_token": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER",
            "api_url": "https://git.mycompany.com/",
            "api_username": null,
            "description": "Test GitLab Runner",
            "locked": false,
            "maximum_timeout": 3600,
            "name": "Test GitLab Runner",
            "owned": false,
            "project": "loc/test",
            "registration_token": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER",
            "run_untagged": true,
            "state": "present",
            "tag_list": [],
            "validate_certs": true
        }
    },
    "msg": "Successfully created or updated the runner Test GitLab Runner",
    "runner": {
        "id": 1232,
        "token": "7Qr-JaAzYS2LH9eAi2HV",
        "token_expires_at": null
    }
}

PLAY RECAP *************************************************************************************************************************************************************************
localhost                  : ok=1    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0

Saturday 28 January 2023  12:34:23 +0100 (0:00:01.004)       0:00:01.057 ******
===============================================================================
Ensure GitLab runner -------------------------------------------------------------------------------------------------------------------------------------------------------- 1.00s
/home/ansible/automation/projects/provisioning/test-gitlab-runner.yml:7 -----------------------------------------------------------------------------------------------------------

$ ansible-playbook test-gitlab-runner.yml -vvvv
ansible-playbook [core 2.14.1]
  config file = /home/ansible/automation/projects/provisioning/ansible.cfg
  configured module search path = ['/home/ansible/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
  ansible python module location = /home/ansible/.local/lib/python3.10/site-packages/ansible
  ansible collection location = /home/ansible/automation/projects/provisioning/collections
  executable location = /home/ansible/.local/bin/ansible-playbook
  python version = 3.10.6 (main, Nov 14 2022, 16:10:14) [GCC 11.3.0] (/usr/bin/python3)
  jinja version = 3.0.3
  libyaml = True
Using /home/ansible/automation/projects/provisioning/ansible.cfg as config file
setting up inventory plugins
host_list declined parsing /etc/ansible/hosts as it did not pass its verify_file() method
Skipping due to inventory source not existing or not being readable by the current user
script declined parsing /etc/ansible/hosts as it did not pass its verify_file() method
auto declined parsing /etc/ansible/hosts as it did not pass its verify_file() method
Skipping due to inventory source not existing or not being readable by the current user
yaml declined parsing /etc/ansible/hosts as it did not pass its verify_file() method
Skipping due to inventory source not existing or not being readable by the current user
ini declined parsing /etc/ansible/hosts as it did not pass its verify_file() method
Skipping due to inventory source not existing or not being readable by the current user
toml declined parsing /etc/ansible/hosts as it did not pass its verify_file() method
[WARNING]: No inventory was parsed, only implicit localhost is available
[WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all'
Loading collection community.general from /home/ansible/automation/projects/provisioning/collections/ansible_collections/community/general
Loading callback plugin default of type stdout, v2.0 from /home/ansible/.local/lib/python3.10/site-packages/ansible/plugins/callback/default.py
Loading collection ansible.posix from /home/ansible/.local/lib/python3.10/site-packages/ansible_collections/ansible/posix
Skipping callback 'default', as we already have a stdout callback.
Skipping callback 'minimal', as we already have a stdout callback.
Skipping callback 'oneline', as we already have a stdout callback.
Loading callback plugin ansible.posix.profile_tasks of type aggregate, v2.0 from /home/ansible/.local/lib/python3.10/site-packages/ansible_collections/ansible/posix/plugins/callback/profile_tasks.py

PLAYBOOK: test-gitlab-runner.yml ***************************************************************************************************************************************************
Positional arguments: test-gitlab-runner.yml
verbosity: 4
connection: smart
timeout: 60
become_method: sudo
tags: ('all',)
inventory: ('/etc/ansible/hosts',)
forks: 5
1 plays in test-gitlab-runner.yml

PLAY [Test playbook] ***************************************************************************************************************************************************************

TASK [Ensure GitLab runner] ********************************************************************************************************************************************************
task path: /home/ansible/automation/projects/provisioning/test-gitlab-runner.yml:7
Saturday 28 January 2023  12:34:26 +0100 (0:00:00.051)       0:00:00.051 ******
<127.0.0.1> ESTABLISH LOCAL CONNECTION FOR USER: ansible
<127.0.0.1> EXEC /bin/sh -c '( umask 77 && mkdir -p "` echo /tmp/.ansible-$USER/tmp `"&& mkdir "` echo /tmp/.ansible-$USER/tmp/ansible-tmp-1674905666.289351-3040847-56819068716431 `" && echo ansible-tmp-1674905666.289351-3040847-56819068716431="` echo /tmp/.ansible-$USER/tmp/ansible-tmp-1674905666.289351-3040847-56819068716431 `" ) && sleep 0'
Using module file /home/ansible/automation/projects/provisioning/collections/ansible_collections/community/general/plugins/modules/gitlab_runner.py
<127.0.0.1> PUT /home/ansible/.ansible/tmp/ansible-local-30408433yz6d20y/tmplkxru1sf TO /tmp/.ansible-ansible/tmp/ansible-tmp-1674905666.289351-3040847-56819068716431/AnsiballZ_gitlab_runner.py
<127.0.0.1> EXEC /bin/sh -c 'chmod u+x /tmp/.ansible-ansible/tmp/ansible-tmp-1674905666.289351-3040847-56819068716431/ /tmp/.ansible-ansible/tmp/ansible-tmp-1674905666.289351-3040847-56819068716431/AnsiballZ_gitlab_runner.py && sleep 0'
<127.0.0.1> EXEC /bin/sh -c '/usr/bin/python3 /tmp/.ansible-ansible/tmp/ansible-tmp-1674905666.289351-3040847-56819068716431/AnsiballZ_gitlab_runner.py && sleep 0'
<127.0.0.1> EXEC /bin/sh -c 'rm -f -r /tmp/.ansible-ansible/tmp/ansible-tmp-1674905666.289351-3040847-56819068716431/ > /dev/null 2>&1 && sleep 0'
changed: [localhost] => {
    "changed": true,
    "invocation": {
        "module_args": {
            "access_level": "ref_protected",
            "active": true,
            "api_job_token": null,
            "api_oauth_token": null,
            "api_password": null,
            "api_token": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER",
            "api_url": "https://git.mycompany.com/",
            "api_username": null,
            "description": "Test GitLab Runner",
            "locked": false,
            "maximum_timeout": 3600,
            "name": "Test GitLab Runner",
            "owned": false,
            "project": "loc/test",
            "registration_token": "VALUE_SPECIFIED_IN_NO_LOG_PARAMETER",
            "run_untagged": true,
            "state": "present",
            "tag_list": [],
            "validate_certs": true
        }
    },
    "msg": "Successfully created or updated the runner Test GitLab Runner",
    "runner": {
        "access_level": "ref_protected",
        "active": true,
        "architecture": null,
        "contacted_at": null,
        "description": "Test GitLab Runner",
        "groups": [],
        "id": 1232,
        "ip_address": "10.2.4.14",
        "is_shared": false,
        "locked": false,
        "maximum_timeout": 3600,
        "name": null,
        "online": null,
        "paused": false,
        "platform": null,
        "projects": [
            {
                "avatar_url": null,
                "created_at": "2023-01-27T12:32:44.132+01:00",
                "default_branch": "main",
                "description": null,
                "forks_count": 0,
                "http_url_to_repo": "https://git.mycompany.com/loc/test.git",
                "id": 1910,
                "last_activity_at": "2023-01-27T13:54:22.868+01:00",
                "name": "test",
                "name_with_namespace": "loc / test",
                "namespace": {
                    "avatar_url": null,
                    "full_path": "loc",
                    "id": 539,
                    "kind": "group",
                    "name": "loc",
                    "parent_id": null,
                    "path": "loc",
                    "web_url": "https://git.mycompany.com/groups/loc"
                },
                "path": "test",
                "path_with_namespace": "loc/test",
                "readme_url": "https://git.mycompany.com/loc/test/-/blob/main/README.md",
                "ssh_url_to_repo": "git@git.mycompany.com:loc/test.git",
                "star_count": 0,
                "tag_list": [],
                "topics": [],
                "web_url": "https://git.mycompany.com/loc/test"
            }
        ],
        "revision": null,
        "run_untagged": true,
        "runner_type": "project_type",
        "status": "never_contacted",
        "tag_list": [],
        "version": null
    }
}

PLAY RECAP *************************************************************************************************************************************************************************
localhost                  : ok=1    changed=1    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0

Saturday 28 January 2023  12:34:27 +0100 (0:00:01.050)       0:00:01.102 ******
===============================================================================
Ensure GitLab runner -------------------------------------------------------------------------------------------------------------------------------------------------------- 1.05s
/home/ansible/automation/projects/provisioning/test-gitlab-runner.yml:7 -----------------------------------------------------------------------------------------------------------

Code of Conduct

I agree to follow the Ansible Code of Conduct

…rst run after runner creation This fix adds the missing parameter 'access_level' on runner creation. Signed-off-by: Christoph Fiehe <c.fiehe@eurodata.de>

ansibullbot · 2023-01-28T11:58:46Z

Files identified in the description:

plugins/modules/gitlab_runner.py

If these files are incorrect, please update the component name section of the description or use the !component bot command.

click here for bot help

ansibullbot · 2023-01-28T11:58:47Z

cc @Lunik @SamyCoenen @Shaps @dj-wasabi @lgatellier @marwatk @metanovii @nejch @scodeman @sh0shin @suukit @waheedi @zanssa
click here for bot help

…rst run after runner creation This fix adds the missing parameter 'access_level' on runner creation. Signed-off-by: Christoph Fiehe <c.fiehe@eurodata.de>

…rst run after runner creation With this fix the parameter 'access_level' of the module 'gitlab_runner' becomes optional. If unset, runner creation relies on GitLab's default value, if set, the runner gets created or updated with the specified access level. Signed-off-by: Christoph Fiehe <c.fiehe@eurodata.de>

…rst run after runner creation This fix introduces the new boolean option 'access_level_on_creation'. It controls, whether the value of 'access_level' is used for runner registration or not. The option 'access_level' has been ignored on registration so far and was only used on updates. The user is informed by a deprecation warning, if the option is unspecified. For reasons of compatibility 'false' is assumed in that case. The option 'access_level_on_creation' will switch to 'true' for the next major release (community.general 7.0.0) Signed-off-by: Christoph Fiehe <c.fiehe@eurodata.de>

…r creation (#5908) This fix introduces the new boolean option 'access_level_on_creation'. It controls, whether the value of 'access_level' is used for runner registration or not. The option 'access_level' has been ignored on registration so far and was only used on updates. The user is informed by a deprecation warning, if the option is unspecified. For reasons of compatibility 'false' is assumed in that case. The option 'access_level_on_creation' will switch to 'true' for the next major release (community.general 7.0.0) Signed-off-by: Christoph Fiehe <c.fiehe@eurodata.de> Co-authored-by: Christoph Fiehe <c.fiehe@eurodata.de> (cherry picked from commit 31ff3f6)

…not idempotent on first run after runner creation (#5922) Fixes #5907: gitlab_runner is not idempotent on first run after runner creation (#5908) This fix introduces the new boolean option 'access_level_on_creation'. It controls, whether the value of 'access_level' is used for runner registration or not. The option 'access_level' has been ignored on registration so far and was only used on updates. The user is informed by a deprecation warning, if the option is unspecified. For reasons of compatibility 'false' is assumed in that case. The option 'access_level_on_creation' will switch to 'true' for the next major release (community.general 7.0.0) Signed-off-by: Christoph Fiehe <c.fiehe@eurodata.de> Co-authored-by: Christoph Fiehe <c.fiehe@eurodata.de> (cherry picked from commit 31ff3f6) Co-authored-by: cfiehe <cfiehe@users.noreply.github.com>

ansibullbot added bug This issue/PR relates to a bug gitlab module module plugins plugin (any type) source_control labels Jan 28, 2023

felixfontein closed this as completed in 31ff3f6 Jan 30, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

gitlab_runner is not idempotent on first run after runner creation #5907

gitlab_runner is not idempotent on first run after runner creation #5907

cfiehe commented Jan 28, 2023

ansibullbot commented Jan 28, 2023

ansibullbot commented Jan 28, 2023

gitlab_runner is not idempotent on first run after runner creation #5907

gitlab_runner is not idempotent on first run after runner creation #5907

Comments

cfiehe commented Jan 28, 2023

Summary

Issue Type

Component Name

Ansible Version

Community.general Version

Configuration

OS / Environment

Steps to Reproduce

Expected Results

Actual Results

Code of Conduct

ansibullbot commented Jan 28, 2023

ansibullbot commented Jan 28, 2023