Unable to tag EEs using infra.ah_configuration.ah_ee_image which have more than 100 versions in Private Automation Hub

[sscheib]

Summary

The module infra.ah_configuration.ah_ee_image is unable to work with EEs that have more than 100 versions present in Automation Hub.

The limit that gets applied is not taken into account by pulp, as it has a max limit of 100 items per page:

# grep max /usr/lib/python3.9/site-packages/pulp_ansible/app/galaxy/v3/pagination.py
max_limit = 100

This causes all EEs to fail that are not in the first 100 results because they are not found:

failed: [host.example.com -> localhost] (item={'name': 'standard-ee:ee-minimal-rhel9_2.17.0-2_base-12.standard-1', 'tags': ['rhel9_2.17_latest']}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "standard-ee:ee-minimal-rhel9_2.17.0-2_base-12.standard-1", "tags": ["rhel9_2.17_latest"]}, "msg": "The image tag ee-minimal-rhel9_2.17.0-2_base-12.standard-1 for the standard-ee repository does not exist."}

failed: [host.example.com -> localhost] (item={'name': 'standard-ee:ee-minimal-rhel9_2.16.7-2_base-12.standard-1', 'tags': ['rhel9_2.16_latest']}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "standard-ee:ee-minimal-rhel9_2.16.7-2_base-12.standard-1", "tags": ["rhel9_2.16_latest"]}, "msg": "The image tag ee-minimal-rhel9_2.16.7-2_base-12.standard-1 for the standard-ee repository does not exist."}

ok: [host.example.com -> localhost] => (item={'name': 'standard-ee:ee-minimal-rhel9_2.16.4-1_base-10.standard-1', 'tags': ['rhel9_2.16_stable']})

ok: [host.example.com -> localhost] => (item={'name': 'standard-ee:ee-minimal-rhel9_2.16.4-1_base-8.standard-1', 'tags': ['rhel9_2.16_stable-1']})

ok: [host.example.com -> localhost] => (item={'name': 'standard-ee:ee-minimal-rhel9_2.16.3-2_base-7.standard-1', 'tags': ['rhel9_2.16_stable-2']})

ok: [host.example.com -> localhost] => (item={'name': 'standard-ee:ee-minimal-rhel9_2.16.3-2_base-4.standard-1', 'tags': ['rhel9_2.16_stable-3']})

failed: [host.example.com -> localhost] (item={'name': 'standard-ee:ee-minimal-rhel9_2.15.10-8_base-12.standard-1', 'tags': ['latest', 'rhel9_2.15_latest']}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "standard-ee:ee-minimal-rhel9_2.15.10-8_base-12.standard-1", "tags": ["latest", "rhel9_2.15_latest"]}, "msg": "The image tag ee-minimal-rhel9_2.15.10-8_base-12.standard-1 for the standard-ee repository does not exist."}

Issue Type

• Bug Report

Ansible, Collection, Private Automation Hub details

ansible --version
ansible [core 2.15.12]
  config file = /home/steffen/ansible.cfg
  configured module search path = ['/home/steffen/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
  ansible python module location = /home/steffen/venvs/ansible-lint/lib64/python3.9/site-packages/ansible
  ansible collection location = /home/steffen/.ansible/collections:/usr/share/ansible/collections
  executable location = /home/steffen/venvs/ansible-lint/bin/ansible
  python version = 3.9.18 (main, Jan 17 2024, 13:42:07) [GCC 8.5.0 20210514 (Red Hat 8.5.0-21)] (/home/steffen/venvs/ansible-lint/bin/python3.9)
  jinja version = 3.1.2
  libyaml = True

ansible-galaxy collection list
(ansible-lint) [steffen@development ~]$ ansible-galaxy collection list

# /home/steffen/.ansible/collections/ansible_collections
Collection                               Version   
---------------------------------------- ----------
ansible.netcommon                        5.3.0     
ansible.posix                            1.5.4     
ansible.tower                            3.8.6     
ansible.utils                            2.10.3    
ansible.windows                          1.11.0    
community.crypto                         2.18.0    
community.docker                         3.9.0     
community.general                        9.0.1     
community.library_inventory_filtering_v1 1.0.1     
community.mysql                          3.4.0     
community.postgresql                     2.2.0     
community.routeros                       2.7.0     
community.zabbix                         1.9.1     
containers.podman                        1.10.1    
infra.ah_configuration                   2.0.6     
kubernetes.core                          2.3.2     
openstack.cloud                          2.0.0     
redhat.openshift                         2.2.0     
redhat.rhel_idm                          1.12.1    
redhat.rhel_system_roles                 1.23.0    
redhat.satellite                         4.0.0     
redhat.satellite_operations              2.1.0     
sscheib.insights                         0.0.2     
theforeman.foreman                       3.11.0-dev
zabbix.zabbix                            1.2.2     


Private Automation Hub version
4.9.1 

• ansible installation method: pip

OS / ENVIRONMENT

RHEL 8.10

Desired Behavior

The collection should perform pagination to retrieve more than 100 results.

Actual Behavior

The collection is unable to work with more than 100 results

STEPS TO REPRODUCE

Add more than 100 EE image versions to your Private Automation Hub and use this collection to tag the images.