amazon.aws 6.0.0

Release Summary

This release brings some new plugins and features. Several bugfixes, breaking changes and deprecated features are also included. The amazon.aws collection has dropped support for botocore<1.25.0 and boto3<1.22.0. Support for Python 3.6 has also been dropped.

Minor Changes

• Add github actions to run unit and sanity tests.(ansible-collections#1393).
• AnsibleAWSModule - add support to the client and resource methods for overriding the default parameters (ansible-collections#1303).
• CONTRIBUTING.md - refactors and adds to contributor documentation (ansible-collections#924)
• Refactor inventory plugins and add aws_rds inventory unit tests (ansible-collections#1218).
• Refactor module_utils/cloudfront_facts.py and add unit tests (ansible-collections#1265).
• The black code formatter has been run across the collection to improve code consistency (ansible-collections#1465).
• amazon.aws inventory plugins - additional refactorization of inventory plugin connection handling (ansible-collections#1271).
• amazon.aws lookup plugins - aws_access_key has been renamed to access_key for consistency between modules and plugins, aws_access_key remains as an alias. This change should have no observable effect for users outside the module/plugin documentation (ansible-collections#1225).
• amazon.aws lookup plugins - aws_profile has been renamed to profile for consistency between modules and plugins, aws_profile remains as an alias. This change should have no observable effect for users outside the module/plugin documentation (ansible-collections#1225).
• amazon.aws lookup plugins - aws_secret_key has been renamed to secret_key for consistency between modules and plugins, aws_secret_key remains as an alias. This change should have no observable effect for users outside the module/plugin documentation (ansible-collections#1225).
• amazon.aws lookup plugins - aws_security_token has been renamed to session_token for consistency between modules and plugins, aws_security_token remains as an alias. This change should have no observable effect for users outside the module/plugin documentation (ansible-collections#1225).
• amazon.aws modules - bulk update of import statements following various refactors (ansible-collections#1310).
• autoscaling_group - minor linting fixes (ansible-collections#1181).
• aws_account_attribute - the aws_account_attribute lookup plugin has been refactored to use AWSLookupBase as its base class (ansible-collections#1225).
• aws_ec2 inventory - minor linting fixes (ansible-collections#1181).
• aws_secret - the aws_secret lookup plugin has been refactored to use AWSLookupBase as its base class (ansible-collections#1225).
• aws_secret - the aws_secret lookup plugin has been renamed secretsmanager_secret, aws_secret remains as an alias (ansible-collections#1225).
• aws_ssm - the aws_ssm lookup plugin has been refactored to use AWSLookupBase as its base class (ansible-collections#1225).
• aws_ssm - the aws_ssm lookup plugin has been renamed ssm_parameter, aws_ssm remains as an alias (ansible-collections#1225).
• backup - Add logic for backup_selection* modules (ansible-collections#1530).
• bulk migration of % and .format() to fstrings (ansible-collections#1483).
• cloud module_utils - minor linting fixes (ansible-collections#1181).
• cloudtrail_info - minor linting fixes (ansible-collections#1181).
• cloudwatchlogs_log_group - minor linting fixes (ansible-collections#1181).
• docs_fragments - amazon.aws.boto3 fragment now pulls the botocore version requirements from module_utils.botocore (ansible-collections#1248).
• docs_fragments - common parameters for modules and plugins have been synchronised and moved to amazon.aws.common.modules and amazon.aws.common.plugins (ansible-collections#1248).
• docs_fragments - region parameters for modules and plugins have been synchronised and moved to amazon.aws.region.modules and amazon.aws.region.plugins (ansible-collections#1248).
• ec2_ami - Extend the unit-test coverage of the module (ansible-collections#1159).
• ec2_ami - allow ImageAvailable waiter to retry when the image can't be found (ansible-collections#1321).
• ec2_ami_info - Add unit-tests coverage (ansible-collections#1252).
• ec2_eip - minor linting fixes (ansible-collections#1181).
• ec2_eni_info - Add unit-tests coverage (ansible-collections#1236).
• ec2_instance - avoid changing module.params (ansible-collections#1187).
• ec2_instance - updated to avoid manipulating module.params (ansible-collections#1337).
• ec2_security_group - added rule options to argument specifications to improve handling of inputs (ansible-collections#1214).
• ec2_security_group - refacter get_target_from_rule() (ansible-collections#1221).
• ec2_security_group - refactor rule expansion and add unit tests (ansible-collections#1261).
• ec2_snapshot - Reenable the integration tests (ansible-collections#1235).
• ec2_snapshot_info - Add unit-tests coverage (ansible-collections#1211).
• ec2_vpc_route_table - add support for Carrier Gateway entry (ansible-collections#926).
• ec2_vpc_subnet - retry fetching subnet details after creation if the first attempt fails (ansible-collections#1526).
• inventory aws ec2 - add parameter use_ssm_inventory allowing to query ssm inventory information for configured EC2 instances and populate hostvars (ansible-collections#704).
• inventory plugins - refactor cache handling (ansible-collections#1285).
• inventory plugins - refactor file verification handling (ansible-collections#1285).
• inventory_aws_ec2 integration tests - replace local module test_get_ssm_inventory by community.aws.ssm_inventory_info (ansible-collections#1416).
• kms_key_info - minor linting fixes (ansible-collections#1181).
• lambda - minor linting fixes (ansible-collections#1181).
• lambda - use common get_aws_account_info helper rather than reimplementing (ansible-collections#1181).
• lambda_alias - refactored to avoid passing around the complex module resource (ansible-collections#1336).
• lambda_alias - updated to avoid manipulating module.params (ansible-collections#1336).
• lambda_execute - minor linting fixes (ansible-collections#1181).
• lambda_info - updated to avoid manipulating module.params (ansible-collections#1336).
• lambda_layer_info - add support for parameter version_number to retrieve detailed information for a specific layer version (ansible-collections#1293).
• module_utils - move RetryingBotoClientWrapper into module_utils.retries for reuse with other plugin types (ansible-collections#1230).
• module_utils - move exceptions into dedicated python module (ansible-collections#1246).
• module_utils - refacter botocore version validation into module_utils.botocore for future reuse (ansible-collections#1227).
• module_utils.acm - Refactor ACMServiceManager class and add unit tests (ansible-collections#1273).
• module_utils.botocore - Add Ansible AWS User-Agent identification (ansible-collections#1306).
• module_utils.botocore - refactorization of get_aws_region, get_aws_connection_info so that the code can be reused by non-module plugins (ansible-collections#1231).
• module_utils.policy - minor refacter of code to reduce complexity and improve test coverage (ansible-collections#1136).
• module_utils.s3 - Refactor get_s3_connection into a module_utils for S3 modules and expand module_utils.s3 unit tests (ansible-collections#1139).
• module_utils/botocore - added support to _boto3_conn for passing dictionaries of configuration (ansible-collections#1307).
• plugin_utils - Added AWSConnectionBase to support refactoring connection plugins (ansible-collections#1340).
• rds - AWS is phasing out aurora1. Integration tests use aurora2 (aurora-mysql) by default (ansible-collections#1233).
• rds_cluster - Split up the functional tests in smaller targets (ansible-collections#1175).
• rds_cluster_snapshot - minor linting fixes (ansible-collections#1181).
• rds_instance - minor linting fixes (ansible-collections#1181).
• rds_instance_info - Add unit-tests coverage (ansible-collections#1132).
• rds_instance_snapshot - minor linting fixes (ansible-collections#1181).
• rds_param_group - drop Python2 import fallbacks (ansible-collections#1513).
• route53_health_check - Drop deprecation warning (ansible-collections/community.aws#1335).
• route53_health_check - minor fix for returning health check info while updating a Route53 health check (ansible-collections#1200).
• route53_health_check - minor linting fixes (ansible-collections#1181).
• route53_info - drop unused imports (ansible-collections#1462).
• s3_bucket - add support for S3 dualstack endpoint (ansible-collections#1305).
• s3_bucket - handle missing read permissions more gracefully when possible (ansible-collections#1406).
• s3_bucket - refactor S3 connection code (ansible-collections#1305).
• s3_object - refactor S3 connection code (ansible-collections#1305).
• s3_object - refactor main to reduce complexity (ansible-collections#1193).
• s3_object_info - minor linting fixes (ansible-collections#1181).
• s3_object_info - refactor S3 connection code (ansible-collections#1305).

Breaking Changes / Porting Guide

• The amazon.aws collection has dropped support for botocore<1.25.0 and boto3<1.22.0. Most modules will continue to work with older versions of the AWS SDK, however compatibility with older versions of the SDK is not guaranteed and will not be tested. When using older versions of the SDK a warning will be emitted by Ansible (ansible-collections#1342).
• amazon.aws - compatibility code for Python < 3.6 has been removed (ansible-collections#1257).
• ec2_eip - the previously deprecated instance_id alias for the device_id parameter has been removed. Please use the device_id parameter name instead (ansible-collections#1176).
• ec2_instance - the default value for instance_type has been removed. At least one of instance_type or launch_template must be specified when launching new instances (ansible-collections#1315).
• ec2_vpc_dhcp_options - the new_options return value has been deprecated after being renamed to dhcp_config. Please use the dhcp_config or dhcp_options return values (ansible-collections#1327).
• ec2_vpc_endpoint - the policy_file parameter has been removed. I(policy) with a file lookup can be used instead (ansible-collections#1178).
• ec2_vpc_net - the classic_link_enabled return value has been removed. Support for EC2 Classic networking was dropped by AWS (ansible-collections#1374).
• ec2_vpc_net_info - the classic_link_dns_status return value has been removed. Support for EC2 Classic networking was dropped by AWS (ansible-collections#1374).
• ec2_vpc_net_info - the classic_link_enabled return value has been removed. Support for EC2 Classic networking was dropped by AWS (ansible-collections#1374).
• module_utils.cloud - the previously deprecated CloudRetry.backoff has been removed. Please use CloudRetry.exponential_backoff or CloudRetry.jittered_backoff instead (ansible-collections#1110).

Deprecated Features

• amazon.aws collection - due to the AWS SDKs Python support policies (https://aws.amazon.com/blogs/developer/python-support-policy-updates-for-aws-sdks-and-tools/) support for Python less than 3.8 by this collection is expected to be removed in a release after 2024-12-01 (ansible-collections#1342).
• amazon.aws collection - due to the AWS SDKs announcing the end of support for Python less than 3.7 (https://aws.amazon.com/blogs/developer/python-support-policy-updates-for-aws-sdks-and-tools/) support for Python less than 3.7 by this collection has been deprecated and will be removed in release 7.0.0. (ansible-collections#1342).
• amazon.aws lookup plugins - the boto3_profile alias for the profile option has been deprecated, please use profile instead (ansible-collections#1225).
• docs_fragments - amazon.aws.aws_credentials docs fragment has been deprecated please use amazon.aws.common.plugins instead (ansible-collections#1248).
• docs_fragments - amazon.aws.aws_region docs fragment has been deprecated please use amazon.aws.region.plugins instead (ansible-collections#1248).
• docs_fragments - amazon.aws.aws docs fragment has been deprecated please use amazon.aws.common.modules instead (ansible-collections#1248).
• docs_fragments - amazon.aws.ec2 docs fragment has been deprecated please use amazon.aws.region.modules instead (ansible-collections#1248).
• module_utils.policy - ansible_collections.amazon.aws.module_utils.policy.sort_json_policy_dict has been deprecated consider using ansible_collections.amazon.aws.module_utils.poilcies.compare_policies instead (ansible-collections#1136).
• s3_object - Support for passing dualstack and endpoint_url at the same time has been deprecated, the dualstack parameter is ignored when endpoint_url is passed. Support will be removed in a release after 2024-12-01 (ansible-collections#1305).
• s3_object - Support for passing values of overwrite other than always, never, different or last last has been deprecated. Boolean values should be replaced by the strings always or never Support will be removed in a release after 2024-12-01 (ansible-collections#1305).
• s3_object_info - Support for passing dualstack and endpoint_url at the same time has been deprecated, the dualstack parameter is ignored when endpoint_url is passed. Support will be removed in a release after 2024-12-01 (ansible-collections#1305).

Removed Features (previously deprecated)

• ec2_vpc_endpoint_info - support for the query parameter was removed. The amazon.aws.ec2_vpc_endpoint_info module now only queries for endpoints. Services can be queried using the amazon.aws.ec2_vpc_endpoint_service_info module (ansible-collections#1308).
• s3_object - support for creating and deleting buckets using the s3_object module has been removed. S3 buckets can be created and deleted using the amazon.aws.s3_bucket module (ansible-collections#1112).

Bugfixes

• ec2_security_group - file included unreachable code. Fix now removes unreachable code by removing an inapproproate logic (ansible-collections#1348).
• ec2_vpc_dhcp_option - retry describe_dhcp_options after creation when InvalidDhcpOptionID.NotFound is raised (ansible-collections#1320).
• lambda_execute - Fix waiter error when function_arn is passed instead of name(ansible-collections#1268).
• module_utils - fixes TypeError: deciding_wrapper() got multiple values for argument 'aws_retry' when passing positional arguments to functions wrapped by AnsibleAWSModule.client (ansible-collections#1230).
• rds_param_group - added a check to fail the task while modifying/updating rds_param_group if trying to change DB parameter group family. (ansible-collections#1169).
• route53_health_check - Fix Name tag key removal idempotentcy issue when creating health_check with use_unique_names and tags set (ansible-collections#1253).
• s3_bucket - Handle setting of permissions while acl is disabled.(ansible-collections#1168).

New Plugins

Lookup

• aws_collection_constants - expose various collection related constants

New Modules

• backup_plan - Manage AWS Backup Plans
• backup_plan_info - Describe AWS Backup Plans
• backup_restore_job_info - List information about backup restore jobs
• backup_selection - Create, delete and modify AWS Backup selection
• backup_selection_info - Describe AWS Backup Selections
• backup_tag - Manage tags on backup plan, backup vault, recovery point
• backup_tag_info - List tags on AWS Backup resources
• backup_vault - Manage AWS Backup Vaults
• backup_vault_info - Describe AWS Backup Vaults