All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog and this project adheres to Semantic Versioning.
v0.4.2 - 2024-03-07
- boto3utils.s3 object now supports specifying the
endpoint_url
parameter for the underlying boto3 client
v0.4.1 - 2022-11-19
- requester pays or other additional parameters using boto3 get_object
v0.4.0 - 2022-11-18
- s3.download_with_metadata() downloads a file and returns both the file path and a selection of metadata about the object (e.g. ETag, Version, etc)
- s3.get_object() takes a new argument,
extra_args={}
that is passed to the underlying client - s3.download() takes a new argument,
extra_args={}
that is passed to the underlying client - s3.download() parses query parameters from the provided url, adding them to the
extra_args
passed to the underlying client - Draft S3Inventory class to replace the functions (to be deprecated) in the s3 module for using S3 Inventories
- s3.exists(), s3.find(), and s3.get_object_metadata() now support requester pays
- s3.urlparse() now supports query parameters, returning them in the
'query_params'
section of the returneddict
- added
coverage.xml
to.gitignore
v0.3.3 - 2022-09-14
- s3.latest_inventory() takes manifest_age_days argument for how far back to look for manifest
- s3.latest_inventory() takes is_latest argument for filtering on versioned files
- s3.latest_inventory() takes key_contains array argument for filtering on key containing strings of the array
- No longer testing against python 3.6
- Now testing against python 3.9 and 3.10
- s3.delete works
- Handle bucket locations in US Standard region
v0.3.2 - 2021-07-15
- tests for secrets
- formatting and linting added to CI tests
- Logging of error when fetching secrets (leave to caller)
- Moved from CircleCI to GitHub Actions
- test directory renamed to tests
- Update moto version
- Linting and formatting updates
v0.3.1 - 2020-07-29
- s3.download() now uses boto3 download_file for multipart stream downloads to avoid memory errors downloading large files
v0.3.0 - 2020-06-14
requester_pays
parameter now argument to s3 session rather than download
v0.2.3 - 2020-05-06
- Syntax error with s3().upload_json
v0.2.2 - 2020-05-05
- Split up s3.latest_inventory() into multiple more modular functions, there is now
- s3.latest_inventory_manifest() - get manifest file for latest inventory
- s3.latest_inventory_files() - iterator to inventory files (each is listing of files in inventory)
v0.2.1 - 2020-02-28
- secrets module with get_secrets function for getting AWS secret as a dictionary {key:value}
- s3.urlpase when URL is an http URL
v0.2.0 - 2020-02-12
- Updated logging when reading from AWS inventory
- s3.read_inventory_file added, breaking up functionality from s3.latest_inventory
- s3.read and s3.read_json now take requester_pays keyword
- s3.latest_inventory() returns URLs instead of an object
- s3.latest_inventory faster filtering
v0.1.3 - 2020-01-31
- s3().https_to_s3 function
- urlparse, and all s3() functions that take in an URL, now take in either an https or s3 url to an s3 object
v0.1.2 - 2020-01-12
- s3().delete function
- s3().upload_json() function for uploading JSON as a file to s3
v0.1.1 - 2019-12-06
- requester_pays option to s3.download, defaults to False
v0.1.0 - 2019-12-05
- The s3 and stepfunction modules are now a class, and the init function accepts a boto3 Session. If not provided a default session is created
- s3.upload now accepts an
http_url
keyword. If set to True it will return the https URL instead of the S3 URL - s3.find now returns complete s3 URL for each found object, not just the key
v0.0.3 - 2019-11-22
- s3.latest_inventory iterator function added for looping through matching files in an s3 inventory
- s3.get_presigned_url for generating a presigned URL for s3....does not use boto3
v0.0.2 - 2019-10-08
Initial Release