Skip to content
This repository has been archived by the owner on Jan 25, 2020. It is now read-only.
/ s3prefixed Public archive

S3 reading operations in prefixed buckets

License

Notifications You must be signed in to change notification settings

mapbox/s3prefixed

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

🌇 As of January 2020, this module is deprecated. It is provided as-is, with no warranty. We are not accepting new bugfixes or feature requests at this time.

s3prefixed

S3 reading operations in prefixed buckets

Motivation

For best possible performance during heavy PUT loads, we sometimes prefix our S3 keys. This makes reading from the bucket a little more challenging if you're looking for a specific file.

Examples

$ s3prefixed ls s3://my-bucket/{prefix}/some/key/
$ s3prefixed cp s3://my-bucket/{prefix}/some/key/tile.vector.pbf
$ s3prefixed cp s3://my-bucket/{prefix}/some/key/tile.vector.pbf /somewhere/some.file

# Sorry but you can't copy into a prefixed bucket. This will fail:
$ s3prefixed cp /somewhere/some.file s3://my-bucket/{prefix}/some/key/tile.vector.pbf
Error: Must specify an s3 url

About

S3 reading operations in prefixed buckets

Topics

Resources

License

Code of conduct

Security policy

Stars

Watchers

Forks

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •