Connecting cubestore to s3 storage failing for af-south-1 region

[andrew-musoke]

Describe the bug
Followed this tutorial to deploy production CubeJS. When running cubestore as docker image and the CUBESTORE_S3_REGION is set to af-south-1, the application will fail to start with below DNS error.

To Reproduce
Steps to reproduce the behavior:

1. Setup s3 bucket and IAM user with appropriate permissions.
2. Set following cubestore environment variables

  CUBESTORE_AWS_ACCESS_KEY_ID: "<redacted>"
  CUBESTORE_AWS_SECRET_ACCESS_KEY: "<redacted>"
  CUBESTORE_S3_BUCKET: "cube-store"
  CUBESTORE_S3_REGION: "af-south-1"
  CUBESTORE_S3_SUB_PATH: "subfolder"

2. Run Docker image.

Expected behavior
Expected the image to start without error

Version:
Docker image cubestore:v0.29.10

Additional context
The problem seems to only present with region af-south-1. From what I gathered, Cubejs couldn't formulate a URL in the form https://cubestore-storage.s3.af-south-1.amazonaws.com as expected.
I changed the region to us-east-1 and this behaviour changed and the app started properly.

[paveltiunov]

Hey @andrew-musoke ! af-south-1 isn't indeed on the list of regions https://github.com/durch/rust-s3/blob/75e2eb3dd9acfa5c1add4893ce64569dbac6d4f0/aws-region/src/region.rs#L98. However you can use s3.af-south-1.amazonaws.com as CUBESTORE_S3_REGION instead.

[PieterVanZyl-Dev]

Hey Andrew !
Great to see more adoptions of cube in the African Continent.

Have you tried pavel's suggestion, this bug seems to be in rust-s3

I created a bug in rust-s3's repo

We can probably close this.

[andrew-musoke]

Hi @PieterVanZyl-Dev If we are successful with cube in prod, shall definitely start evangelizing it here :)

Just got a chance to try @paveltiunov work around but brings a different error. FYI upgraded to v0.29.23.

Thanks for raising the rust issue. Will follow up there.

[github-actions]

If you are interested in working on this issue, please leave a comment below and we will be happy to assign the issue to you.
If this is the first time you are contributing a Pull Request to Cube.js, please check our contribution guidelines.
You can also post any questions while contributing in the #contributors channel in the Cube.js Slack.

[jonasdebeukelaer]

Bit late to the party, but I notice that in version 0.29.0 of rust-s3, they've added the missing af-south-1 region. see durch/rust-s3@v0.28.0...v0.29.0

[ovr]

It should work starting from https://github.com/cube-js/cube/releases/tag/v0.35.17

Thanks, @jonasdebeukelaer, for your contribution!