Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Core deployment errors - Error: reading blob properties for Storage Account #4004

Closed
jonnyry opened this issue Jun 24, 2024 · 20 comments · Fixed by #4220
Closed

Core deployment errors - Error: reading blob properties for Storage Account #4004

jonnyry opened this issue Jun 24, 2024 · 20 comments · Fixed by #4220
Labels
bug Something isn't working

Comments

@jonnyry
Copy link
Collaborator

jonnyry commented Jun 24, 2024

Deploying a fresh TRE from 2 commits behind main (1ffb09b)...

Experienced storage account failures on two seperate deployments:

Capture

Capture3

@jonnyry jonnyry added the bug Something isn't working label Jun 24, 2024
@tim-p-allen
Copy link
Collaborator

could be an issue with the terraform providers?

@jonnyry
Copy link
Collaborator Author

jonnyry commented Jun 24, 2024

Just pulled your tf provider update and giving it a try now.

@jonnyry
Copy link
Collaborator Author

jonnyry commented Jun 24, 2024

Reployed fine with the tf provider update - I'll close this off.

@jonnyry jonnyry closed this as completed Jun 24, 2024
@jonnyry jonnyry reopened this Jun 24, 2024
@jonnyry
Copy link
Collaborator Author

jonnyry commented Jun 24, 2024

Unfortuntely just happened again on the latest codebase (including the tf provider update):

image

@tim-p-allen
Copy link
Collaborator

how weird, and the storage account doesn't exist in the portal?

@jonnyry
Copy link
Collaborator Author

jonnyry commented Jun 25, 2024

I have already destroyed that environment already, but I've just seen it happen again and I've checked and the storage account does exist:

image

image

@jonnyry
Copy link
Collaborator Author

jonnyry commented Jun 25, 2024

Looks like it could be this: hashicorp/terraform-provider-azurerm#22992

@jonnyry
Copy link
Collaborator Author

jonnyry commented Jun 25, 2024

And for the issue to be resolved, wait for the following PR: hashicorp/terraform-provider-azurerm#26218

@jonnyry
Copy link
Collaborator Author

jonnyry commented Jun 27, 2024

still occurring on almost every deployment:

image

@marrobi
Copy link
Member

marrobi commented Jun 27, 2024

Are you using the same TRE ID between deployments? Wonder if some sort of DNS caching going on?

@jonnyry
Copy link
Collaborator Author

jonnyry commented Jun 27, 2024

I am yes. I think it is to do with DNS caching.

However not sure why the issue has only started occuring this week, as been reusing TRE IDs for a long time.

@marrobi
Copy link
Member

marrobi commented Jun 27, 2024

Are these jobs running on a github agent? Is it a GitHub hosted one or an agent you manage?

@jonnyry
Copy link
Collaborator Author

jonnyry commented Jun 27, 2024

Just a standard GitHub Actions Runner - not one that we manage.

@marrobi
Copy link
Member

marrobi commented Jun 27, 2024

Hmm, we never really deploy, destroy, and deploy with the same ID. Wonder if you left it a couple of days before reusing the same ID.

Might be need to create an issue in the Terraform provider repository/wait for the one you mentioned, not sure its an Azure TRE issue, or something we are going to be able to resolve.

@jonnyry
Copy link
Collaborator Author

jonnyry commented Jun 27, 2024

It's intermittent - I think it does depend on how long it was since the last deploy.

Curiously for the issue I was having this morning, I deleted the storage account that was causing the 404, re-ran the build and it completed sucessfully.

I'll hopefully manage to work around it for now and keep an eye on release of the terraform PR above.

@marrobi
Copy link
Member

marrobi commented Jul 19, 2024

Could be fixed by https://github.com/hashicorp/terraform-provider-azurerm/releases/tag/v3.113.0

@jonnyry
Copy link
Collaborator Author

jonnyry commented Jul 19, 2024

Strangely not seen it for a couple of weeks - it went away by itself. If it reoccurs, I'll try bumping the terraform azurerm version.

@marrobi
Copy link
Member

marrobi commented Aug 6, 2024

Going to close this given not senit again.

@marrobi marrobi closed this as completed Aug 6, 2024
@jonnyry jonnyry reopened this Dec 24, 2024
@jonnyry
Copy link
Collaborator Author

jonnyry commented Dec 24, 2024

This has occured 6 times in the last week - when attempting to deploy a TRE instance using the same name as that of a recently deleted TRE instace.

Going to try bumping TF provider in the core from v3.112.0 to v3.117.0 (incorporating a fix for this issue) to see if it helps.

jonnyry added a commit to nwsde/nwsde-azuretre that referenced this issue Dec 24, 2024
jonnyry added a commit to nwsde/nwsde-azuretre that referenced this issue Dec 24, 2024
@jonnyry
Copy link
Collaborator Author

jonnyry commented Dec 24, 2024

OK three deployments using v3.117.0 have succeeded.

jonnyry added a commit that referenced this issue Dec 26, 2024
* Upgrade azurerm terraform provider from v3.112.0 to v3.117.0 to mitigate storage account deployment issue #4004

* Bump core, devops and template version numbers
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants