Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

balena "draft" releases to force through broken / failed releases #293

Closed
shawaj opened this issue Dec 3, 2021 · 4 comments
Closed

balena "draft" releases to force through broken / failed releases #293

shawaj opened this issue Dec 3, 2021 · 4 comments

Comments

@shawaj
Copy link
Member

shawaj commented Dec 3, 2021

We are regularly getting issues where balena releases are failing with ESOCKETTIMEDOUT errors. For example ...

https://github.com/NebraLtd/helium-miner-software/actions/runs/1535610752/attempts/2

It is possible to force these through manually using the --draft flag:

balena deploy nebraltd/helium-indoor-868 --logs --debug --nocache --build --draft

and then finalising the release using either balena CLI or by finding the release in balenaCloud and finalising it from the dropdown.

Whilst this is a bit of a workaround, it does seem to work most of the time.

Need to add this to documentation and/or change the deploy actions to use this flow

@shawaj
Copy link
Member Author

shawaj commented Dec 3, 2021

FYI @vpetersson

shawaj added a commit that referenced this issue Dec 3, 2021
to allow us to manually trigger draft builds

Relates-to: #293
shawaj added a commit that referenced this issue Dec 3, 2021
to allow us to manually trigger draft builds

Relates-to: #293
@shawaj
Copy link
Member Author

shawaj commented Dec 3, 2021

created a manually triggerable action for draft deploys in #294

We can probably find a way to output the release tag and then finalise the release either in the same action or in a separate manually triggerable action. But this should be helpful as a starting point in any case

shawaj added a commit that referenced this issue Dec 3, 2021
add draft deploy

Relates-to: #293
@shawaj
Copy link
Member Author

shawaj commented Dec 6, 2021

Sadly this hasn't helped with github actions / balena.

Still will likely work manually but really balena need to sort this out as it's impractical to do this manually every time for 14 fleets 🤦

shawaj added a commit that referenced this issue Dec 7, 2021
add multiple balena API tokens to avoid rate limiting

Relates-to: #293 
Relates-to: #299 
Relates-to: #300
shawaj added a commit that referenced this issue Dec 7, 2021
- add multiple balena API tokens to avoid (or at least reduce the impact of) rate limiting
- add random sleep to testnet pushes

Relates-to: #293
Relates-to: #299
Relates-to: #300
shawaj added a commit that referenced this issue Dec 7, 2021
- add multiple balena API tokens to avoid (or at least reduce the impact of) rate limiting
- add random sleep to testnet pushes

Relates-to: #293
Relates-to: #299
Relates-to: #300
@shawaj
Copy link
Member Author

shawaj commented Dec 7, 2021

closing this for now, as #294 #299 #300 and #301 seem to have made a big improvement.

we can monitor this and reopen if necessary at a later date

@shawaj shawaj closed this as completed Dec 7, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant