API is sometimes temporarily unavailable when updating

[deliahu]

Description

API is sometimes temporarily unavailable when updating to a new model

Application Configuration

Fraud

To Reproduce

1. cx deploy
2. Modify dnn (e.g. to do 100 steps)
3. cx deploy
4. Repeatedly run cx predict fraud transactions.json

Actual Behavior

error: api "fraud" is updating

Expected Behavior

Successful prediction requests at all times (smooth transition to new model)

Screenshots

Version

master

Additional Context

• container readiness probes docs 1, docs 2
• bitnami example