deploy: add non-default namespace support for rbd kubernetes manifest files (backport #2340)

[mergify]

This is an automatic backport of pull request #2340 done by Mergify.

---

Mergify commands and options

More conditions and actions can be found in the documentation.

You can also trigger Mergify actions by commenting on this pull request:

• @Mergifyio refresh will re-evaluate the rules
• @Mergifyio rebase will rebase this PR on its base branch
• @Mergifyio update will merge the base branch into this PR
• @Mergifyio backport <destination> will backport this PR on <destination> branch

Additionally, on Mergify dashboard you can:

• look at your merge queues
• generate the Mergify configuration with the config editor.

Finally, you can contact us on https://mergify.io/

[nixpanic]

@Mergifyio refresh

[mergify]

Command refresh: success

Pull request refreshed

[nixpanic]

/retest ci/centos/mini-e2e/k8s-1.19

[nixpanic]

/retest ci/centos/mini-e2e/k8s-1.19

[nixpanic]

/retest ci/centos/mini-e2e/k8s-1.19

�[1mSTEP�[0m: perform IO on rbd-nbd volume after nodeplugin restart
...
Aug  4 11:29:01.959: INFO: attach command running after restart, runningAttachCmd: rbd-nbd --id cephcsi-rbd-node -m rook-ceph-mon-a.rook-ceph.svc.cluster.local:6789 --keyfile=/tmp/csi/keys/keyfile-974211006 attach replicapool/csi-vol-b39b2869-f50e-11eb-a3f5-c2e8c5fe2168 --device /dev/nbd0 --try-netlink --reattach-timeout=300

Aug  4 11:29:01.964: INFO: ExecWithOptions {Command:[/bin/sh -c echo 'Hello World' > /var/lib/www/html/test] Namespace:rbd-694 PodName:csi-rbd-demo-pod ContainerName:web-server Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false}
Aug  4 11:29:01.964: INFO: >>> kubeConfig: /root/.kube/config
Aug  4 11:29:05.378: INFO: stdErr occurred: /bin/sh: 1: cannot create /var/lib/www/html/test: Read-only file system

Aug  4 11:29:05.378: FAIL: failed to write IO, err: command terminated with exit code 2, stdErr: /bin/sh: 1: cannot create /var/lib/www/html/test: Read-only file system

Issue has been reported as #2204 (logs)

[pkalever]

/retest ci/centos/mini-e2e/k8s-1.19

�[1mSTEP�[0m: perform IO on rbd-nbd volume after nodeplugin restart
...
Aug  4 11:29:01.959: INFO: attach command running after restart, runningAttachCmd: rbd-nbd --id cephcsi-rbd-node -m rook-ceph-mon-a.rook-ceph.svc.cluster.local:6789 --keyfile=/tmp/csi/keys/keyfile-974211006 attach replicapool/csi-vol-b39b2869-f50e-11eb-a3f5-c2e8c5fe2168 --device /dev/nbd0 --try-netlink --reattach-timeout=300

Aug  4 11:29:01.964: INFO: ExecWithOptions {Command:[/bin/sh -c echo 'Hello World' > /var/lib/www/html/test] Namespace:rbd-694 PodName:csi-rbd-demo-pod ContainerName:web-server Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:true Quiet:false}
Aug  4 11:29:01.964: INFO: >>> kubeConfig: /root/.kube/config
Aug  4 11:29:05.378: INFO: stdErr occurred: /bin/sh: 1: cannot create /var/lib/www/html/test: Read-only file system

Aug  4 11:29:05.378: FAIL: failed to write IO, err: command terminated with exit code 2, stdErr: /bin/sh: 1: cannot create /var/lib/www/html/test: Read-only file system

Issue has been reported as #2204 (logs)

@nixpanic this must be not running with #2298

I see the logs and the sync is missing in them, a rebase should fix.

[nixpanic]

@nixpanic this must be not running with #2298

I see the logs and the sync is missing in them, a rebase should fix.

Thanks for checking! This is a backport to release-v3.4 so we don't have #2298.

[nixpanic]

/retest ci/centos/upgrade-tests-cephfs