Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

e2e: add backend cephfs subvolume validation #1319

Merged
merged 4 commits into from
Aug 11, 2020
Merged

Conversation

Madhu-1
Copy link
Collaborator

@Madhu-1 Madhu-1 commented Aug 5, 2020

added a backend validation to check subvolumes count when we create and delete PVC.

fixes #1316

updates: #1242
Signed-off-by: Madhu Rajanna madhupr007@gmail.com

@nixpanic nixpanic added component/cephfs Issues related to CephFS component/testing Additional test cases or CI work labels Aug 5, 2020
@Madhu-1
Copy link
Collaborator Author

Madhu-1 commented Aug 6, 2020

@Mergifyio rebase

@mergify
Copy link
Contributor

mergify bot commented Aug 6, 2020

Command rebase: success

@Madhu-1
Copy link
Collaborator Author

Madhu-1 commented Aug 6, 2020

@Mergifyio rebase

@mergify
Copy link
Contributor

mergify bot commented Aug 6, 2020

Command rebase: success

@Madhu-1
Copy link
Collaborator Author

Madhu-1 commented Aug 6, 2020

/retest ci/centos/mini-e2e/k8s-1.18.5

@Madhu-1
Copy link
Collaborator Author

Madhu-1 commented Aug 7, 2020

/retest ci/centos/containerized-tests

@Madhu-1
Copy link
Collaborator Author

Madhu-1 commented Aug 7, 2020

@humblec @nixpanic PTAL

@humblec
Copy link
Collaborator

humblec commented Aug 7, 2020

@Madhu-1 sure.. Will review this soon. Also once the snap PR in, we could use this PR for adding that for snapshot backend too.

@mergify
Copy link
Contributor

mergify bot commented Aug 8, 2020

This pull request now has conflicts with the target branch. Could you please resolve conflicts and force push the corrected changes? 🙏

humblec
humblec previously approved these changes Aug 10, 2020
@Madhu-1
Copy link
Collaborator Author

Madhu-1 commented Aug 10, 2020

looks like PVC-PVC clone backend subvolumes are not getting deleted.

from https://jenkins-ceph-csi.apps.ocp.ci.centos.org/job/mini-e2e-helm_k8s-1.18.5/93/consoleFull

Aug 10 08:38:34.959: INFO: waiting for PVC cephfs-80811 in state &PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},}  to be deleted (4 seconds elapsed)
Aug 10 08:38:34.960: INFO: waiting for PVC cephfs-80810 in state &PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},}  to be deleted (4 seconds elapsed)
Aug 10 08:38:36.939: INFO: waiting for PVC cephfs-80812 in state &PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},}  to be deleted (6 seconds elapsed)
Aug 10 08:38:36.959: INFO: waiting for PVC cephfs-80811 in state &PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},}  to be deleted (6 seconds elapsed)
Aug 10 08:38:36.960: INFO: waiting for PVC cephfs-80810 in state &PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},}  to be deleted (6 seconds elapsed)
Aug 10 08:38:36.971: INFO: subvolumes [{csi-vol-5a70834e-dadc-11ea-94af-0242ac110013} {csi-vol-5a7706d8-dadc-11ea-94af-0242ac110013} {csi-vol-5a9acc41-dadc-11ea-94af-0242ac110013} {csi-vol-4d41b82f-dadc-11ea-94af-0242ac110013}]. subvolume count 4 not matching expected count 0

from https://jenkins-ceph-csi.apps.ocp.ci.centos.org/job/mini-e2e_k8s-1.17.8/112/consoleFull

�[91m�[1m��� Failure [948.822 seconds]�[0m
cephfs
�[90m/go/src/github.com/ceph/ceph-csi/e2e/cephfs.go:117�[0m
  Test cephfs CSI
  �[90m/go/src/github.com/ceph/ceph-csi/e2e/cephfs.go:165�[0m
    �[91m�[1mTest cephfs CSI [It]�[0m
    �[90m/go/src/github.com/ceph/ceph-csi/e2e/cephfs.go:166�[0m

    �[91msubvolumes [{csi-vol-554c9613-dadb-11ea-af3e-0242ac110014} {csi-vol-558ac206-dadb-11ea-af3e-0242ac110014} {csi-vol-4836236f-dadb-11ea-af3e-0242ac110014} {csi-vol-553d2c3e-dadb-11ea-af3e-0242ac110014}]. subvolume count 4 not matching expected count 0�[0m

    /go/src/github.com/ceph/ceph-csi/e2e/cephfs.go:660

@Madhu-1
Copy link
Collaborator Author

Madhu-1 commented Aug 10, 2020

looks like PVC-PVC clone backend subvolumes are not getting deleted.

from https://jenkins-ceph-csi.apps.ocp.ci.centos.org/job/mini-e2e-helm_k8s-1.18.5/93/consoleFull

Aug 10 08:38:34.959: INFO: waiting for PVC cephfs-80811 in state &PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},}  to be deleted (4 seconds elapsed)
Aug 10 08:38:34.960: INFO: waiting for PVC cephfs-80810 in state &PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},}  to be deleted (4 seconds elapsed)
Aug 10 08:38:36.939: INFO: waiting for PVC cephfs-80812 in state &PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},}  to be deleted (6 seconds elapsed)
Aug 10 08:38:36.959: INFO: waiting for PVC cephfs-80811 in state &PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},}  to be deleted (6 seconds elapsed)
Aug 10 08:38:36.960: INFO: waiting for PVC cephfs-80810 in state &PersistentVolumeClaimStatus{Phase:,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},}  to be deleted (6 seconds elapsed)
Aug 10 08:38:36.971: INFO: subvolumes [{csi-vol-5a70834e-dadc-11ea-94af-0242ac110013} {csi-vol-5a7706d8-dadc-11ea-94af-0242ac110013} {csi-vol-5a9acc41-dadc-11ea-94af-0242ac110013} {csi-vol-4d41b82f-dadc-11ea-94af-0242ac110013}]. subvolume count 4 not matching expected count 0

from https://jenkins-ceph-csi.apps.ocp.ci.centos.org/job/mini-e2e_k8s-1.17.8/112/consoleFull

�[91m�[1m��� Failure [948.822 seconds]�[0m
cephfs
�[90m/go/src/github.com/ceph/ceph-csi/e2e/cephfs.go:117�[0m
  Test cephfs CSI
  �[90m/go/src/github.com/ceph/ceph-csi/e2e/cephfs.go:165�[0m
    �[91m�[1mTest cephfs CSI [It]�[0m
    �[90m/go/src/github.com/ceph/ceph-csi/e2e/cephfs.go:166�[0m

    �[91msubvolumes [{csi-vol-554c9613-dadb-11ea-af3e-0242ac110014} {csi-vol-558ac206-dadb-11ea-af3e-0242ac110014} {csi-vol-4836236f-dadb-11ea-af3e-0242ac110014} {csi-vol-553d2c3e-dadb-11ea-af3e-0242ac110014}]. subvolume count 4 not matching expected count 0�[0m

    /go/src/github.com/ceph/ceph-csi/e2e/cephfs.go:660

some check is e2e was missing added it

@mergify mergify bot dismissed humblec’s stale review August 10, 2020 15:56

Pull request has been modified.

@Madhu-1 Madhu-1 added this to the release-3.1.0 milestone Aug 11, 2020
@humblec
Copy link
Collaborator

humblec commented Aug 11, 2020

/retest ci/centos/mini-e2e/k8s-1.17.8

@humblec
Copy link
Collaborator

humblec commented Aug 11, 2020

@Madhu-1 can you please revisit this PR ?

@Madhu-1
Copy link
Collaborator Author

Madhu-1 commented Aug 11, 2020

@Mergifyio rebase

added a helper function in e2e to list subvolumes
in a filesystem

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
added a backend validation to check subvolumes
count when we create and delete pvc.

fixes ceph#1316

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
added backend subvolume validation for cephfs
snapshot restore and pvc to pvc clone.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
@mergify
Copy link
Contributor

mergify bot commented Aug 11, 2020

Command rebase: success

Branch has been successfully rebased

@mergify mergify bot merged commit b5320d9 into ceph:master Aug 11, 2020
@humblec humblec removed this from the release-3.1.0 milestone Aug 12, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/cephfs Issues related to CephFS component/testing Additional test cases or CI work
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Enhance CephFS subvolume backend validation in E2E tests
4 participants