Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix minikube restart on Cloud Shell #12237

Merged
merged 9 commits into from
Aug 23, 2021

Conversation

sharifelgamal
Copy link
Collaborator

@sharifelgamal sharifelgamal commented Aug 11, 2021

This PR adds a basic StartStop test to the Cloud Shell tests as well

Fixes #12232

@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. labels Aug 11, 2021
@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Aug 11, 2021
@sharifelgamal
Copy link
Collaborator Author

/ok-to-test

@k8s-ci-robot k8s-ci-robot added the ok-to-test Indicates a non-member PR verified by an org member that is safe to test. label Aug 11, 2021
@minikube-pr-bot
Copy link

kvm2 driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 47.2s    | 47.4s               |
| enable ingress | 31.9s    | 33.8s               |
+----------------+----------+---------------------+

Times for minikube start: 47.7s 48.5s 46.2s 46.4s 47.3s
Times for minikube (PR 12237) start: 46.5s 48.4s 47.0s 47.7s 47.5s

Times for minikube ingress: 32.8s 30.7s 31.8s 31.8s 32.2s
Times for minikube (PR 12237) ingress: 31.8s 32.7s 31.2s 31.7s 41.4s

docker driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 21.9s    | 22.0s               |
| enable ingress | 35.0s    | 32.3s               |
+----------------+----------+---------------------+

Times for minikube start: 21.6s 21.8s 21.6s 21.6s 22.9s
Times for minikube (PR 12237) start: 21.6s 21.0s 21.3s 22.1s 24.0s

Times for minikube ingress: 34.5s 36.5s 37.0s 35.5s 31.5s
Times for minikube (PR 12237) ingress: 31.5s 35.5s 36.0s 28.0s 30.5s

docker driver with containerd runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 41.9s    | 43.6s               |
| enable ingress |          |                     |
+----------------+----------+---------------------+

Times for minikube start: 42.8s 43.7s 36.1s 43.7s 43.3s
Times for minikube (PR 12237) start: 43.9s 43.3s 43.5s 43.7s 43.7s

@minikube-pr-bot
Copy link

kvm2 driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 48.1s    | 48.0s               |
| enable ingress | 31.0s    | 32.1s               |
+----------------+----------+---------------------+

Times for minikube start: 47.5s 47.8s 47.2s 50.6s 47.2s
Times for minikube (PR 12237) start: 47.7s 48.0s 47.5s 49.9s 47.2s

Times for minikube ingress: 31.8s 30.8s 30.8s 30.8s 30.8s
Times for minikube (PR 12237) ingress: 32.8s 32.3s 29.8s 30.8s 34.8s

docker driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 21.9s    | 22.3s               |
| enable ingress | 28.5s    | 27.3s               |
+----------------+----------+---------------------+

Times for minikube ingress: 27.0s 26.5s 27.5s 35.0s 26.5s
Times for minikube (PR 12237) ingress: 27.5s 26.5s 28.0s 27.0s 27.5s

Times for minikube start: 21.9s 22.1s 22.1s 21.6s 21.6s
Times for minikube (PR 12237) start: 22.0s 22.7s 22.3s 22.4s 21.9s

docker driver with containerd runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 44.0s    | 43.5s               |
| enable ingress |          |                     |
+----------------+----------+---------------------+

Times for minikube start: 45.3s 43.1s 43.9s 43.7s 43.9s
Times for minikube (PR 12237) start: 43.9s 43.4s 43.3s 43.1s 43.7s

@minikube-pr-bot
Copy link

These are the flake rates of all failed tests.

Environment Failed Tests Flake Rate (%)
Docker_Linux_containerd TestStartStop/group/default-k8s-different-port/serial/Pause (gopogh) 0.65 (chart)
KVM_Linux_crio TestStartStop/group/no-preload/serial/AddonExistsAfterStop (gopogh) 0.68 (chart)
KVM_Linux_crio TestStartStop/group/no-preload/serial/SecondStart (gopogh) 0.68 (chart)
KVM_Linux_crio TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (gopogh) 0.68 (chart)
Docker_Linux TestStartStop/group/newest-cni/serial/SecondStart (gopogh) 1.29 (chart)
Docker_Linux TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (gopogh) 1.29 (chart)
Docker_Linux_docker_arm64 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (gopogh) 1.83 (chart)
Docker_Linux TestStartStop/group/newest-cni/serial/Pause (gopogh) 2.58 (chart)
Docker_macOS TestDebPackageInstall/install_amd64_debian (gopogh) 10/kvm2-driver (chart)
Docker_macOS TestDebPackageInstall/install_amd64_debian (gopogh) 9/kvm2-driver (chart)
Docker_macOS TestDebPackageInstall/install_amd64_debian (gopogh) latest/kvm2-driver (chart)
Docker_macOS TestDebPackageInstall/install_amd64_debian (gopogh) sid/kvm2-driver (chart)
Docker_macOS TestDebPackageInstall/install_amd64_ubuntu (gopogh) 18.04/kvm2-driver (chart)
Docker_macOS TestDebPackageInstall/install_amd64_ubuntu (gopogh) 20.04/kvm2-driver (chart)
Docker_macOS TestDebPackageInstall/install_amd64_ubuntu (gopogh) 20.10/kvm2-driver (chart)
Docker_macOS TestDebPackageInstall/install_amd64_ubuntu (gopogh) latest/kvm2-driver (chart)
KVM_Linux_crio TestAddons/parallel/Olm (gopogh) 4.83 (chart)
Docker_Linux_crio TestStartStop/group/newest-cni/serial/Stop (gopogh) 6.45 (chart)
Docker_Linux_crio TestStartStop/group/old-k8s-version/serial/Pause (gopogh) 7.10 (chart)
KVM_Linux_crio TestPause/serial/PauseAgain (gopogh) 8.22 (chart)
Docker_Linux_crio TestNetworkPlugins/group/kindnet/DNS (gopogh) 8.44 (chart)
Docker_Windows TestKubernetesUpgrade (gopogh) 9.77 (chart)
Docker_Linux_crio_arm64 TestStartStop/group/no-preload/serial/EnableAddonWhileActive (gopogh) 10.78 (chart)
Docker_macOS TestScheduledStopUnix (gopogh) 12.15 (chart)
Docker_Linux_containerd TestPause/serial/Pause (gopogh) 15.48 (chart)
Docker_Linux_containerd TestPause/serial/VerifyStatus (gopogh) 15.48 (chart)
Docker_Linux_crio TestStartStop/group/no-preload/serial/Stop (gopogh) 22.58 (chart)
Docker_Windows TestStartStop/group/no-preload/serial/SecondStart (gopogh) 22.69 (chart)
Docker_Linux_containerd TestPause/serial/PauseAgain (gopogh) 23.23 (chart)
KVM_Linux TestScheduledStopUnix (gopogh) 25.66 (chart)
More tests... Continued...

Too many tests failed - See test logs for more details.

To see the flake rates of all tests by environment, click here.

@minikube-pr-bot
Copy link

These are the flake rates of all failed tests.

Environment Failed Tests Flake Rate (%)
KVM_Linux_containerd TestStartStop/group/embed-certs/serial/Pause (gopogh) 0.65 (chart)
Docker_Linux TestForceSystemdEnv (gopogh) 0.66 (chart)
KVM_Linux_crio TestFunctional/parallel/LoadImage (gopogh) 0.69 (chart)
KVM_Linux_crio TestNetworkPlugins/group/cilium/Start (gopogh) 1.38 (chart)
Docker_Linux_containerd_arm64 TestFunctional/parallel/BuildImage (gopogh) 3.36 (chart)
Docker_Linux_containerd_arm64 TestAddons/parallel/GCPAuth (gopogh) 9.40 (chart)
Docker_Linux_containerd_arm64 TestFunctional/parallel/TunnelCmd/serial/AccessDirect (gopogh) 10.74 (chart)
Hyperkit_macOS TestDebPackageInstall/install_amd64_debian (gopogh) 10/kvm2-driver (chart)
Hyperkit_macOS TestDebPackageInstall/install_amd64_debian (gopogh) 9/kvm2-driver (chart)
Hyperkit_macOS TestDebPackageInstall/install_amd64_debian (gopogh) latest/kvm2-driver (chart)
Hyperkit_macOS TestDebPackageInstall/install_amd64_debian (gopogh) sid/kvm2-driver (chart)
Hyperkit_macOS TestDebPackageInstall/install_amd64_ubuntu (gopogh) 18.04/kvm2-driver (chart)
Hyperkit_macOS TestDebPackageInstall/install_amd64_ubuntu (gopogh) 20.04/kvm2-driver (chart)
Hyperkit_macOS TestDebPackageInstall/install_amd64_ubuntu (gopogh) 20.10/kvm2-driver (chart)
Hyperkit_macOS TestDebPackageInstall/install_amd64_ubuntu (gopogh) latest/kvm2-driver (chart)
Docker_Linux_containerd_arm64 TestAddons/parallel/Ingress (gopogh) 12.75 (chart)
Docker_Linux_containerd_arm64 TestFunctional/parallel/MountCmd/any-port (gopogh) 14.77 (chart)
Docker_Linux_containerd_arm64 TestAddons/parallel/CSI (gopogh) 15.44 (chart)
Docker_Linux_containerd_arm64 TestFunctional/parallel/PersistentVolumeClaim (gopogh) 16.11 (chart)
Docker_Linux_containerd TestPause/serial/Pause (gopogh) 16.45 (chart)
Docker_Linux_containerd TestPause/serial/VerifyStatus (gopogh) 16.45 (chart)
Docker_Linux_crio TestScheduledStopUnix (gopogh) 19.74 (chart)
Docker_Linux TestScheduledStopUnix (gopogh) 20.39 (chart)
Docker_Linux_containerd TestPause/serial/PauseAgain (gopogh) 24.34 (chart)
Docker_Linux_containerd_arm64 TestNetworkPlugins/group/enable-default-cni/Start (gopogh) 29.45 (chart)
Docker_Linux_crio_arm64 TestStartStop/group/no-preload/serial/DeployApp (gopogh) 32.32 (chart)
Docker_Linux_crio_arm64 TestAddons/parallel/GCPAuth (gopogh) 37.41 (chart)
Docker_Linux_containerd_arm64 TestNetworkPlugins/group/kindnet/Start (gopogh) 39.04 (chart)
Docker_Linux_containerd_arm64 TestScheduledStopUnix (gopogh) 42.28 (chart)
Docker_Linux_crio_arm64 TestAddons/parallel/CSI (gopogh) 44.22 (chart)
More tests... Continued...

Too many tests failed - See test logs for more details.

To see the flake rates of all tests by environment, click here.

@k8s-ci-robot k8s-ci-robot added size/S Denotes a PR that changes 10-29 lines, ignoring generated files. and removed size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. labels Aug 12, 2021
@minikube-pr-bot
Copy link

kvm2 driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 49.1s    | 49.5s               |
| enable ingress | 31.3s    | 31.5s               |
+----------------+----------+---------------------+

Times for minikube start: 48.6s 47.6s 52.7s 48.6s 48.2s
Times for minikube (PR 12237) start: 49.0s 50.2s 50.5s 50.5s 47.3s

Times for minikube ingress: 30.8s 30.4s 31.8s 31.3s 31.8s
Times for minikube (PR 12237) ingress: 31.4s 31.4s 31.3s 31.8s 31.8s

docker driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 22.6s    | 22.7s               |
| enable ingress | 30.3s    | 30.0s               |
+----------------+----------+---------------------+

Times for minikube start: 23.6s 22.2s 22.2s 22.3s 22.5s
Times for minikube (PR 12237) start: 22.5s 22.7s 22.5s 23.8s 22.2s

Times for minikube ingress: 27.0s 35.0s 26.6s 28.0s 35.1s
Times for minikube (PR 12237) ingress: 27.5s 26.5s 27.0s 34.0s 35.1s

docker driver with containerd runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 42.6s    | 44.5s               |
| enable ingress |          |                     |
+----------------+----------+---------------------+

Times for minikube start: 32.4s 44.3s 44.1s 44.6s 47.6s
Times for minikube (PR 12237) start: 44.9s 45.4s 43.5s 43.7s 45.2s

@minikube-pr-bot
Copy link

These are the flake rates of all failed tests.

Environment Failed Tests Flake Rate (%)
Docker_Windows TestKicCustomNetwork/use_default_bridge_network (gopogh) 0.00 (chart)
KVM_Linux_containerd TestDownloadOnly/v1.22.0-rc.0/LogsDuration (gopogh) 0.65 (chart)
Docker_Linux_crio_arm64 TestStartStop/group/newest-cni/serial/FirstStart (gopogh) 1.01 (chart)
Docker_Linux_containerd_arm64 TestFunctional/parallel/BuildImage (gopogh) 3.33 (chart)
Docker_Windows TestNetworkPlugins/group/auto/DNS (gopogh) 4.05 (chart)
Docker_Windows TestFunctional/serial/LogsCmd (gopogh) 5.04 (chart)
Docker_macOS TestDebPackageInstall/install_amd64_debian (gopogh) 10/kvm2-driver (chart)
Docker_macOS TestDebPackageInstall/install_amd64_debian (gopogh) 9/kvm2-driver (chart)
Docker_macOS TestDebPackageInstall/install_amd64_debian (gopogh) latest/kvm2-driver (chart)
Docker_macOS TestDebPackageInstall/install_amd64_debian (gopogh) sid/kvm2-driver (chart)
Docker_macOS TestDebPackageInstall/install_amd64_ubuntu (gopogh) 18.04/kvm2-driver (chart)
Docker_macOS TestDebPackageInstall/install_amd64_ubuntu (gopogh) 20.04/kvm2-driver (chart)
Docker_macOS TestDebPackageInstall/install_amd64_ubuntu (gopogh) 20.10/kvm2-driver (chart)
Docker_macOS TestDebPackageInstall/install_amd64_ubuntu (gopogh) latest/kvm2-driver (chart)
Docker_Linux_crio TestStartStop/group/old-k8s-version/serial/Pause (gopogh) 7.19 (chart)
KVM_Linux_crio TestPause/serial/PauseAgain (gopogh) 7.64 (chart)
Docker_Linux_crio_arm64 TestFunctional/parallel/BuildImage (gopogh) 9.52 (chart)
Docker_Linux_crio TestNetworkPlugins/group/auto/DNS (gopogh) 9.80 (chart)
Docker_Linux_containerd_arm64 TestAddons/parallel/GCPAuth (gopogh) 11.33 (chart)
Docker_Windows TestStartStop/group/old-k8s-version/serial/Pause (gopogh) 13.33 (chart)
Docker_Linux_containerd_arm64 TestAddons/parallel/Ingress (gopogh) 15.33 (chart)
Docker_Linux_containerd_arm64 TestFunctional/parallel/MountCmd/any-port (gopogh) 17.33 (chart)
Docker_Linux_containerd_arm64 TestAddons/parallel/CSI (gopogh) 18.00 (chart)
Docker_Linux_containerd_arm64 TestFunctional/parallel/PersistentVolumeClaim (gopogh) 18.67 (chart)
Docker_macOS TestNetworkPlugins/group/bridge/Start (gopogh) 23.33 (chart)
Docker_Linux_crio TestScheduledStopUnix (gopogh) 24.18 (chart)
Docker_Windows TestStartStop/group/newest-cni/serial/Pause (gopogh) 28.10 (chart)
KVM_Linux TestScheduledStopUnix (gopogh) 29.80 (chart)
Docker_Linux_crio_arm64 TestAddons/parallel/GCPAuth (gopogh) 38.78 (chart)
Docker_Windows TestStoppedBinaryUpgrade/MinikubeLogs (gopogh) 39.26 (chart)
More tests... Continued...

Too many tests failed - See test logs for more details.

To see the flake rates of all tests by environment, click here.

@sharifelgamal
Copy link
Collaborator Author

/ok-to-test

@minikube-pr-bot
Copy link

kvm2 driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 48.1s    | 47.5s               |
| enable ingress | 31.1s    | 31.3s               |
+----------------+----------+---------------------+

Times for minikube (PR 12237) start: 46.1s 47.3s 48.7s 47.1s 48.4s
Times for minikube start: 47.6s 47.4s 50.2s 48.7s 46.5s

Times for minikube (PR 12237) ingress: 31.3s 30.8s 31.3s 31.2s 31.8s
Times for minikube ingress: 31.8s 30.8s 30.8s 31.3s 30.8s

docker driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 21.6s    | 21.9s               |
| enable ingress | 29.1s    | 30.1s               |
+----------------+----------+---------------------+

Times for minikube ingress: 26.5s 27.5s 28.0s 27.5s 36.0s
Times for minikube (PR 12237) ingress: 27.5s 27.0s 26.5s 34.5s 35.0s

Times for minikube start: 20.9s 22.3s 21.4s 21.5s 21.7s
Times for minikube (PR 12237) start: 21.2s 22.1s 22.5s 22.6s 21.1s

docker driver with containerd runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 43.1s    | 40.0s               |
| enable ingress |          |                     |
+----------------+----------+---------------------+

Times for minikube start: 45.1s 43.3s 43.6s 40.1s 43.4s
Times for minikube (PR 12237) start: 44.7s 43.4s 25.6s 42.5s 43.6s

@minikube-pr-bot
Copy link

These are the flake rates of all failed tests.

Environment Failed Tests Flake Rate (%)
Docker_Linux_containerd TestJSONOutput/pause/Command (gopogh) n/a
Docker_Linux_crio TestJSONOutput/pause/Command (gopogh) n/a
Docker_Linux_crio TestStoppedBinaryUpgrade/MinikubeLogs (gopogh) n/a
Docker_Linux_crio TestStoppedBinaryUpgrade/Upgrade (gopogh) n/a
KVM_Linux_containerd TestJSONOutput/pause/Command (gopogh) n/a
KVM_Linux_crio TestJSONOutput/pause/Command (gopogh) n/a
Docker_Linux_containerd_arm64 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (gopogh) 0.00 (chart)
Docker_Linux_crio TestFunctional/parallel/DashboardCmd (gopogh) 0.00 (chart)
KVM_Linux_containerd TestAddons/parallel/GCPAuth (gopogh) 0.65 (chart)
Docker_Linux_crio TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (gopogh) 2.67 (chart)
Docker_Linux_crio TestStartStop/group/old-k8s-version/serial/SecondStart (gopogh) 2.67 (chart)
Docker_Linux_crio TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (gopogh) 2.67 (chart)
Docker_Linux_crio TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (gopogh) 2.67 (chart)
Docker_Linux_containerd_arm64 TestNetworkPlugins/group/custom-weave/Start (gopogh) 5.63 (chart)
Docker_Linux_containerd_arm64 TestFunctional/parallel/BuildImage (gopogh) 11.64 (chart)
Docker_Linux_containerd_arm64 TestAddons/parallel/GCPAuth (gopogh) 21.23 (chart)
Docker_Linux_containerd_arm64 TestAddons/parallel/Ingress (gopogh) 21.92 (chart)
KVM_Linux_containerd TestStartStop/group/newest-cni/serial/Pause (gopogh) 22.22 (chart)
Docker_Linux_containerd_arm64 TestFunctional/parallel/TunnelCmd/serial/AccessDirect (gopogh) 22.60 (chart)
Docker_Linux_containerd_arm64 TestStartStop/group/embed-certs/serial/Pause (gopogh) 27.08 (chart)
Docker_Linux_containerd_arm64 TestStartStop/group/newest-cni/serial/Pause (gopogh) 27.08 (chart)
Docker_Linux_containerd_arm64 TestStartStop/group/default-k8s-different-port/serial/Pause (gopogh) 27.27 (chart)
Docker_Linux_crio TestStartStop/group/default-k8s-different-port/serial/Pause (gopogh) 27.27 (chart)
KVM_Linux_containerd TestStartStop/group/default-k8s-different-port/serial/Pause (gopogh) 27.45 (chart)
KVM_Linux_containerd TestStartStop/group/old-k8s-version/serial/Pause (gopogh) 27.45 (chart)
Docker_Linux_containerd_arm64 TestStartStop/group/no-preload/serial/Pause (gopogh) 27.46 (chart)
Docker_Linux_containerd_arm64 TestAddons/parallel/CSI (gopogh) 28.08 (chart)
KVM_Linux_containerd TestPause/serial/Pause (gopogh) 28.10 (chart)
KVM_Linux_containerd TestPause/serial/VerifyStatus (gopogh) 28.10 (chart)
KVM_Linux_containerd TestStartStop/group/embed-certs/serial/Pause (gopogh) 28.10 (chart)
More tests... Continued...

Too many tests failed - See test logs for more details.

To see the flake rates of all tests by environment, click here.

@minikube-pr-bot
Copy link

kvm2 driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 47.5s    | 46.8s               |
| enable ingress | 34.0s    | 34.1s               |
+----------------+----------+---------------------+

Times for minikube start: 48.4s 46.9s 48.7s 46.4s 46.9s
Times for minikube (PR 12237) start: 47.4s 45.9s 46.6s 46.9s 47.2s

Times for minikube ingress: 38.8s 33.3s 32.4s 33.4s 31.8s
Times for minikube (PR 12237) ingress: 32.8s 33.9s 32.3s 39.8s 31.9s

docker driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 22.0s    | 22.2s               |
| enable ingress | 35.8s    | 35.2s               |
+----------------+----------+---------------------+

Times for minikube (PR 12237) start: 22.0s 21.7s 22.2s 21.7s 23.6s
Times for minikube start: 22.8s 21.4s 21.9s 21.9s 21.9s

Times for minikube (PR 12237) ingress: 35.5s 36.0s 35.5s 36.0s 33.0s
Times for minikube ingress: 35.5s 37.0s 35.5s 35.5s 35.5s

docker driver with containerd runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 39.2s    | 43.8s               |
| enable ingress |          |                     |
+----------------+----------+---------------------+

Times for minikube start: 27.8s 43.6s 36.8s 44.1s 43.9s
Times for minikube (PR 12237) start: 44.2s 43.8s 44.1s 43.5s 43.3s

@minikube-pr-bot
Copy link

These are the flake rates of all failed tests.

Environment Failed Tests Flake Rate (%)
KVM_Linux_containerd TestNetworkPlugins/group/kindnet/Start (gopogh) 0.00 (chart)
KVM_Linux_crio TestStoppedBinaryUpgrade/MinikubeLogs (gopogh) 0.00 (chart)
KVM_Linux_crio TestStoppedBinaryUpgrade/Upgrade (gopogh) 0.00 (chart)
Docker_Linux TestStartStop/group/no-preload/serial/AddonExistsAfterStop (gopogh) 0.65 (chart)
Docker_Linux TestStartStop/group/no-preload/serial/SecondStart (gopogh) 0.65 (chart)
Docker_Linux TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (gopogh) 0.65 (chart)
Docker_Linux TestStartStop/group/no-preload/serial/VerifyKubernetesImages (gopogh) 0.65 (chart)
Docker_Linux_containerd_arm64 TestNetworkPlugins/group/auto/Start (gopogh) 1.43 (chart)
Docker_Linux_containerd_arm64 TestNetworkPlugins/group/custom-weave/Start (gopogh) 6.43 (chart)
Docker_Windows TestNetworkPlugins/group/auto/DNS (gopogh) 6.45 (chart)
Docker_Linux_containerd_arm64 TestNetworkPlugins/group/calico/Start (gopogh) 7.86 (chart)
Docker_Linux TestStartStop/group/no-preload/serial/Pause (gopogh) 9.15 (chart)
Docker_Linux_docker_arm64 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (gopogh) 14.29 (chart)
KVM_Linux_containerd TestPause/serial/SecondStartNoReconfiguration (gopogh) 16.88 (chart)
Docker_Linux_crio TestStartStop/group/default-k8s-different-port/serial/Stop (gopogh) 26.14 (chart)
Docker_Linux_containerd_arm64 TestNetworkPlugins/group/enable-default-cni/Start (gopogh) 27.86 (chart)
Docker_Linux_docker_arm64 TestStartStop/group/old-k8s-version/serial/Pause (gopogh) 28.57 (chart)
Docker_Linux_crio TestScheduledStopUnix (gopogh) 36.60 (chart)
KVM_Linux_containerd TestStartStop/group/newest-cni/serial/Pause (gopogh) 39.61 (chart)
Docker_Linux_crio_arm64 TestStartStop/group/old-k8s-version/serial/Pause (gopogh) 43.24 (chart)
Docker_Linux_crio_arm64 TestStartStop/group/embed-certs/serial/Pause (gopogh) 43.84 (chart)
Docker_Linux_crio_arm64 TestStartStop/group/default-k8s-different-port/serial/Pause (gopogh) 44.74 (chart)
Docker_Linux_crio_arm64 TestStartStop/group/newest-cni/serial/Pause (gopogh) 46.75 (chart)
Docker_Linux_crio_arm64 TestStartStop/group/no-preload/serial/Pause (gopogh) 47.92 (chart)
Docker_Windows TestAddons/Setup (gopogh) 48.28 (chart)
Docker_Linux_containerd_arm64 TestStartStop/group/embed-certs/serial/Pause (gopogh) 48.59 (chart)
Docker_Linux_containerd_arm64 TestStartStop/group/newest-cni/serial/Pause (gopogh) 48.59 (chart)
Docker_Linux_containerd_arm64 TestStartStop/group/default-k8s-different-port/serial/Pause (gopogh) 48.94 (chart)
Docker_Linux_containerd_arm64 TestStartStop/group/no-preload/serial/Pause (gopogh) 48.94 (chart)
KVM_Linux_containerd TestStartStop/group/default-k8s-different-port/serial/Pause (gopogh) 49.35 (chart)
More tests... Continued...

Too many tests failed - See test logs for more details.

To see the flake rates of all tests by environment, click here.

@sharifelgamal
Copy link
Collaborator Author

/ok-to-test

@minikube-pr-bot
Copy link

kvm2 driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 47.5s    | 47.1s               |
| enable ingress | 35.2s    | 35.6s               |
+----------------+----------+---------------------+

Times for minikube start: 48.8s 47.7s 47.6s 46.9s 46.7s
Times for minikube (PR 12237) start: 47.4s 47.6s 46.3s 47.0s 47.1s

Times for minikube (PR 12237) ingress: 41.4s 32.3s 32.3s 32.3s 39.8s
Times for minikube ingress: 40.8s 32.3s 30.8s 31.8s 40.3s

docker driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 22.4s    | 21.8s               |
| enable ingress | 33.8s    | 34.1s               |
+----------------+----------+---------------------+

Times for minikube start: 23.9s 22.8s 21.8s 21.7s 21.8s
Times for minikube (PR 12237) start: 22.2s 21.5s 21.5s 21.5s 22.4s

Times for minikube ingress: 35.0s 31.0s 31.5s 35.5s 36.0s
Times for minikube (PR 12237) ingress: 30.0s 32.0s 36.5s 36.5s 35.5s

docker driver with containerd runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 36.9s    | 39.4s               |
| enable ingress |          |                     |
+----------------+----------+---------------------+

Times for minikube start: 27.1s 26.4s 43.3s 43.7s 44.0s
Times for minikube (PR 12237) start: 26.8s 43.1s 42.9s 40.4s 43.6s

@minikube-pr-bot
Copy link

These are the flake rates of all failed tests.

Environment Failed Tests Flake Rate (%)
Docker_Linux_containerd TestErrorSpam/setup (gopogh) 0.00 (chart)
Docker_Linux_crio TestAddons/parallel/CSI (gopogh) 0.00 (chart)
Docker_Linux TestStartStop/group/embed-certs/serial/Pause (gopogh) 8.75 (chart)
Docker_Linux_docker_arm64 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (gopogh) 12.50 (chart)
Hyperkit_macOS TestFunctional/parallel/DashboardCmd (gopogh) 17.39 (chart)
Docker_Linux_docker_arm64 TestStartStop/group/old-k8s-version/serial/Pause (gopogh) 25.00 (chart)
KVM_Linux_containerd TestStartStop/group/newest-cni/serial/Pause (gopogh) 41.61 (chart)
Docker_Windows TestAddons/Setup (gopogh) 45.71 (chart)
Docker_Linux_crio_arm64 TestNetworkPlugins/group/auto/Start (gopogh) 49.57 (chart)
Docker_Linux_containerd_arm64 TestStartStop/group/embed-certs/serial/Pause (gopogh) 50.68 (chart)
Docker_Linux_containerd_arm64 TestStartStop/group/newest-cni/serial/Pause (gopogh) 50.68 (chart)
Docker_Linux_containerd_arm64 TestStartStop/group/default-k8s-different-port/serial/Pause (gopogh) 51.02 (chart)
Docker_Linux_containerd_arm64 TestStartStop/group/no-preload/serial/Pause (gopogh) 51.02 (chart)
KVM_Linux_containerd TestStartStop/group/default-k8s-different-port/serial/Pause (gopogh) 51.55 (chart)
KVM_Linux_containerd TestStartStop/group/embed-certs/serial/Pause (gopogh) 51.55 (chart)
KVM_Linux_containerd TestStartStop/group/old-k8s-version/serial/Pause (gopogh) 51.55 (chart)
KVM_Linux_containerd TestPause/serial/Pause (gopogh) 52.17 (chart)
KVM_Linux_containerd TestPause/serial/VerifyStatus (gopogh) 52.17 (chart)
KVM_Linux_containerd TestStartStop/group/no-preload/serial/Pause (gopogh) 52.17 (chart)
Docker_Linux_crio TestStartStop/group/no-preload/serial/Pause (gopogh) 52.42 (chart)
Docker_Linux_containerd TestStartStop/group/default-k8s-different-port/serial/Pause (gopogh) 52.50 (chart)
Docker_Linux_containerd TestStartStop/group/newest-cni/serial/Pause (gopogh) 52.50 (chart)
Docker_Linux_crio TestStartStop/group/default-k8s-different-port/serial/Pause (gopogh) 52.94 (chart)
KVM_Linux_crio TestStartStop/group/embed-certs/serial/Pause (gopogh) 53.59 (chart)
KVM_Linux_crio TestStartStop/group/default-k8s-different-port/serial/Pause (gopogh) 53.64 (chart)
Docker_Linux_containerd TestStartStop/group/no-preload/serial/Pause (gopogh) 53.75 (chart)
Docker_Linux_crio TestStartStop/group/newest-cni/serial/Pause (gopogh) 53.79 (chart)
KVM_Linux_crio TestStartStop/group/newest-cni/serial/Pause (gopogh) 53.90 (chart)
KVM_Linux_crio TestStartStop/group/old-k8s-version/serial/Pause (gopogh) 53.95 (chart)
Docker_Linux_crio_arm64 TestPause/serial/Pause (gopogh) 54.11 (chart)
More tests... Continued...

Too many tests failed - See test logs for more details.

To see the flake rates of all tests by environment, click here.

@minikube-pr-bot
Copy link

kvm2 driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 53.2s    | 50.5s               |
| enable ingress | 40.5s    | 35.2s               |
+----------------+----------+---------------------+

Times for minikube start: 55.0s 54.1s 53.6s 50.0s 53.3s
Times for minikube (PR 12237) start: 49.7s 51.2s 49.9s 49.9s 51.8s

Times for minikube ingress: 40.9s 34.0s 41.9s 44.0s 41.5s
Times for minikube (PR 12237) ingress: 33.8s 34.0s 34.4s 40.4s 33.5s

docker driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 23.5s    | 23.6s               |
| enable ingress | 34.5s    | 35.2s               |
+----------------+----------+---------------------+

Times for minikube start: 24.5s 22.3s 22.5s 24.0s 24.2s
Times for minikube (PR 12237) start: 23.2s 23.8s 23.9s 23.0s 24.0s

Times for minikube ingress: 33.6s 37.6s 37.1s 31.6s 32.6s
Times for minikube (PR 12237) ingress: 37.1s 33.6s 32.1s 36.1s 37.0s

docker driver with containerd runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 42.0s    | 45.2s               |
| enable ingress |          |                     |
+----------------+----------+---------------------+

Times for minikube start: 28.0s 44.4s 44.9s 44.7s 48.1s
Times for minikube (PR 12237) start: 45.3s 44.2s 48.3s 43.6s 44.7s

@minikube-pr-bot
Copy link

These are the flake rates of all failed tests.

Environment Failed Tests Flake Rate (%)
Docker_Linux_containerd_arm64 TestFunctional/parallel/LoadImage (gopogh) 0.00 (chart)
Docker_macOS TestFunctional/serial/LogsCmd (gopogh) 0.00 (chart)
Hyperkit_macOS TestFunctional/parallel/LoadImage (gopogh) 0.00 (chart)
KVM_Linux TestPause/serial/Pause (gopogh) 0.67 (chart)
KVM_Linux TestPause/serial/VerifyStatus (gopogh) 0.67 (chart)
Docker_Linux_docker_arm64 TestStartStop/group/no-preload/serial/DeployApp (gopogh) 1.33 (chart)
Docker_Linux_crio_arm64 TestStoppedBinaryUpgrade/MinikubeLogs (gopogh) 1.54 (chart)
KVM_Linux TestAddons/parallel/CSI (gopogh) 3.33 (chart)
Hyperkit_macOS TestFunctional/parallel/MySQL (gopogh) 4.50 (chart)
Docker_Linux_crio_arm64 TestStoppedBinaryUpgrade/Upgrade (gopogh) 4.76 (chart)
Docker_Linux TestStartStop/group/newest-cni/serial/Pause (gopogh) 5.30 (chart)
Hyperkit_macOS TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (gopogh) 6.25 (chart)
Hyperkit_macOS TestFunctional/parallel/TunnelCmd/serial/AccessDirect (gopogh) 6.31 (chart)
Hyperkit_macOS TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (gopogh) 6.31 (chart)
Docker_Linux_crio TestNetworkPlugins/group/kindnet/DNS (gopogh) 6.58 (chart)
KVM_Linux_crio TestAddons/parallel/GCPAuth (gopogh) 8.33 (chart)
Hyperkit_macOS TestMultiNode/serial/AddNode (gopogh) 8.93 (chart)
Hyperkit_macOS TestFunctional/parallel/MountCmd/any-port (gopogh) 9.91 (chart)
Hyperkit_macOS TestFunctional/parallel/PersistentVolumeClaim (gopogh) 9.91 (chart)
Hyperkit_macOS TestMultiNode/serial/StartAfterStop (gopogh) 10.71 (chart)
Hyperkit_macOS TestMultiNode/serial/FreshStart2Nodes (gopogh) 11.61 (chart)
Hyperkit_macOS TestMultiNode/serial/DeployApp2Nodes (gopogh) 13.39 (chart)
Hyperkit_macOS TestMultiNode/serial/PingHostFrom2Pods (gopogh) 13.39 (chart)
Docker_macOS TestFunctional/parallel/DashboardCmd (gopogh) 14.29 (chart)
Hyperkit_macOS TestNetworkPlugins/group/calico/Start (gopogh) 15.18 (chart)
Docker_Windows TestStartStop/group/old-k8s-version/serial/Pause (gopogh) 17.14 (chart)
Docker_Linux_docker_arm64 TestMultiNode/serial/AddNode (gopogh) 17.33 (chart)
Docker_Linux_docker_arm64 TestMultiNode/serial/StartAfterStop (gopogh) 17.33 (chart)
Hyperkit_macOS TestDebPackageInstall/install_amd64_debian (gopogh) 10/kvm2-driver (chart)
Hyperkit_macOS TestDebPackageInstall/install_amd64_debian (gopogh) 9/kvm2-driver (chart)
More tests... Continued...

Too many tests failed - See test logs for more details.

To see the flake rates of all tests by environment, click here.

@sharifelgamal sharifelgamal changed the title add TestStartStop to Cloud Shell tests Fix minikube restart on Cloud Shell Aug 23, 2021
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: medyagh, sharifelgamal

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:
  • OWNERS [medyagh,sharifelgamal]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@minikube-pr-bot
Copy link

kvm2 driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 47.6s    | 48.8s               |
| enable ingress | 32.8s    | 33.6s               |
+----------------+----------+---------------------+

Times for minikube start: 47.8s 47.3s 47.8s 48.2s 46.9s
Times for minikube (PR 12237) start: 47.4s 47.3s 52.1s 48.9s 48.0s

Times for minikube ingress: 30.8s 32.3s 39.3s 31.3s 30.4s
Times for minikube (PR 12237) ingress: 31.3s 39.9s 31.4s 31.8s 33.9s

docker driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 22.8s    | 22.7s               |
| enable ingress | 33.0s    | 31.7s               |
+----------------+----------+---------------------+

Times for minikube start: 23.4s 23.0s 22.9s 22.4s 22.4s
Times for minikube (PR 12237) start: 23.5s 22.1s 22.8s 22.0s 22.9s

Times for minikube ingress: 34.0s 30.5s 34.5s 35.5s 30.5s
Times for minikube (PR 12237) ingress: 27.0s 34.5s 34.5s 35.0s 27.5s

docker driver with containerd runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 12237) |
+----------------+----------+---------------------+
| minikube start | 40.7s    | 43.9s               |
| enable ingress |          |                     |
+----------------+----------+---------------------+

Times for minikube start: 27.1s 44.3s 43.8s 44.9s 43.6s
Times for minikube (PR 12237) start: 43.5s 44.0s 45.1s 43.1s 43.9s

@sharifelgamal sharifelgamal merged commit 1af4ec8 into kubernetes:master Aug 23, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. ok-to-test Indicates a non-member PR verified by an org member that is safe to test. size/S Denotes a PR that changes 10-29 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Fix minikube start && stop && start in Cloud Shell: ubepods.slice already exists."
4 participants