Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

chectl server:deploy --platform docker-desktop is failing with exitCode: 137 #21146

Closed
amol-m-deshpande opened this issue Feb 9, 2022 · 8 comments
Closed

chectl server:deploy --platform docker-desktop is failing with exitCode: 137 #21146

amol-m-deshpande opened this issue Feb 9, 2022 · 8 comments
Labels
area/chectl Issues related to chectl, the CLI of Che kind/bug Outline of a bug - must adhere to the bug report template. lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale.

Comments

@amol-m-deshpande
Copy link

amol-m-deshpande commented Feb 9, 2022 •
edited
Loading

Describe the bug

As per the documentation, I installed docker desktop with kubernates, chectl, kubectl

When I execute the following command
chectl server:deploy --platform docker-desktop

I get the following error

~ % chectl server:deploy --platform docker-desktop
› Installer type is set to: 'operator'
› Current Kubernetes context: 'docker-desktop'
  ✔ Verify Kubernetes API...OK
  ✔ 👀  Looking for an already existing Eclipse Che instance
    ✔ Verify if Eclipse Che is deployed into namespace "eclipse-che"...it is not
  ✔ 🧪  DevWorkspace engine
    ✔ Verify cert-manager installation
      ✔ Check Cert Manager deployment...not deployed
      ✔ Deploy Cert Manager...done
      ✔ Wait for Cert Manager...ready
  ✔ ✈️  Docker Desktop preflight checklist
    ✔ Verify if kubectl is installed
    ✔ Verify if kubectl context is Docker Desktop: Found docker-desktop.
    ✔ Verify remote kubernetes status...done.
    ✔ Check Kubernetes version: Found v1.22.5.
    ✔ Verify if nginx ingress is installed
    ✔ Installing nginx ingress
    ✔ Verify domain is set... auto-assigning domain to 192.168.0.168.nip.io....set to 192.168.0.168.nip.io.
  ✔ Following Eclipse Che logs
    ✔ Start following Operator logs...done
    ✔ Start following Eclipse Che Server logs...done
    ✔ Start following PostgreSQL logs...done
    ✔ Start following Keycloak logs...done
    ✔ Start following Plug-in Registry logs...done
    ✔ Start following Devfile Registry logs...done
    ✔ Start following Eclipse Che Dashboard logs...done
    ✔ Start following namespace events...done
  ✔ Create Namespace eclipse-che...[OK]
  ⠙ 🏃‍  Running the Eclipse Che operator
  ✔ Create Namespace eclipse-che...[OK]
  ✔ 🏃‍  Running the Eclipse Che operator
    ✔ Create ServiceAccount che-operator in namespace eclipse-che...done.
    ✔ Read Roles and Bindings...done.
    ✔ Creating Roles and Bindings...done.
    ✔ Create CRD checlusters.org.eclipse.che...done.
    ✔ Waiting 5 seconds for the new Kubernetes resources to get flushed...done.
    ✔ Create deployment che-operator in namespace eclipse-che...done.
    ✔ Operator pod bootstrap
      ✔ Scheduling...done
      ✔ Downloading images...done
      ✔ Starting...done
    ✔ Prepare Eclipse Che cluster CR...Done.
    ✔ Create the Custom Resource of type checlusters.org.eclipse.che in the namespace eclipse-che...done.
  ❯ ✅  Post installation checklist
    ✔ PostgreSQL pod bootstrap
      ✔ Scheduling...done
      ✔ Downloading images...done
      ✔ Starting...done
    ✔ Keycloak pod bootstrap...skipped
    ✔ Devfile Registry pod bootstrap
      ✔ Scheduling...done
      ✔ Downloading images...done
      ✔ Starting...done
    ✔ Plug-in Registry pod bootstrap
      ✔ Scheduling...done
      ✔ Downloading images...done
      ✔ Starting...done
    ✔ Eclipse Che Dashboard pod bootstrap
      ✔ Scheduling...done
      ✔ Downloading images...done
      ✔ Starting...done
    ❯ Eclipse Che Server pod bootstrap
      ✔ Scheduling...done
      ✔ Downloading images...done
      ✖ Starting...failed
        → Failed to start a pod, reason: Error, exitCode: 137
      Eclipse Che status check
    Retrieving Che self-signed CA certificate
    Prepare post installation output
    Error: Command server:deploy failed. Error log: /Users/amoldeshpande/Library/Caches/chectl/error.log.

I have allocated enough memory for the docker desktop and have also set the proper context with kubectl config use-context docker-desktop, I am unable to find what's the issue.

When I go to the file to check the log

2021-10-19T15:19:07.089Z Error: Command server:deploy failed. Error log: /Users/amoldeshpande/Library/Caches/chectl/error.log. Eclipse Che logs: /var/folders/7w/7plm6t812z1fstxfnplccyhc0000gn/T/chectl-logs/1634656736398.
2021-10-19T15:19:07.089Z     at newError (/usr/local/lib/chectl/lib/util.js:198:19)
2021-10-19T15:19:07.089Z     at Object.wrapCommandError (/usr/local/lib/chectl/lib/util.js:194:12)
2021-10-19T15:19:07.089Z     at Deploy.<anonymous> (/usr/local/lib/chectl/lib/commands/server/deploy.js:261:35)
2021-10-19T15:19:07.089Z     at Generator.throw (<anonymous>)
2021-10-19T15:19:07.089Z     at rejected (/usr/local/lib/chectl/node_modules/tslib/tslib.js:115:69)
2021-10-19T15:19:07.089Z Cause: Error: E_PLATFORM_NOT_READY: current kube context is not Docker Desktop context. Found loaded-context
2021-10-19T15:19:07.089Z     at Object.error (/usr/local/lib/chectl/node_modules/@oclif/errors/lib/index.js:26:15)
2021-10-19T15:19:07.089Z     at Deploy.error (/usr/local/lib/chectl/node_modules/@oclif/command/lib/command.js:60:23)
2021-10-19T15:19:07.089Z     at DockerDesktopTasks.<anonymous> (/usr/local/lib/chectl/lib/tasks/platforms/docker-desktop.js:45:33)
2021-10-19T15:19:07.089Z     at Generator.next (<anonymous>)
2021-10-19T15:19:07.089Z     at fulfilled (/usr/local/lib/chectl/node_modules/tslib/tslib.js:114:62)
2021-10-19T15:19:23.517Z Error: Command server:deploy failed. Error log: /Users/amoldeshpande/Library/Caches/chectl/error.log. Eclipse Che logs: /var/folders/7w/7plm6t812z1fstxfnplccyhc0000gn/T/chectl-logs/1634656759127.
2021-10-19T15:19:23.517Z     at newError (/usr/local/lib/chectl/lib/util.js:198:19)
2021-10-19T15:19:23.517Z     at Object.wrapCommandError (/usr/local/lib/chectl/lib/util.js:194:12)
2021-10-19T15:19:23.517Z     at Deploy.<anonymous> (/usr/local/lib/chectl/lib/commands/server/deploy.js:261:35)
2021-10-19T15:19:23.517Z     at Generator.throw (<anonymous>)
2021-10-19T15:19:23.517Z     at rejected (/usr/local/lib/chectl/node_modules/tslib/tslib.js:115:69)
2021-10-19T15:19:23.517Z Cause: Error: E_PLATFORM_NOT_READY: current kube context is not Docker Desktop context. Found loaded-context
2021-10-19T15:19:23.517Z     at Object.error (/usr/local/lib/chectl/node_modules/@oclif/errors/lib/index.js:26:15)
2021-10-19T15:19:23.517Z     at Deploy.error (/usr/local/lib/chectl/node_modules/@oclif/command/lib/command.js:60:23)
2021-10-19T15:19:23.517Z     at DockerDesktopTasks.<anonymous> (/usr/local/lib/chectl/lib/tasks/platforms/docker-desktop.js:45:33)
2021-10-19T15:19:23.517Z     at Generator.next (<anonymous>)
2021-10-19T15:19:23.517Z     at fulfilled (/usr/local/lib/chectl/node_modules/tslib/tslib.js:114:62)
2021-10-19T15:23:29.850Z Warning: Consider using the more reliable 'OLM' installer when deploying a stable release of Eclipse Che (--installer=olm).
2021-10-19T15:23:29.850Z     at Object.warn (/usr/local/lib/chectl/node_modules/@oclif/errors/lib/index.js:49:15)
2021-10-19T15:23:29.850Z     at Deploy.warn (/usr/local/lib/chectl/node_modules/@oclif/command/lib/command.js:57:16)
2021-10-19T15:23:29.850Z     at HelmTasks.deployTasks (/usr/local/lib/chectl/lib/tasks/installers/helm.js:37:21)
2021-10-19T15:23:29.850Z     at Task.task (/usr/local/lib/chectl/lib/tasks/installers/installer.js:95:36)
2021-10-19T15:23:29.850Z     at /usr/local/lib/chectl/node_modules/listr/lib/task.js:167:30
2021-10-19T15:23:29.850Z     at processTicksAndRejections (internal/process/task_queues.js:97:5)

Che version

7.42@latest

Steps to reproduce

bash <(curl -sL https://www.eclipse.org/che/chectl/)

chectl server:deploy --platform docker-desktop

Expected behavior

It should deploy successfully

Runtime

Docker Desktop

Screenshots

Uploading image.png…

Installation method

chectl/latest

Environment

macOS

Eclipse Che Logs

No response

Additional context

No response
@amol-m-deshpande amol-m-deshpande added the kind/bug Outline of a bug - must adhere to the bug report template. label Feb 9, 2022
@che-bot che-bot added the status/need-triage An issue that needs to be prioritized by the curator responsible for the triage. See https://github. label Feb 9, 2022
@benoitf benoitf added area/chectl Issues related to chectl, the CLI of Che and removed status/need-triage An issue that needs to be prioritized by the curator responsible for the triage. See https://github. labels Feb 10, 2022
@benoitf
Copy link
Contributor

benoitf commented Feb 10, 2022

@amol-m-deshpande could you please check the kubernetes context that is set
(or clicking on the whale in tray icon and checking Kubernetes context is set to 'docker-desktop')

@tolusha
Copy link
Contributor

tolusha commented Feb 10, 2022

@amol-m-deshpande
Could you run chectl server:logs and attach logs?

@amol-m-deshpande
Copy link
Author

@benoitf Yes, the context is set to docker-desktop
@tolusha Here are the logs

2022-02-12T12:40:54.390Z	INFO	Binary info 	{"Go version": "go1.16.12"}
2022-02-12T12:40:54.391Z	INFO	Binary info 	{"OS": "linux", "Arch": "amd64"}
2022-02-12T12:40:54.391Z	INFO	Address 	{"Metrics": ":60000"}
2022-02-12T12:40:54.391Z	INFO	Address 	{"Probe": ":6789"}
2022-02-12T12:40:54.391Z	INFO	Operator is running on 	{"Infrastructure": "Kubernetes"}
time="2022-02-12T12:40:54Z" level=info msg="Limit cache by selector: app.kubernetes.io/part-of=che.eclipse.org"
2022-02-12T12:40:55.616Z	INFO	controller-runtime.metrics	metrics server is starting to listen	{"addr": ":60000"}
time="2022-02-12T12:40:56Z" level=info msg="Use 'terminationGracePeriodSeconds' 20 sec. from operator deployment."
time="2022-02-12T12:40:56Z" level=info msg="Set up process signal handler"
2022-02-12T12:40:56.846Z	INFO	setup	DevWorkspace support enabled.
2022-02-12T12:40:56.846Z	INFO	setup	starting manager
2022-02-12T12:40:56.846Z	INFO	controller-runtime.manager	starting metrics server	{"path": "/metrics"}
I0212 12:40:56.846851       1 leaderelection.go:243] attempting to acquire leader lease eclipse-che/e79b08a4.org.eclipse.che...
I0212 12:41:39.118283       1 leaderelection.go:253] successfully acquired lease eclipse-che/e79b08a4.org.eclipse.che
2022-02-12T12:41:39.119Z	INFO	controller-runtime.manager.controller.namespace	Starting EventSource	{"reconciler group": "", "reconciler kind": "Namespace", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.119Z	INFO	controller-runtime.manager.controller.namespace	Starting EventSource	{"reconciler group": "", "reconciler kind": "Namespace", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.119Z	INFO	controller-runtime.manager.controller.namespace	Starting EventSource	{"reconciler group": "", "reconciler kind": "Namespace", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.119Z	INFO	controller-runtime.manager.controller.namespace	Starting EventSource	{"reconciler group": "", "reconciler kind": "Namespace", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.119Z	INFO	controller-runtime.manager.controller.namespace	Starting Controller	{"reconciler group": "", "reconciler kind": "Namespace"}
2022-02-12T12:41:39.120Z	INFO	controller-runtime.manager.controller.devworkspacerouting	Starting EventSource	{"reconciler group": "controller.devfile.io", "reconciler kind": "DevWorkspaceRouting", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.120Z	INFO	controller-runtime.manager.controller.devworkspacerouting	Starting EventSource	{"reconciler group": "controller.devfile.io", "reconciler kind": "DevWorkspaceRouting", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.120Z	INFO	controller-runtime.manager.controller.devworkspacerouting	Starting EventSource	{"reconciler group": "controller.devfile.io", "reconciler kind": "DevWorkspaceRouting", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.120Z	INFO	controller-runtime.manager.controller.devworkspacerouting	Starting EventSource	{"reconciler group": "controller.devfile.io", "reconciler kind": "DevWorkspaceRouting", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.120Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.121Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.122Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.122Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.122Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.122Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.122Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.122Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.122Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.122Z	INFO	controller-runtime.manager.controller.checluster	Starting Controller	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster"}
2022-02-12T12:41:39.122Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.122Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.122Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.122Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.122Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.122Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.122Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.123Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.123Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.123Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.123Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.123Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.123Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.123Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-12T12:41:39.123Z	INFO	controller-runtime.manager.controller.checluster	Starting Controller	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster"}
2022-02-12T12:41:39.120Z	INFO	controller-runtime.manager.controller.devworkspacerouting	Starting Controller	{"reconciler group": "controller.devfile.io", "reconciler kind": "DevWorkspaceRouting"}
2022-02-12T12:41:39.235Z	INFO	controller-runtime.manager.controller.namespace	Starting workers	{"reconciler group": "", "reconciler kind": "Namespace", "worker count": 1}
2022-02-12T12:41:39.236Z	INFO	controller-runtime.manager.controller.devworkspacerouting	Starting workers	{"reconciler group": "controller.devfile.io", "reconciler kind": "DevWorkspaceRouting", "worker count": 1}
2022-02-12T12:41:39.236Z	INFO	controller-runtime.manager.controller.checluster	Starting workers	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "worker count": 1}
2022-02-12T12:41:39.236Z	INFO	controller-runtime.manager.controller.checluster	Starting workers	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "worker count": 1}
2022-02-12T12:41:39.254Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
2022-02-12T12:41:39.260Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
2022-02-12T12:41:39.274Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
2022-02-12T12:41:39.295Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
2022-02-12T12:41:39.337Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
2022-02-12T12:41:39.420Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
2022-02-12T12:41:39.585Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
2022-02-12T12:41:39.907Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
2022-02-12T12:41:40.548Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
I0212 12:41:41.067315       1 request.go:668] Waited for 1.041469818s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/networking.k8s.io/v1?timeout=32s
2022-02-12T12:41:41.830Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
time="2022-02-12T12:41:42Z" level=info msg="Creating a new object: v1.ServiceAccount, name: che"
2022-02-12T12:41:42.291Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
time="2022-02-12T12:41:42Z" level=info msg="Creating a new object: v1.ClusterRole, name: eclipse-che-che-gateway"
time="2022-02-12T12:41:42Z" level=info msg="Creating a new object: v1.ClusterRoleBinding, name: eclipse-che-che-gateway"
2022-02-12T12:41:42.307Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
time="2022-02-12T12:41:42Z" level=info msg="Added finalizer: cheGateway.clusterpermissions.finalizers.che.eclipse.org"
2022-02-12T12:41:42.352Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
time="2022-02-12T12:41:42Z" level=info msg="Creating a new object: v1.ClusterRole, name: eclipse-che-cheworkspaces-clusterrole"
time="2022-02-12T12:41:42Z" level=info msg="Creating a new object: v1.ClusterRoleBinding, name: eclipse-che-cheworkspaces-clusterrole"
time="2022-02-12T12:41:42Z" level=info msg="Added finalizer: cheWorkspaces.clusterpermissions.finalizers.che.eclipse.org"
2022-02-12T12:41:42.419Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
time="2022-02-12T12:41:42Z" level=info msg="Creating a new object: v1.ClusterRole, name: eclipse-che-cheworkspaces-namespaces-clusterrole"
time="2022-02-12T12:41:42Z" level=info msg="Creating a new object: v1.ClusterRoleBinding, name: eclipse-che-cheworkspaces-namespaces-clusterrole"
time="2022-02-12T12:41:42Z" level=info msg="Added finalizer: namespaces-editor.permissions.finalizers.che.eclipse.org"
2022-02-12T12:41:42.449Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
time="2022-02-12T12:41:42Z" level=info msg="Creating a new object: v1.ClusterRole, name: eclipse-che-cheworkspaces-devworkspace-clusterrole"
time="2022-02-12T12:41:42Z" level=info msg="Creating a new object: v1.ClusterRoleBinding, name: eclipse-che-cheworkspaces-devworkspace-clusterrole"
2022-02-12T12:41:42.481Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
time="2022-02-12T12:41:42Z" level=info msg="Added finalizer: devWorkspace.permissions.finalizers.che.eclipse.org"
time="2022-02-12T12:41:42Z" level=info msg="Creating a new object: v1.Secret, name: che-postgres-secret"
time="2022-02-12T12:41:42Z" level=info msg="Custom resource spec eclipse-che updated with Postgres Secret: che-postgres-secret"
2022-02-12T12:41:42.497Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
time="2022-02-12T12:41:42Z" level=info msg="Custom resource spec eclipse-che updated with Postgres DB: dbche"
2022-02-12T12:41:42.508Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
2022-02-12T12:41:42.515Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
time="2022-02-12T12:41:42Z" level=info msg="Custom resource spec eclipse-che updated with Postgres hostname: postgres"
2022-02-12T12:41:42.524Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
time="2022-02-12T12:41:42Z" level=info msg="Custom resource spec eclipse-che updated with Postgres port: 5432"
time="2022-02-12T12:41:42Z" level=info msg="Custom resource spec eclipse-che updated with log level: INFO"
time="2022-02-12T12:41:42Z" level=info msg="Creating a new object: v1.Service, name: che-host"
2022-02-12T12:41:42.533Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
time="2022-02-12T12:41:42Z" level=info msg="Creating a new object: v1.Ingress, name: che"
2022-02-12T12:41:42.542Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "expecting exactly 1 ingress to match Che gateway labels but found 0"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
time="2022-02-12T12:41:42Z" level=error msg="Failed to update checluster status, cause: Operation cannot be fulfilled on checlusters.org.eclipse.che \"eclipse-che\": the object has been modified; please apply your changes to the latest version and try again"
2022-02-12T12:41:42.610Z	ERROR	controller-runtime.manager.controller.checluster	Reconciler error	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "name": "eclipse-che", "namespace": "eclipse-che", "error": "Operation cannot be fulfilled on checlusters.org.eclipse.che \"eclipse-che\": the object has been modified; please apply your changes to the latest version and try again"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/che-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214
time="2022-02-12T12:41:46Z" level=info msg="Custom resource spec eclipse-che updated with CheHost URL: 192.168.0.168.nip.io"
time="2022-02-12T12:41:46Z" level=info msg="Creating a new object: v1.Service, name: postgres"
time="2022-02-12T12:41:46Z" level=info msg="Creating a new object: v1.PersistentVolumeClaim, name: postgres-data"
time="2022-02-12T12:41:46Z" level=info msg="Creating a new object: v1.Deployment, name: postgres"
I0212 12:41:51.694866       1 request.go:668] Waited for 1.023193381s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/controller.devfile.io/v1alpha1?timeout=32s
I0212 12:42:39.641637       1 request.go:668] Waited for 1.045863462s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/authorization.k8s.io/v1?timeout=32s
time="2022-02-12T12:42:40Z" level=info msg="Running exec for 'get PostgreSQL version' in the pod 'postgres-b64ff75df-fr767'"
time="2022-02-12T12:42:41Z" level=info msg="Exec successfully completed."
time="2022-02-12T12:42:41Z" level=info msg="Custom resource spec eclipse-che updated with database.postgresVersion: 13.3"
time="2022-02-12T12:42:41Z" level=info msg="Custom resource spec eclipse-che updated with oAuthClient name: eclipse-che-openshift-identity-provider-hkitqz"
time="2022-02-12T12:42:41Z" level=info msg="Custom resource spec eclipse-che updated with oAuth secret name: bgXcazCbWGxY"
time="2022-02-12T12:42:41Z" level=info msg="Creating a new object: v1.Service, name: devfile-registry"
time="2022-02-12T12:42:41Z" level=info msg="Creating a new object: v1.ConfigMap, name: che-gateway-route-devfile-registry"
time="2022-02-12T12:42:41Z" level=info msg="Custom resource status eclipse-che updated with status: Devfile Registry URL: https://192.168.0.168.nip.io/devfile-registry"
time="2022-02-12T12:42:41Z" level=info msg="Creating a new object: v1.ConfigMap, name: devfile-registry"
time="2022-02-12T12:42:41Z" level=info msg="Creating a new object: v1.Deployment, name: devfile-registry"
I0212 12:43:02.999384       1 request.go:668] Waited for 1.047223626s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/discovery.k8s.io/v1beta1?timeout=32s
time="2022-02-12T12:43:04Z" level=info msg="Creating a new object: v1.Service, name: plugin-registry"
time="2022-02-12T12:43:04Z" level=info msg="Creating a new object: v1.ConfigMap, name: che-gateway-route-plugin-registry"
time="2022-02-12T12:43:04Z" level=info msg="Custom resource status eclipse-che updated with status: Plugin Registry URL: https://192.168.0.168.nip.io/plugin-registry/v3"
time="2022-02-12T12:43:04Z" level=info msg="Creating a new object: v1.ConfigMap, name: plugin-registry"
time="2022-02-12T12:43:04Z" level=info msg="Creating a new object: v1.Deployment, name: plugin-registry"
I0212 12:43:36.311251       1 request.go:668] Waited for 1.046883721s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/acme.cert-manager.io/v1beta1?timeout=32s
time="2022-02-12T12:43:37Z" level=info msg="Creating a new object: v1.Service, name: che-dashboard"
time="2022-02-12T12:43:37Z" level=info msg="Creating a new object: v1.ConfigMap, name: che-gateway-route-che-dashboard"
time="2022-02-12T12:43:37Z" level=info msg="Creating a new object: v1.ServiceAccount, name: che-dashboard"
time="2022-02-12T12:43:37Z" level=info msg="Creating a new object: v1.ClusterRole, name: eclipse-che-che-dashboard"
time="2022-02-12T12:43:37Z" level=info msg="Creating a new object: v1.ClusterRoleBinding, name: eclipse-che-che-dashboard"
time="2022-02-12T12:43:37Z" level=info msg="Added finalizer: dashboard.clusterpermissions.finalizers.che.eclipse.org"
time="2022-02-12T12:43:37Z" level=info msg="Creating a new object: v1.Deployment, name: che-dashboard"
I0212 12:43:57.609299       1 request.go:668] Waited for 1.04749043s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/autoscaling/v2beta1?timeout=32s
time="2022-02-12T12:43:58Z" level=info msg="Creating a new object: v1.ServiceAccount, name: che-gateway"
time="2022-02-12T12:43:58Z" level=info msg="Creating a new object: v1.Role, name: che-gateway"
time="2022-02-12T12:43:58Z" level=info msg="Creating a new object: v1.RoleBinding, name: che-gateway"
time="2022-02-12T12:43:58Z" level=info msg="Creating a new object: v1.Secret, name: che-gateway-oauth-secret"
time="2022-02-12T12:43:58Z" level=info msg="Creating a new object: v1.ConfigMap, name: che-gateway-config-oauth-proxy"
time="2022-02-12T12:43:58Z" level=info msg="Creating a new object: v1.ConfigMap, name: che-gateway-config-kube-rbac-proxy"
time="2022-02-12T12:43:58Z" level=info msg="Creating a new object: v1.ConfigMap, name: che-gateway-config"
time="2022-02-12T12:43:58Z" level=info msg="Creating a new object: v1.Deployment, name: che-gateway"
time="2022-02-12T12:43:58Z" level=info msg="Creating a new object: v1.Service, name: che-gateway"
time="2022-02-12T12:43:58Z" level=info msg="Creating a new object: v1.ConfigMap, name: che-gateway-route-server"
time="2022-02-12T12:43:58Z" level=info msg="Creating a new object: v1.ConfigMap, name: che"
time="2022-02-12T12:44:03Z" level=info msg="Creating a new object: v1.Deployment, name: che"
I0212 12:44:08.309314       1 request.go:668] Waited for 1.038319321s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/node.k8s.io/v1?timeout=32s
I0212 12:54:00.293743       1 request.go:668] Waited for 1.0463161s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/admissionregistration.k8s.io/v1?timeout=32s
I0212 12:54:26.542517       1 request.go:668] Waited for 1.0439585s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/cert-manager.io/v1alpha3?timeout=32s
I0212 12:54:51.817251       1 request.go:668] Waited for 1.0454745s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/policy/v1?timeout=32s
I0212 12:55:42.124133       1 request.go:668] Waited for 1.0430798s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/authorization.k8s.io/v1?timeout=32s
I0212 12:56:29.832083       1 request.go:668] Waited for 1.0337454s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/discovery.k8s.io/v1?timeout=32s
I0212 12:56:39.853277       1 request.go:668] Waited for 1.1949948s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/cert-manager.io/v1beta1?timeout=32s
I0212 12:57:32.482048       1 request.go:668] Waited for 1.0424223s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/autoscaling/v2beta1?timeout=32s
I0212 12:57:58.455267       1 request.go:668] Waited for 1.0441767s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/acme.cert-manager.io/v1beta1?timeout=32s
I0212 12:58:31.234104       1 request.go:668] Waited for 1.0457427s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/acme.cert-manager.io/v1beta1?timeout=32s

@tolusha
Copy link
Contributor

tolusha commented Feb 14, 2022

@amol-m-deshpande
That's che-operator pod logs. Everything is fine here.

I would like to check che-serer pod logs (the one which is failed to start)

@tolusha
Copy link
Contributor

tolusha commented Feb 16, 2022

Pls, try and attach output: kubectl logs deploy/che -n eclipse-che

@amol-m-deshpande
Copy link
Author 

Using embedded assembly in /home/user/eclipse-che.
Found a custom cert. Adding it to java trust store /home/user/cacerts based on /opt/java/openjdk/lib/security/cacerts
Trust this certificate? [no]:  Certificate was added to keystore
NOTE: Picked up JDK_JAVA_OPTIONS:  --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
16-Feb-2022 08:50:36.135 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version name:   Apache Tomcat/10.0.14
16-Feb-2022 08:50:36.155 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server built:          Dec 2 2021 22:01:36 UTC
16-Feb-2022 08:50:36.155 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version number: 10.0.14.0
16-Feb-2022 08:50:36.155 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Name:               Linux
16-Feb-2022 08:50:36.155 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Version:            5.10.76-linuxkit
16-Feb-2022 08:50:36.155 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Architecture:          amd64
16-Feb-2022 08:50:36.155 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Java Home:             /opt/java/openjdk
16-Feb-2022 08:50:36.158 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Version:           11.0.11+9
16-Feb-2022 08:50:36.158 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Vendor:            AdoptOpenJDK
16-Feb-2022 08:50:36.158 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_BASE:         /home/user/eclipse-che/tomcat
16-Feb-2022 08:50:36.158 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_HOME:         /home/user/eclipse-che/tomcat
16-Feb-2022 08:50:36.170 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.lang=ALL-UNNAMED
16-Feb-2022 08:50:36.170 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.io=ALL-UNNAMED
16-Feb-2022 08:50:36.170 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.util=ALL-UNNAMED
16-Feb-2022 08:50:36.170 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.util.concurrent=ALL-UNNAMED
16-Feb-2022 08:50:36.170 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
16-Feb-2022 08:50:36.171 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.config.file=/home/user/eclipse-che/tomcat/conf/logging.properties
16-Feb-2022 08:50:36.171 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
16-Feb-2022 08:50:36.171 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -XX:MaxRAMPercentage=85.0
16-Feb-2022 08:50:36.171 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dche.docker.network=bridge
16-Feb-2022 08:50:36.171 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djavax.net.ssl.trustStore=/home/user/cacerts
16-Feb-2022 08:50:36.171 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djavax.net.ssl.trustStorePassword=changeit
16-Feb-2022 08:50:36.171 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dport.http=8080
16-Feb-2022 08:50:36.171 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dche.home=/home/user/eclipse-che
16-Feb-2022 08:50:36.171 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dche.logs.dir=/logs/
16-Feb-2022 08:50:36.171 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dche.logs.level=INFO
16-Feb-2022 08:50:36.171 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djuli-logback.configurationFile=file:/home/user/eclipse-che/tomcat/conf/tomcat-logger.xml
16-Feb-2022 08:50:36.172 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djdk.tls.ephemeralDHKeySize=2048
16-Feb-2022 08:50:36.172 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.protocol.handler.pkgs=org.apache.catalina.webresources
16-Feb-2022 08:50:36.172 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.apache.catalina.security.SecurityListener.UMASK=0022
16-Feb-2022 08:50:36.172 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dche.local.conf.dir=/home/user/eclipse-che/tomcat/conf/
16-Feb-2022 08:50:36.172 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dignore.endorsed.dirs=
16-Feb-2022 08:50:36.172 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.base=/home/user/eclipse-che/tomcat
16-Feb-2022 08:50:36.172 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.home=/home/user/eclipse-che/tomcat
16-Feb-2022 08:50:36.172 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.io.tmpdir=/home/user/eclipse-che/tomcat/temp
16-Feb-2022 08:50:37.646 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-8080"]
16-Feb-2022 08:50:37.753 INFO [main] org.apache.catalina.startup.Catalina.load Server initialization in [2323] milliseconds
16-Feb-2022 08:50:38.035 INFO [main] org.apache.catalina.core.StandardService.startInternal Starting service [Catalina]
16-Feb-2022 08:50:38.035 INFO [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet engine: [Apache Tomcat/10.0.14]
16-Feb-2022 08:50:38.225 INFO [main] org.apache.catalina.startup.HostConfig.deployWAR Deploying web application archive [/home/user/eclipse-che/tomcat/webapps/ROOT.war]
16-Feb-2022 08:50:45.333 INFO [main] org.apache.catalina.startup.HostConfig.deployWAR Deployment of web application archive [/home/user/eclipse-che/tomcat/webapps/ROOT.war] has finished in [7,109] ms
16-Feb-2022 08:50:45.336 INFO [main] org.apache.catalina.startup.HostConfig.deployWAR Deploying web application archive [/home/user/eclipse-che/tomcat/webapps/api.war]
2022-02-16 08:50:53,052[main]             [INFO ] [.e.c.c.d.JNDIDataSourceFactory 63]   - This=org.eclipse.che.core.db.postgresql.PostgreSQLJndiDataSourceFactory@7ba947a7 obj=ResourceRef[className=javax.sql.DataSource,factoryClassLocation=null,factoryClassName=org.apache.naming.factory.ResourceFactory,{type=scope,content=Shareable},{type=auth,content=Container},{type=singleton,content=true},{type=factory,content=org.eclipse.che.core.db.postgresql.PostgreSQLJndiDataSourceFactory}] name=che Context=org.apache.naming.NamingContext@5cd8e7f3 environment={}
2022-02-16 08:50:54,358[main]             [INFO ] [.e.c.a.d.WsMasterServletModule 52]   - Running in native-user mode ...
2022-02-16 08:51:03,306[main]             [INFO ] [o.j.p.kubernetes.KUBE_PING 131]      - namespace eclipse-che set; clustering enabled

-------------------------------------------------------------------
GMS: address=che-5cd647f644-rvxqs-34100, cluster=RemoteSubscriptionChannel, physical address=10.1.0.120:7800
-------------------------------------------------------------------
2022-02-16 08:51:06,838[main]             [INFO ] [o.jgroups.protocols.pbcast.GMS 125]  - che-5cd647f644-rvxqs-34100: no members discovered after 3500 ms: creating cluster as coordinator
2022-02-16 08:51:06,866[main]             [INFO ] [o.j.p.kubernetes.KUBE_PING 131]      - namespace eclipse-che set; clustering enabled

-------------------------------------------------------------------
GMS: address=che-5cd647f644-rvxqs-44544, cluster=WorkspaceLocks, physical address=10.1.0.120:7801
-------------------------------------------------------------------
2022-02-16 08:51:09,933[main]             [INFO ] [o.jgroups.protocols.pbcast.GMS 125]  - che-5cd647f644-rvxqs-44544: no members discovered after 3056 ms: creating cluster as coordinator
2022-02-16 08:51:09,982[main]             [INFO ] [o.j.p.kubernetes.KUBE_PING 131]      - namespace eclipse-che set; clustering enabled

-------------------------------------------------------------------
GMS: address=che-5cd647f644-rvxqs-14092, cluster=WorkspaceStateCache, physical address=10.1.0.120:7802
-------------------------------------------------------------------
2022-02-16 08:51:13,122[main]             [INFO ] [o.jgroups.protocols.pbcast.GMS 125]  - che-5cd647f644-rvxqs-14092: no members discovered after 3118 ms: creating cluster as coordinator
2022-02-16 08:51:13,927[main]             [INFO ] [o.f.c.i.d.DbSupportFactory 44]       - Database: jdbc:postgresql://postgres:5432/dbche (PostgreSQL 13.3)
2022-02-16 08:51:14,046[main]             [INFO ] [o.f.c.i.util.VersionPrinter 44]      - Flyway 4.2.0 by Boxfuse
2022-02-16 08:51:14,052[main]             [INFO ] [o.f.c.i.d.DbSupportFactory 44]       - Database: jdbc:postgresql://postgres:5432/dbche (PostgreSQL 13.3)
2022-02-16 08:51:14,133[main]             [INFO ] [i.f.CustomSqlMigrationResolver 158]  - Searching for SQL scripts in locations [classpath:che-schema]
2022-02-16 08:51:14,517[main]             [INFO ] [o.f.c.i.command.DbValidate 44]       - Successfully validated 63 migrations (execution time 00:00.387s)
2022-02-16 08:51:14,537[main]             [INFO ] [o.f.c.i.command.DbMigrate 44]        - Current version of schema "public": 7.26.0.1
2022-02-16 08:51:14,538[main]             [INFO ] [o.f.c.i.command.DbMigrate 44]        - Schema "public" is up to date. No migration necessary.
2022-02-16 08:51:17,129[main]             [INFO ] [o.j.p.kubernetes.KUBE_PING 131]      - namespace eclipse-che set; clustering enabled

-------------------------------------------------------------------
GMS: address=che-5cd647f644-rvxqs-40238, cluster=EclipseLinkCommandChannel, physical address=10.1.0.120:7803
-------------------------------------------------------------------
2022-02-16 08:51:20,305[main]             [INFO ] [o.jgroups.protocols.pbcast.GMS 125]  - che-5cd647f644-rvxqs-40238: no members discovered after 3094 ms: creating cluster as coordinator
2022-02-16 08:51:20,361[main]             [INFO ] [o.e.c.a.w.s.WorkspaceRuntimes 182]   - Configured factories for environments: '[kubernetes, no-environment]'
2022-02-16 08:51:20,362[main]             [INFO ] [o.e.c.a.w.s.WorkspaceRuntimes 183]   - Registered infrastructure 'kubernetes'
2022-02-16 08:51:20,418[main]             [INFO ] [o.e.c.a.w.s.WorkspaceRuntimes 694]   - Infrastructure is tracking 0 active runtimes that need to be stopped
2022-02-16 08:51:20,426[main]             [INFO ] [o.e.c.m.oidc.OIDCInfoProvider 71]    - Retrieving OpenId configuration from endpoint: http://192.168.0.168.nip.io:5050/auth/.well-known/openid-configuration
2022-02-16 08:52:36,112[main]             [INFO ] [o.e.c.m.oidc.OIDCInfoProvider 71]    - Retrieving OpenId configuration from endpoint: http://192.168.0.168.nip.io:5050/auth/.well-known/openid-configuration
2022-02-16 08:53:51,585[main]             [INFO ] [o.e.c.a.c.u.ApiInfoLogInformer 36]   - Eclipse Che Api Core: Build info '7.43.0' scmRevision '9a0a73c1500f1398796e157bbb4fdafd19c51c7c' implementationVersion '7.43.0'
2022-02-16 08:53:51,617[main]             [INFO ] [o.e.c.c.metrics.MetricsServer 46]    - Metrics server started at port 8087 successfully 
2022-02-16 08:53:51,807[main]             [INFO ] [o.e.c.m.oidc.OIDCInfoProvider 71]    - Retrieving OpenId configuration from endpoint: http://192.168.0.168.nip.io:5050/auth/.well-known/openid-configuration```

@tolusha
Copy link
Contributor

tolusha commented Feb 16, 2022

I got the problem.
OIDC identity provider is required since 7.42.0 version

See similar issues:
#21136
#21049

Doc:
https://kubernetes.io/docs/reference/access-authn-authz/authentication/#configuring-the-api-server
https://dexidp.io/docs/kubernetes/

@che-bot
Copy link
Contributor

che-bot commented Aug 15, 2022

Issues go stale after 180 days of inactivity. lifecycle/stale issues rot after an additional 7 days of inactivity and eventually close.

Mark the issue as fresh with /remove-lifecycle stale in a new comment.

If this issue is safe to close now please do so.

Moderators: Add lifecycle/frozen label to avoid stale mode.

@che-bot che-bot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Aug 15, 2022
@che-bot che-bot closed this as completed Aug 22, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area/chectl Issues related to chectl, the CLI of Che kind/bug Outline of a bug - must adhere to the bug report template. lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@benoitf @tolusha @che-bot @amol-m-deshpande