Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ReportWorkflow errors in API server #796

Closed
yebrahim opened this issue Feb 7, 2019 · 3 comments
Closed

ReportWorkflow errors in API server #796

yebrahim opened this issue Feb 7, 2019 · 3 comments
Assignees
@hongye-sun
Labels
area/backend kind/bug lifecycle/stale The issue / pull request is stale, any activities remove this label. priority/p2

Comments

@yebrahim
Copy link
Contributor

yebrahim commented Feb 7, 2019

I'm seeing a bunch of these errors when looking at the API server's logs:

I0206 09:24:11.136905       1 error.go:218] Invalid input error: Failed to update run e67660b1-0a4a-11e9-884e-42010a800169. Row not found.
github.com/kubeflow/pipelines/backend/src/common/util.NewInvalidInputError
        /go/src/github.com/kubeflow/pipelines/backend/src/common/util/error.go:165
github.com/kubeflow/pipelines/backend/src/apiserver/storage.(*RunStore).UpdateRun
        /go/src/github.com/kubeflow/pipelines/backend/src/apiserver/storage/run_store.go:370
github.com/kubeflow/pipelines/backend/src/apiserver/resource.(*ResourceManager).ReportWorkflowResource
        /go/src/github.com/kubeflow/pipelines/backend/src/apiserver/resource/resource_manager.go:367
github.com/kubeflow/pipelines/backend/src/apiserver/server.(*ReportServer).ReportWorkflow
        /go/src/github.com/kubeflow/pipelines/backend/src/apiserver/server/report_server.go:39
github.com/kubeflow/pipelines/backend/api/go_client._ReportService_ReportWorkflow_Handler.func1
        /go/src/github.com/kubeflow/pipelines/backend/api/go_client/report.pb.go:188
main.apiServerInterceptor
        /go/src/github.com/kubeflow/pipelines/backend/src/apiserver/interceptor.go:30
github.com/kubeflow/pipelines/backend/api/go_client._ReportService_ReportWorkflow_Handler
        /go/src/github.com/kubeflow/pipelines/backend/api/go_client/report.pb.go:190
google.golang.org/grpc.(*Server).processUnaryRPC
        /go/pkg/mod/google.golang.org/grpc@v1.16.0/server.go:935
google.golang.org/grpc.(*Server).handleStream
        /go/pkg/mod/google.golang.org/grpc@v1.16.0/server.go:1139
google.golang.org/grpc.(*Server).serveStreams.func1.1
        /go/pkg/mod/google.golang.org/grpc@v1.16.0/server.go:683
runtime.goexit
        /usr/local/go/src/runtime/asm_amd64.s:1333
Report workflow failed.
github.com/kubeflow/pipelines/backend/src/common/util.(*UserError).wrap
        /go/src/github.com/kubeflow/pipelines/backend/src/common/util/error.go:211
github.com/kubeflow/pipelines/backend/src/common/util.Wrap
        /go/src/github.com/kubeflow/pipelines/backend/src/common/util/error.go:244
github.com/kubeflow/pipelines/backend/src/apiserver/server.(*ReportServer).ReportWorkflow
        /go/src/github.com/kubeflow/pipelines/backend/src/apiserver/server/report_server.go:41
github.com/kubeflow/pipelines/backend/api/go_client._ReportService_ReportWorkflow_Handler.func1
        /go/src/github.com/kubeflow/pipelines/backend/api/go_client/report.pb.go:188
main.apiServerInterceptor
        /go/src/github.com/kubeflow/pipelines/backend/src/apiserver/interceptor.go:30
github.com/kubeflow/pipelines/backend/api/go_client._ReportService_ReportWorkflow_Handler
        /go/src/github.com/kubeflow/pipelines/backend/api/go_client/report.pb.go:190
google.golang.org/grpc.(*Server).processUnaryRPC
        /go/pkg/mod/google.golang.org/grpc@v1.16.0/server.go:935
google.golang.org/grpc.(*Server).handleStream
        /go/pkg/mod/google.golang.org/grpc@v1.16.0/server.go:1139
google.golang.org/grpc.(*Server).serveStreams.func1.1
        /go/pkg/mod/google.golang.org/grpc@v1.16.0/server.go:683
runtime.goexit
        /usr/local/go/src/runtime/asm_amd64.s:1333
/api.ReportService/ReportWorkflow call failed
github.com/kubeflow/pipelines/backend/src/common/util.(*UserError).wrapf
        /go/src/github.com/kubeflow/pipelines/backend/src/common/util/error.go:206
github.com/kubeflow/pipelines/backend/src/common/util.Wrapf
        /go/src/github.com/kubeflow/pipelines/backend/src/common/util/error.go:231
main.apiServerInterceptor
        /go/src/github.com/kubeflow/pipelines/backend/src/apiserver/interceptor.go:32
github.com/kubeflow/pipelines/backend/api/go_client._ReportService_ReportWorkflow_Handler
        /go/src/github.com/kubeflow/pipelines/backend/api/go_client/report.pb.go:190
google.golang.org/grpc.(*Server).processUnaryRPC
        /go/pkg/mod/google.golang.org/grpc@v1.16.0/server.go:935
google.golang.org/grpc.(*Server).handleStream
        /go/pkg/mod/google.golang.org/grpc@v1.16.0/server.go:1139
google.golang.org/grpc.(*Server).serveStreams.func1.1
        /go/pkg/mod/google.golang.org/grpc@v1.16.0/server.go:683
runtime.goexit
        /usr/local/go/src/runtime/asm_amd64.s:1333
@Kyrremann
Copy link

Kyrremann commented Dec 10, 2019 •
edited
Loading

This is really old, but my logs are filling up with these. If I delete the workflow-resource they disappear.

Any tips to solutions?
I'm running Kubeflow 0.6.2.

@Kyrremann Kyrremann mentioned this issue Dec 11, 2019
Closed
@stale
Copy link

stale bot commented Jun 25, 2020

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the lifecycle/stale The issue / pull request is stale, any activities remove this label. label Jun 25, 2020
@stale
Copy link

stale bot commented Jul 2, 2020

This issue has been automatically closed because it has not had recent activity. Please comment "/reopen" to reopen it.

@stale stale bot closed this as completed Jul 2, 2020
Linchin pushed a commit to Linchin/pipelines that referenced this issue Apr 11, 2023
@Bobgy
test: pin gcp blueprint auto deploy to v1.1 branch in testing repo (k…
0abc3ce 
…ubeflow#796)
magdalenakuhn17 pushed a commit to magdalenakuhn17/pipelines that referenced this issue Oct 22, 2023
@yuzisun
Migrate KFServing to Go Module (kubeflow#796)
f31f382 
* delete vendor

* Fix codegen

* Add go mod

* Fix status map type

* Fix status test

* Fix url address

* Fix url address test

* Pin controller tools version

* Remove address hack

* Fix dockerfile for go mod

* Update generated code

* Fix unit tests

* Fix dockerfile

* Fix openapi gen

* Copy go mod file

* Remove resource validation

* Increase timeout

* Add comment for update-codegen.sh

* Fix controller gen version

* Update api docs

* Remove generate from test target

* Update developer guide for GO MOD

* Fix rbac role name

* Add object selector

* Fix addressable type

* Fix addressable type

* Fix status map

* Generate swagger.json

* Fix status validation

* Review comments

* Clean up dependency
HumairAK pushed a commit to red-hat-data-services/data-science-pipelines that referenced this issue Mar 11, 2024
@ckadner
Load performance test pipelines from files (kubeflow#796)
2c61c8a 
* Add perf_test_config.yaml with paths of test pipelines
* Add a 'Status' column to output CSV file
* Update compile_pyfile to remove loaded pipeline module after
  compilation to allow subsequent imports of another module
  with the same name

Resolves kubeflow#778

Signed-off-by: Christian Kadner <ckadner@us.ibm.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@hongye-sun hongye-sun

Labels
area/backend kind/bug lifecycle/stale The issue / pull request is stale, any activities remove this label. priority/p2
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@yebrahim @Kyrremann @vicaire @hongye-sun