Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

HTTPRoute translation and status updates may result in race condition #2446

Closed
rainest opened this issue Apr 29, 2022 · 0 comments · Fixed by #2448
Closed

HTTPRoute translation and status updates may result in race condition #2446

rainest opened this issue Apr 29, 2022 · 0 comments · Fixed by #2448
Assignees
@shaneutt
Labels
bug Something isn't working priority/medium
Milestone
Gateway API - Mil...

Comments

@rainest
Copy link
Contributor

rainest commented Apr 29, 2022

The post-merge tests for a non-code change resulted in a race condition failure. Initial read is that we get a reference to an HTTPRoute object somewhere, pass the same reference to both the parser and the status updater, and if the parser happens to translate that HTTPRoute into a Kong route at the same time as we update status in the other goroutine, we have a simultaneous read/write to the same object. Hard to see specifics since the write occurs in the bowels of some generic apimachinery JSON handling function:

2022-04-29T18:29:25.7901340Z === RUN   TestGatewayFilters
2022-04-29T18:29:25.9945979Z     gateway_test.go:420: deploying a supported gatewayclass to the test cluster
2022-04-29T18:29:26.0068223Z     gateway_test.go:443: deploying a gateway that allows routes in all namespaces
2022-04-29T18:29:26.0175711Z     gateway_test.go:492: deploying a minimal HTTP container deployment to test Ingress routes
2022-04-29T18:29:26.0407776Z     gateway_test.go:514: exposing deployment httpbin via service
2022-04-29T18:29:26.4010057Z     gateway_test.go:535: creating an httproute to access deployment httpbin via kong
2022-04-29T18:29:26.4687157Z     gateway_test.go:596: verifying that the Gateway gets linked to the route via status
2022-04-29T18:29:28.5674141Z time="2022-04-29T18:29:28Z" level=debug msg="fetching endpoints" service_name=httpbin service_namespace=93045779-d077-4d2a-8083-02db3b3d7945 service_port="&ServicePort{Name:,Protocol:TCP,Port:80,TargetPort:{0 80 },NodePort:30980,AppProtocol:nil,}"
2022-04-29T18:29:28.5676788Z time="2022-04-29T18:29:28Z" level=debug msg="found endpoints: [{10.244.0.26 80}]" service_name=httpbin service_namespace=93045779-d077-4d2a-8083-02db3b3d7945 service_port="&ServicePort{Name:,Protocol:TCP,Port:80,TargetPort:{0 80 },NodePort:30980,AppProtocol:nil,}"
2022-04-29T18:29:28.5679826Z time="2022-04-29T18:29:28Z" level=debug msg="found endpoints: []" service_name=httpbin service_namespace=17858d92-ce4f-4491-a2ba-16eb6286acf5 service_port="&ServicePort{Name:,Protocol:TCP,Port:80,TargetPort:{0 80 },NodePort:30451,AppProtocol:nil,}"
2022-04-29T18:29:28.5682412Z time="2022-04-29T18:29:28Z" level=warning msg="no active endpoints" service_name=httpbin service_namespace=17858d92-ce4f-4491-a2ba-16eb6286acf5 service_port="&ServicePort{Name:,Protocol:TCP,Port:80,TargetPort:{0 80 },NodePort:30451,AppProtocol:nil,}"
2022-04-29T18:29:28.5684777Z time="2022-04-29T18:29:28Z" level=error msg="no targets could be found for kubernetes service 17858d92-ce4f-4491-a2ba-16eb6286acf5/httpbin" service_name=httproute.17858d92-ce4f-4491-a2ba-16eb6286acf5.78362461-ce12-4327-bb9e-650b4dc76d75.0
2022-04-29T18:29:28.5687187Z time="2022-04-29T18:29:28Z" level=warning msg="no targets found to create upstream" service_name=httproute.17858d92-ce4f-4491-a2ba-16eb6286acf5.78362461-ce12-4327-bb9e-650b4dc76d75.0
2022-04-29T18:29:29.1206663Z time="2022-04-29T18:29:29Z" level=info msg="successfully synced configuration to kong."
2022-04-29T18:29:29.1211867Z time="2022-04-29T18:29:29Z" level=debug msg="triggering report for 2 configured Kubernetes objects"
2022-04-29T18:29:31.5661152Z time="2022-04-29T18:29:31Z" level=error msg="HTTPRoute / can't be routed: no rules provided"
2022-04-29T18:29:31.5667939Z ==================
2022-04-29T18:29:31.5670258Z WARNING: DATA RACE
2022-04-29T18:29:31.5673434Z Write at 0x00c0012c3e20 by goroutine 249:
2022-04-29T18:29:31.5675974Z   reflect.Value.SetString()
2022-04-29T18:29:31.5676728Z       /opt/hostedtoolcache/go/1.18.1/x64/src/reflect/value.go:2291 +0x90
2022-04-29T18:29:31.5678923Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).literalStore()
2022-04-29T18:29:31.5680443Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:1052 +0xa29
2022-04-29T18:29:31.5683644Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).value()
2022-04-29T18:29:31.5684695Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:411 +0x24e
2022-04-29T18:29:31.5685366Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).object()
2022-04-29T18:29:31.5686294Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:851 +0x152d
2022-04-29T18:29:31.5686847Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).value()
2022-04-29T18:29:31.5687745Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:397 +0xb2
2022-04-29T18:29:31.5688302Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).object()
2022-04-29T18:29:31.5689209Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:851 +0x152d
2022-04-29T18:29:31.5689740Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).value()
2022-04-29T18:29:31.5690632Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:397 +0xb2
2022-04-29T18:29:31.5691200Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).unmarshal()
2022-04-29T18:29:31.5693324Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:187 +0x3e7
2022-04-29T18:29:31.5694019Z   sigs.k8s.io/json/internal/golang/encoding/json.Unmarshal()
2022-04-29T18:29:31.5694974Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:112 +0x285
2022-04-29T18:29:31.5695538Z   sigs.k8s.io/json.UnmarshalCaseSensitivePreserveInts()
2022-04-29T18:29:31.5696456Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/json.go:62 +0x133
2022-04-29T18:29:31.5697023Z   k8s.io/apimachinery/pkg/runtime/serializer/json.(*Serializer).unmarshal()
2022-04-29T18:29:31.5697735Z       /home/runner/go/pkg/mod/k8s.io/apimachinery@v0.23.6/pkg/runtime/serializer/json/json.go:245 +0xaa
2022-04-29T18:29:31.5698450Z   k8s.io/apimachinery/pkg/runtime/serializer/json.(*Serializer).Decode()
2022-04-29T18:29:31.5699447Z       /home/runner/go/pkg/mod/k8s.io/apimachinery@v0.23.6/pkg/runtime/serializer/json/json.go:193 +0xbef
2022-04-29T18:29:31.5700908Z   k8s.io/apimachinery/pkg/runtime.WithoutVersionDecoder.Decode()
2022-04-29T18:29:31.5701489Z       /home/runner/go/pkg/mod/k8s.io/apimachinery@v0.23.6/pkg/runtime/helper.go:252 +0xb9
2022-04-29T18:29:31.5701919Z   k8s.io/apimachinery/pkg/runtime.(*WithoutVersionDecoder).Decode()
2022-04-29T18:29:31.5702271Z       <autogenerated>:1 +0xb5
2022-04-29T18:29:31.5702836Z   sigs.k8s.io/controller-runtime/pkg/client/apiutil.targetZeroingDecoder.Decode()
2022-04-29T18:29:31.5703627Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/client/apiutil/apimachinery.go:186 +0xd8
2022-04-29T18:29:31.5704229Z   sigs.k8s.io/controller-runtime/pkg/client/apiutil.(*targetZeroingDecoder).Decode()
2022-04-29T18:29:31.5704606Z       <autogenerated>:1 +0xb5
2022-04-29T18:29:31.5704964Z   k8s.io/client-go/rest.Result.Into()
2022-04-29T18:29:31.5706117Z       /home/runner/go/pkg/mod/k8s.io/client-go@v0.23.6/rest/request.go:1334 +0xab
2022-04-29T18:29:31.5706779Z   sigs.k8s.io/controller-runtime/pkg/client.(*typedClient).UpdateStatus()
2022-04-29T18:29:31.5707610Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/client/typed_client.go:180 +0x844
2022-04-29T18:29:31.5708240Z   sigs.k8s.io/controller-runtime/pkg/client.(*statusWriter).Update()
2022-04-29T18:29:31.5709143Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/client/client.go:313 +0x38f
2022-04-29T18:29:31.5709965Z   github.com/kong/kubernetes-ingress-controller/v2/internal/controllers/gateway.(*HTTPRouteReconciler).ensureGatewayReferenceStatusAdded()
2022-04-29T18:29:31.5711146Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/controllers/gateway/httproute_controller.go:416 +0xaed
2022-04-29T18:29:31.5711921Z   github.com/kong/kubernetes-ingress-controller/v2/internal/controllers/gateway.(*HTTPRouteReconciler).Reconcile()
2022-04-29T18:29:31.5713109Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/controllers/gateway/httproute_controller.go:325 +0xd84
2022-04-29T18:29:31.5713841Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile()
2022-04-29T18:29:31.5714698Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:114 +0x3ad
2022-04-29T18:29:31.5715668Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler()
2022-04-29T18:29:31.5716472Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:311 +0x44a
2022-04-29T18:29:31.5717092Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem()
2022-04-29T18:29:31.5754723Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:266 +0x324
2022-04-29T18:29:31.5755823Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2()
2022-04-29T18:29:31.5756867Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:227 +0xc8
2022-04-29T18:29:31.5757154Z 
2022-04-29T18:29:31.5757291Z Previous read at 0x00c0012c3e20 by goroutine 162:
2022-04-29T18:29:31.5757947Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane/parser.(*Parser).ingressRulesFromHTTPRoutes()
2022-04-29T18:29:31.5758940Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/parser/translate_httproute.go:31 +0x2a9
2022-04-29T18:29:31.5759651Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane/parser.(*Parser).Build()
2022-04-29T18:29:31.5760534Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/parser/parser.go:70 +0xec
2022-04-29T18:29:31.5761371Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane.(*KongClient).Update()
2022-04-29T18:29:31.5762258Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/kong_client.go:262 +0x36a
2022-04-29T18:29:31.5762969Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane.(*Synchronizer).startUpdateServer()
2022-04-29T18:29:31.5763883Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/synchronizer.go:162 +0x1d5
2022-04-29T18:29:31.5764785Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane.(*Synchronizer).Start.func2()
2022-04-29T18:29:31.5765706Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/synchronizer.go:100 +0x58
2022-04-29T18:29:31.5766011Z 
2022-04-29T18:29:31.5766132Z Goroutine 249 (running) created at:
2022-04-29T18:29:31.5766636Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2()
2022-04-29T18:29:31.5767438Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:223 +0x48e
2022-04-29T18:29:31.5768018Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start()
2022-04-29T18:29:31.5768929Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:234 +0x2a8
2022-04-29T18:29:31.5769522Z   sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1()
2022-04-29T18:29:31.5770276Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/runnable_group.go:218 +0x1b8
2022-04-29T18:29:31.5770975Z   sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func2()
2022-04-29T18:29:31.5772039Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/runnable_group.go:221 +0x47
2022-04-29T18:29:31.5772318Z 
2022-04-29T18:29:31.5772455Z Goroutine 162 (running) created at:
2022-04-29T18:29:31.5773076Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane.(*Synchronizer).Start()
2022-04-29T18:29:31.5774082Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/synchronizer.go:100 +0x249
2022-04-29T18:29:31.5774916Z   sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1()
2022-04-29T18:29:31.5775746Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/runnable_group.go:218 +0x1b8
2022-04-29T18:29:31.5776374Z   sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func2()
2022-04-29T18:29:31.5777441Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/runnable_group.go:221 +0x47
2022-04-29T18:29:31.5777758Z ==================
2022-04-29T18:29:31.5794048Z ==================
2022-04-29T18:29:31.5794690Z WARNING: DATA RACE
2022-04-29T18:29:31.5797598Z Write at 0x00c0012c3e40 by goroutine 249:
2022-04-29T18:29:31.5798153Z   reflect.Value.SetString()
2022-04-29T18:29:31.5798771Z       /opt/hostedtoolcache/go/1.18.1/x64/src/reflect/value.go:2291 +0x90
2022-04-29T18:29:31.5799426Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).literalStore()
2022-04-29T18:29:31.5800394Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:1052 +0xa29
2022-04-29T18:29:31.5800858Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).value()
2022-04-29T18:29:31.5801656Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:411 +0x24e
2022-04-29T18:29:31.5802116Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).object()
2022-04-29T18:29:31.5802922Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:851 +0x152d
2022-04-29T18:29:31.5803375Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).value()
2022-04-29T18:29:31.5804317Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:397 +0xb2
2022-04-29T18:29:31.5804778Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).object()
2022-04-29T18:29:31.5806827Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:851 +0x152d
2022-04-29T18:29:31.5807398Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).value()
2022-04-29T18:29:31.5808375Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:397 +0xb2
2022-04-29T18:29:31.5808905Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).unmarshal()
2022-04-29T18:29:31.5809830Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:187 +0x3e7
2022-04-29T18:29:31.5810561Z   sigs.k8s.io/json/internal/golang/encoding/json.Unmarshal()
2022-04-29T18:29:31.5811913Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:112 +0x285
2022-04-29T18:29:31.5812435Z   sigs.k8s.io/json.UnmarshalCaseSensitivePreserveInts()
2022-04-29T18:29:31.5813226Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/json.go:62 +0x133
2022-04-29T18:29:31.5813719Z   k8s.io/apimachinery/pkg/runtime/serializer/json.(*Serializer).unmarshal()
2022-04-29T18:29:31.5814404Z       /home/runner/go/pkg/mod/k8s.io/apimachinery@v0.23.6/pkg/runtime/serializer/json/json.go:245 +0xaa
2022-04-29T18:29:31.5815062Z   k8s.io/apimachinery/pkg/runtime/serializer/json.(*Serializer).Decode()
2022-04-29T18:29:31.5815800Z       /home/runner/go/pkg/mod/k8s.io/apimachinery@v0.23.6/pkg/runtime/serializer/json/json.go:193 +0xbef
2022-04-29T18:29:31.5816254Z   k8s.io/apimachinery/pkg/runtime.WithoutVersionDecoder.Decode()
2022-04-29T18:29:31.5816808Z       /home/runner/go/pkg/mod/k8s.io/apimachinery@v0.23.6/pkg/runtime/helper.go:252 +0xb9
2022-04-29T18:29:31.5817240Z   k8s.io/apimachinery/pkg/runtime.(*WithoutVersionDecoder).Decode()
2022-04-29T18:29:31.5817591Z       <autogenerated>:1 +0xb5
2022-04-29T18:29:31.5818109Z   sigs.k8s.io/controller-runtime/pkg/client/apiutil.targetZeroingDecoder.Decode()
2022-04-29T18:29:31.5819227Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/client/apiutil/apimachinery.go:186 +0xd8
2022-04-29T18:29:31.5819959Z   sigs.k8s.io/controller-runtime/pkg/client/apiutil.(*targetZeroingDecoder).Decode()
2022-04-29T18:29:31.5820468Z       <autogenerated>:1 +0xb5
2022-04-29T18:29:31.5820978Z   k8s.io/client-go/rest.Result.Into()
2022-04-29T18:29:31.5821860Z       /home/runner/go/pkg/mod/k8s.io/client-go@v0.23.6/rest/request.go:1334 +0xab
2022-04-29T18:29:31.5822449Z   sigs.k8s.io/controller-runtime/pkg/client.(*typedClient).UpdateStatus()
2022-04-29T18:29:31.5823294Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/client/typed_client.go:180 +0x844
2022-04-29T18:29:31.5823910Z   sigs.k8s.io/controller-runtime/pkg/client.(*statusWriter).Update()
2022-04-29T18:29:31.5825016Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/client/client.go:313 +0x38f
2022-04-29T18:29:31.5825950Z   github.com/kong/kubernetes-ingress-controller/v2/internal/controllers/gateway.(*HTTPRouteReconciler).ensureGatewayReferenceStatusAdded()
2022-04-29T18:29:31.5827156Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/controllers/gateway/httproute_controller.go:416 +0xaed
2022-04-29T18:29:31.5828044Z   github.com/kong/kubernetes-ingress-controller/v2/internal/controllers/gateway.(*HTTPRouteReconciler).Reconcile()
2022-04-29T18:29:31.5829250Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/controllers/gateway/httproute_controller.go:325 +0xd84
2022-04-29T18:29:31.5829960Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile()
2022-04-29T18:29:31.5831010Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:114 +0x3ad
2022-04-29T18:29:31.5831667Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler()
2022-04-29T18:29:31.5832982Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:311 +0x44a
2022-04-29T18:29:31.5833681Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem()
2022-04-29T18:29:31.5834569Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:266 +0x324
2022-04-29T18:29:31.5835233Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2()
2022-04-29T18:29:31.5836338Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:227 +0xc8
2022-04-29T18:29:31.5836591Z 
2022-04-29T18:29:31.5836737Z Previous read at 0x00c0012c3e40 by goroutine 162:
2022-04-29T18:29:31.5837376Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane/parser.(*Parser).ingressRulesFromHTTPRoutes()
2022-04-29T18:29:31.5838369Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/parser/translate_httproute.go:31 +0x271
2022-04-29T18:29:31.5839056Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane/parser.(*Parser).Build()
2022-04-29T18:29:31.5839938Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/parser/parser.go:70 +0xec
2022-04-29T18:29:31.5840620Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane.(*KongClient).Update()
2022-04-29T18:29:31.5841500Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/kong_client.go:262 +0x36a
2022-04-29T18:29:31.5842221Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane.(*Synchronizer).startUpdateServer()
2022-04-29T18:29:31.5843141Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/synchronizer.go:162 +0x1d5
2022-04-29T18:29:31.5843842Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane.(*Synchronizer).Start.func2()
2022-04-29T18:29:31.5844728Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/synchronizer.go:100 +0x58
2022-04-29T18:29:31.5845028Z 
2022-04-29T18:29:31.5845135Z Goroutine 249 (running) created at:
2022-04-29T18:29:31.5845633Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2()
2022-04-29T18:29:31.5846428Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:223 +0x48e
2022-04-29T18:29:31.5847008Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start()
2022-04-29T18:29:31.5847793Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:234 +0x2a8
2022-04-29T18:29:31.5848384Z   sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1()
2022-04-29T18:29:31.5849272Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/runnable_group.go:218 +0x1b8
2022-04-29T18:29:31.5849873Z   sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func2()
2022-04-29T18:29:31.5850620Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/runnable_group.go:221 +0x47
2022-04-29T18:29:31.5850861Z 
2022-04-29T18:29:31.5850981Z Goroutine 162 (running) created at:
2022-04-29T18:29:31.5851513Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane.(*Synchronizer).Start()
2022-04-29T18:29:31.5852405Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/synchronizer.go:100 +0x249
2022-04-29T18:29:31.5853034Z   sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1()
2022-04-29T18:29:31.5853911Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/runnable_group.go:218 +0x1b8
2022-04-29T18:29:31.5854471Z   sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func2()
2022-04-29T18:29:31.5855221Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/runnable_group.go:221 +0x47
2022-04-29T18:29:31.5855539Z ==================
2022-04-29T18:29:31.5855741Z ==================
2022-04-29T18:29:31.5855952Z WARNING: DATA RACE
2022-04-29T18:29:31.5867993Z Write at 0x00c0012c3f18 by goroutine 249:
2022-04-29T18:29:31.5868385Z   reflect.typedmemmove()
2022-04-29T18:29:31.5868891Z       /opt/hostedtoolcache/go/1.18.1/x64/src/runtime/mbarrier.go:178 +0x0
2022-04-29T18:29:31.5869220Z   reflect.Value.Set()
2022-04-29T18:29:31.5869690Z       /opt/hostedtoolcache/go/1.18.1/x64/src/reflect/value.go:2093 +0x10a
2022-04-29T18:29:31.5870123Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).array()
2022-04-29T18:29:31.5871060Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:576 +0x953
2022-04-29T18:29:31.5871554Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).value()
2022-04-29T18:29:31.5872654Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:387 +0x128
2022-04-29T18:29:31.5873153Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).object()
2022-04-29T18:29:31.5874041Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:851 +0x152d
2022-04-29T18:29:31.5874542Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).value()
2022-04-29T18:29:31.5875546Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:397 +0xb2
2022-04-29T18:29:31.5876114Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).object()
2022-04-29T18:29:31.5879593Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:851 +0x152d
2022-04-29T18:29:31.5880065Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).value()
2022-04-29T18:29:31.5880871Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:397 +0xb2
2022-04-29T18:29:31.5881340Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).unmarshal()
2022-04-29T18:29:31.5882147Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:187 +0x3e7
2022-04-29T18:29:31.5882588Z   sigs.k8s.io/json/internal/golang/encoding/json.Unmarshal()
2022-04-29T18:29:31.5883361Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:112 +0x285
2022-04-29T18:29:31.5883814Z   sigs.k8s.io/json.UnmarshalCaseSensitivePreserveInts()
2022-04-29T18:29:31.5884515Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/json.go:62 +0x133
2022-04-29T18:29:31.5885151Z   k8s.io/apimachinery/pkg/runtime/serializer/json.(*Serializer).unmarshal()
2022-04-29T18:29:31.5885787Z       /home/runner/go/pkg/mod/k8s.io/apimachinery@v0.23.6/pkg/runtime/serializer/json/json.go:245 +0xaa
2022-04-29T18:29:31.5886234Z   k8s.io/apimachinery/pkg/runtime/serializer/json.(*Serializer).Decode()
2022-04-29T18:29:31.5886835Z       /home/runner/go/pkg/mod/k8s.io/apimachinery@v0.23.6/pkg/runtime/serializer/json/json.go:193 +0xbef
2022-04-29T18:29:31.5887276Z   k8s.io/apimachinery/pkg/runtime.WithoutVersionDecoder.Decode()
2022-04-29T18:29:31.5887841Z       /home/runner/go/pkg/mod/k8s.io/apimachinery@v0.23.6/pkg/runtime/helper.go:252 +0xb9
2022-04-29T18:29:31.5888270Z   k8s.io/apimachinery/pkg/runtime.(*WithoutVersionDecoder).Decode()
2022-04-29T18:29:31.5888616Z       <autogenerated>:1 +0xb5
2022-04-29T18:29:31.5889261Z   sigs.k8s.io/controller-runtime/pkg/client/apiutil.targetZeroingDecoder.Decode()
2022-04-29T18:29:31.5890065Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/client/apiutil/apimachinery.go:186 +0xd8
2022-04-29T18:29:31.5890651Z   sigs.k8s.io/controller-runtime/pkg/client/apiutil.(*targetZeroingDecoder).Decode()
2022-04-29T18:29:31.5891028Z       <autogenerated>:1 +0xb5
2022-04-29T18:29:31.5891371Z   k8s.io/client-go/rest.Result.Into()
2022-04-29T18:29:31.5891949Z       /home/runner/go/pkg/mod/k8s.io/client-go@v0.23.6/rest/request.go:1334 +0xab
2022-04-29T18:29:31.5892459Z   sigs.k8s.io/controller-runtime/pkg/client.(*typedClient).UpdateStatus()
2022-04-29T18:29:31.5893195Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/client/typed_client.go:180 +0x844
2022-04-29T18:29:31.5893711Z   sigs.k8s.io/controller-runtime/pkg/client.(*statusWriter).Update()
2022-04-29T18:29:31.5894411Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/client/client.go:313 +0x38f
2022-04-29T18:29:31.5895190Z   github.com/kong/kubernetes-ingress-controller/v2/internal/controllers/gateway.(*HTTPRouteReconciler).ensureGatewayReferenceStatusAdded()
2022-04-29T18:29:31.5896238Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/controllers/gateway/httproute_controller.go:416 +0xaed
2022-04-29T18:29:31.5897006Z   github.com/kong/kubernetes-ingress-controller/v2/internal/controllers/gateway.(*HTTPRouteReconciler).Reconcile()
2022-04-29T18:29:31.5898000Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/controllers/gateway/httproute_controller.go:325 +0xd84
2022-04-29T18:29:31.5898865Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile()
2022-04-29T18:29:31.5899665Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:114 +0x3ad
2022-04-29T18:29:31.5900268Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler()
2022-04-29T18:29:31.5901076Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:311 +0x44a
2022-04-29T18:29:31.5901697Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem()
2022-04-29T18:29:31.5902501Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:266 +0x324
2022-04-29T18:29:31.5903097Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2()
2022-04-29T18:29:31.5903889Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:227 +0xc8
2022-04-29T18:29:31.5904141Z 
2022-04-29T18:29:31.5904286Z Previous read at 0x00c0012c3f18 by goroutine 162:
2022-04-29T18:29:31.5904566Z   runtime.racereadrange()
2022-04-29T18:29:31.5904860Z       <autogenerated>:1 +0x1b
2022-04-29T18:29:31.5905506Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane/parser.(*Parser).ingressRulesFromHTTPRoutes()
2022-04-29T18:29:31.5906635Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/parser/translate_httproute.go:30 +0x216
2022-04-29T18:29:31.5908273Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane/parser.(*Parser).Build()
2022-04-29T18:29:31.5909311Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/parser/parser.go:70 +0xec
2022-04-29T18:29:31.5910092Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane.(*KongClient).Update()
2022-04-29T18:29:31.5911225Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/kong_client.go:262 +0x36a
2022-04-29T18:29:31.5911938Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane.(*Synchronizer).startUpdateServer()
2022-04-29T18:29:31.5913015Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/synchronizer.go:162 +0x1d5
2022-04-29T18:29:31.5914106Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane.(*Synchronizer).Start.func2()
2022-04-29T18:29:31.5915098Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/synchronizer.go:100 +0x58
2022-04-29T18:29:31.5915692Z 
2022-04-29T18:29:31.5915813Z Goroutine 249 (running) created at:
2022-04-29T18:29:31.5916317Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2()
2022-04-29T18:29:31.5917101Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:223 +0x48e
2022-04-29T18:29:31.5917679Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start()
2022-04-29T18:29:31.5918460Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:234 +0x2a8
2022-04-29T18:29:31.5919040Z   sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1()
2022-04-29T18:29:31.5919804Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/runnable_group.go:218 +0x1b8
2022-04-29T18:29:31.5920524Z   sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func2()
2022-04-29T18:29:31.5921446Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/runnable_group.go:221 +0x47
2022-04-29T18:29:31.5921710Z 
2022-04-29T18:29:31.5921827Z Goroutine 162 (running) created at:
2022-04-29T18:29:31.5922413Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane.(*Synchronizer).Start()
2022-04-29T18:29:31.5923594Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/synchronizer.go:100 +0x249
2022-04-29T18:29:31.5924233Z   sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1()
2022-04-29T18:29:31.5924982Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/runnable_group.go:218 +0x1b8
2022-04-29T18:29:31.5925560Z   sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func2()
2022-04-29T18:29:31.5926308Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/runnable_group.go:221 +0x47
2022-04-29T18:29:31.5926612Z ==================
2022-04-29T18:29:31.5926810Z ==================
2022-04-29T18:29:31.5927018Z WARNING: DATA RACE
2022-04-29T18:29:31.5927267Z Write at 0x00c0012c3f20 by goroutine 249:
2022-04-29T18:29:31.5927541Z   reflect.Value.SetLen()
2022-04-29T18:29:31.5927973Z       /opt/hostedtoolcache/go/1.18.1/x64/src/reflect/value.go:2188 +0xa4
2022-04-29T18:29:31.5928374Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).array()
2022-04-29T18:29:31.5929183Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:579 +0x995
2022-04-29T18:29:31.5929641Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).value()
2022-04-29T18:29:31.5930447Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:387 +0x128
2022-04-29T18:29:31.5931005Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).object()
2022-04-29T18:29:31.5931847Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:851 +0x152d
2022-04-29T18:29:31.5932287Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).value()
2022-04-29T18:29:31.5933080Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:397 +0xb2
2022-04-29T18:29:31.5933531Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).object()
2022-04-29T18:29:31.5934329Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:851 +0x152d
2022-04-29T18:29:31.5934778Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).value()
2022-04-29T18:29:31.5935681Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:397 +0xb2
2022-04-29T18:29:31.5936142Z   sigs.k8s.io/json/internal/golang/encoding/json.(*decodeState).unmarshal()
2022-04-29T18:29:31.5936932Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:187 +0x3e7
2022-04-29T18:29:31.5937372Z   sigs.k8s.io/json/internal/golang/encoding/json.Unmarshal()
2022-04-29T18:29:31.5938160Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/internal/golang/encoding/json/decode.go:112 +0x285
2022-04-29T18:29:31.5938774Z   sigs.k8s.io/json.UnmarshalCaseSensitivePreserveInts()
2022-04-29T18:29:31.5939744Z       /home/runner/go/pkg/mod/sigs.k8s.io/json@v0.0.0-20211020170558-c049b76a60c6/json.go:62 +0x133
2022-04-29T18:29:31.5940212Z   k8s.io/apimachinery/pkg/runtime/serializer/json.(*Serializer).unmarshal()
2022-04-29T18:29:31.5940824Z       /home/runner/go/pkg/mod/k8s.io/apimachinery@v0.23.6/pkg/runtime/serializer/json/json.go:245 +0xaa
2022-04-29T18:29:31.5941259Z   k8s.io/apimachinery/pkg/runtime/serializer/json.(*Serializer).Decode()
2022-04-29T18:29:31.5941848Z       /home/runner/go/pkg/mod/k8s.io/apimachinery@v0.23.6/pkg/runtime/serializer/json/json.go:193 +0xbef
2022-04-29T18:29:31.5942308Z   k8s.io/apimachinery/pkg/runtime.WithoutVersionDecoder.Decode()
2022-04-29T18:29:31.5942873Z       /home/runner/go/pkg/mod/k8s.io/apimachinery@v0.23.6/pkg/runtime/helper.go:252 +0xb9
2022-04-29T18:29:31.5943299Z   k8s.io/apimachinery/pkg/runtime.(*WithoutVersionDecoder).Decode()
2022-04-29T18:29:31.5943649Z       <autogenerated>:1 +0xb5
2022-04-29T18:29:31.5944180Z   sigs.k8s.io/controller-runtime/pkg/client/apiutil.targetZeroingDecoder.Decode()
2022-04-29T18:29:31.5944981Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/client/apiutil/apimachinery.go:186 +0xd8
2022-04-29T18:29:31.5945580Z   sigs.k8s.io/controller-runtime/pkg/client/apiutil.(*targetZeroingDecoder).Decode()
2022-04-29T18:29:31.5945960Z       <autogenerated>:1 +0xb5
2022-04-29T18:29:31.5946305Z   k8s.io/client-go/rest.Result.Into()
2022-04-29T18:29:31.5946885Z       /home/runner/go/pkg/mod/k8s.io/client-go@v0.23.6/rest/request.go:1334 +0xab
2022-04-29T18:29:31.5947383Z   sigs.k8s.io/controller-runtime/pkg/client.(*typedClient).UpdateStatus()
2022-04-29T18:29:31.5948115Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/client/typed_client.go:180 +0x844
2022-04-29T18:29:31.5948646Z   sigs.k8s.io/controller-runtime/pkg/client.(*statusWriter).Update()
2022-04-29T18:29:31.5949351Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/client/client.go:313 +0x38f
2022-04-29T18:29:31.5950270Z   github.com/kong/kubernetes-ingress-controller/v2/internal/controllers/gateway.(*HTTPRouteReconciler).ensureGatewayReferenceStatusAdded()
2022-04-29T18:29:31.5951342Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/controllers/gateway/httproute_controller.go:416 +0xaed
2022-04-29T18:29:31.5952385Z   github.com/kong/kubernetes-ingress-controller/v2/internal/controllers/gateway.(*HTTPRouteReconciler).Reconcile()
2022-04-29T18:29:31.5953900Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/controllers/gateway/httproute_controller.go:325 +0xd84
2022-04-29T18:29:31.5954657Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile()
2022-04-29T18:29:31.5955647Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:114 +0x3ad
2022-04-29T18:29:31.5956413Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler()
2022-04-29T18:29:31.5957220Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:311 +0x44a
2022-04-29T18:29:31.5957849Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem()
2022-04-29T18:29:31.5958819Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:266 +0x324
2022-04-29T18:29:31.5959407Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2()
2022-04-29T18:29:31.5960192Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:227 +0xc8
2022-04-29T18:29:31.5960439Z 
2022-04-29T18:29:31.5960583Z Previous read at 0x00c0012c3f20 by goroutine 162:
2022-04-29T18:29:31.5960875Z   runtime.racereadrange()
2022-04-29T18:29:31.5961168Z       <autogenerated>:1 +0x1b
2022-04-29T18:29:31.5961776Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane/parser.(*Parser).ingressRulesFromHTTPRoutes()
2022-04-29T18:29:31.5962759Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/parser/translate_httproute.go:30 +0x216
2022-04-29T18:29:31.5963453Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane/parser.(*Parser).Build()
2022-04-29T18:29:31.5964334Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/parser/parser.go:70 +0xec
2022-04-29T18:29:31.5965010Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane.(*KongClient).Update()
2022-04-29T18:29:31.5966064Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/kong_client.go:262 +0x36a
2022-04-29T18:29:31.5966808Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane.(*Synchronizer).startUpdateServer()
2022-04-29T18:29:31.5967716Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/synchronizer.go:162 +0x1d5
2022-04-29T18:29:31.5968417Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane.(*Synchronizer).Start.func2()
2022-04-29T18:29:31.5969305Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/synchronizer.go:100 +0x58
2022-04-29T18:29:31.5969611Z 
2022-04-29T18:29:31.5969723Z Goroutine 249 (running) created at:
2022-04-29T18:29:31.5970233Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2()
2022-04-29T18:29:31.5971141Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:223 +0x48e
2022-04-29T18:29:31.5971734Z   sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start()
2022-04-29T18:29:31.5972516Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/internal/controller/controller.go:234 +0x2a8
2022-04-29T18:29:31.5973099Z   sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1()
2022-04-29T18:29:31.5973847Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/runnable_group.go:218 +0x1b8
2022-04-29T18:29:31.5974403Z   sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func2()
2022-04-29T18:29:31.5975261Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/runnable_group.go:221 +0x47
2022-04-29T18:29:31.5975523Z 
2022-04-29T18:29:31.5975647Z Goroutine 162 (running) created at:
2022-04-29T18:29:31.5976198Z   github.com/kong/kubernetes-ingress-controller/v2/internal/dataplane.(*Synchronizer).Start()
2022-04-29T18:29:31.5977089Z       /home/runner/work/kubernetes-ingress-controller/kubernetes-ingress-controller/internal/dataplane/synchronizer.go:100 +0x249
2022-04-29T18:29:31.5977725Z   sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1()
2022-04-29T18:29:31.5978632Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/runnable_group.go:218 +0x1b8
2022-04-29T18:29:31.5979210Z   sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func2()
2022-04-29T18:29:31.5979959Z       /home/runner/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.11.2/pkg/manager/runnable_group.go:221 +0x47
2022-04-29T18:29:31.5980404Z ==================
2022-04-29T18:29:32.1035384Z time="2022-04-29T18:29:32Z" level=debug msg="triggering report for 1 configured Kubernetes objects"
2022-04-29T18:29:32.4744067Z     gateway_test.go:599: waiting for routes from HTTPRoute to become operational
2022-04-29T18:29:33.4930311Z     gateway_test.go:601: waiting for routes from HTTPRoute in other namespace to become operational
2022-04-29T18:29:34.5675178Z time="2022-04-29T18:29:34Z" level=debug msg="found endpoints: [{10.244.0.25 80}]" service_name=httpbin service_namespace=17858d92-ce4f-4491-a2ba-16eb6286acf5 service_port="&ServicePort{Name:,Protocol:TCP,Port:80,TargetPort:{0 80 },NodePort:30451,AppProtocol:nil,}"
2022-04-29T18:29:35.5127134Z     gateway_test.go:604: changing to the same namespace filter
2022-04-29T18:29:35.5292623Z     gateway_test.go:632: confirming other namespace route becomes inaccessible
2022-04-29T18:29:38.5362238Z     gateway_test.go:634: confirming same namespace route still operational
2022-04-29T18:29:39.5418112Z     gateway_test.go:637: changing to a selector filter
2022-04-29T18:29:39.5619756Z     gateway_test.go:677: confirming wrong selector namespace route becomes inaccessible
2022-04-29T18:29:41.5641503Z     gateway_test.go:679: confirming right selector namespace route becomes operational
2022-04-29T18:29:42.5718124Z     gateway_test.go:583: cleaning up the httproute 78362461-ce12-4327-bb9e-650b4dc76d75
2022-04-29T18:29:42.5862450Z     gateway_test.go:522: cleaning up the services 93045779-d077-4d2a-8083-02db3b3d7945/httpbin and 17858d92-ce4f-4491-a2ba-16eb6286acf5/httpbin
2022-04-29T18:29:42.6492200Z     gateway_test.go:501: cleaning up deployments 93045779-d077-4d2a-8083-02db3b3d7945/httpbin and 17858d92-ce4f-4491-a2ba-16eb6286acf5/httpbin
2022-04-29T18:29:42.6597134Z     gateway_test.go:484: cleaning up gateways
2022-04-29T18:29:42.6769934Z     gateway_test.go:435: cleaning up gatewayclasses
@rainest rainest added the bug Something isn't working label Apr 29, 2022
@shaneutt shaneutt added this to the Gateway API - Milestone 2 milestone May 2, 2022
@shaneutt shaneutt self-assigned this May 2, 2022
@shaneutt shaneutt mentioned this issue May 2, 2022
Merged
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@shaneutt shaneutt

Labels
bug Something isn't working priority/medium
Projects
None yet
Milestone
Gateway API - Milestone 2
Development

Successfully merging a pull request may close this issue.

fix: race conditions for object status updates Kong/kubernetes-ingress-controller
2 participants
@rainest @shaneutt