Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

go get fail with “AsynkronIT / protoactor-go” undefined: balancer.PickOptions and undefined: resolver.BuildOption #475

Closed
yossidab opened this issue Apr 25, 2021 · 5 comments · Fixed by #668
Closed

go get fail with “AsynkronIT / protoactor-go” undefined: balancer.PickOptions and undefined: resolver.BuildOption #475

yossidab opened this issue Apr 25, 2021 · 5 comments · Fixed by #668

Comments

@yossidab
Copy link

I have tried to use "go get github.com/AsynkronIT/protoactor-go/..." and I get:

github.com/coreos/etcd/clientv3/balancer/resolver/endpoint
coreos/etcd@v3.3.25+incompatible/clientv3/balancer/resolver/endpoint/endpoint.go:114:78: undefined: resolver.BuildOption
coreos/etcd@v3.3.25+incompatible/clientv3/balancer/resolver/endpoint/endpoint.go:182:31: undefined: resolver.ResolveNowOption
github.com/coreos/etcd/clientv3/balancer/picker
coreos/etcd@v3.3.25+incompatible/clientv3/balancer/picker/err.go:37:44: undefined: balancer.PickOptions
coreos/etcd@v3.3.25+incompatible/clientv3/balancer/picker/roundrobin_balanced.go:55:54: undefined: balancer.PickOptions

I finally got a folder with that name:

$GOPATH/go/pkg/mod/github.com/!asynkron!i!t/protoactor-go@v0.0.0-20210405044454-10bc19881ad6/go.mod

instead of :

$GOPATH/src/github.com/AsynkronIT/protoactor-go

Also i fail in the test at this point: My result:

$GOPATH/pkg/mod/github.com/!asynkron!i!t/protoactor-go@v0.0.0-20210405044454-10bc19881ad6$ go test go list ./... | grep -v consul | grep -v 'no test files'

ok github.com/AsynkronIT/protoactor-go/actor (cached)
ok github.com/AsynkronIT/protoactor-go/actor/middleware/opentracing (cached) [no tests to run]
ok github.com/AsynkronIT/protoactor-go/actor/middleware/propagator (cached)
ok github.com/AsynkronIT/protoactor-go/cluster (cached)
ok github.com/AsynkronIT/protoactor-go/cluster/automanaged (cached) [no tests to run]

expected result:

ok github.com/AsynkronIT/protoactor-go/actor 0.115s
ok github.com/AsynkronIT/protoactor-go/eventstream 0.020s
ok github.com/AsynkronIT/protoactor-go/internal/queue/goring 2.524s
ok github.com/AsynkronIT/protoactor-go/internal/queue/mpsc 2.385s
ok github.com/AsynkronIT/protoactor-go/log 0.017s
ok github.com/AsynkronIT/protoactor-go/mailbox 2.742s
ok github.com/AsynkronIT/protoactor-go/plugin 1.227s
ok github.com/AsynkronIT/protoactor-go/router 1.836s
ok github.com/AsynkronIT/protoactor-go/stream 0.017s
@cupen
Copy link
Contributor

cupen commented Apr 26, 2021 •
edited
Loading

@yossidab Hello, have a good day.

  1. the compile error. It's a compatibility problem between etcd and grpc.
    You can pin grpc-v1.26 in go.mod like:
    https://github.com/AsynkronIT/protoactor-go/blob/335b8bb8304596a893314fc1727d9d00997d62b1/go.mod#L3-L4

    etcd-v3.5 would fix it, but it havn't been released yet.
    https://github.com/etcd-io/etcd/tree/v3.5.0-alpha.0

  2. I finally got a folder with that name.
    Yes, the $GOPATH/go/pkg/mod/ is right path, it's default behavior of your go-v1.13+.
    See cmd/go: default to GO111MODULE=on golang/go#41330

  3. Also i fail in the test at this point
    Some test cases require external services. e.g.: cluster/ConsulProvider require consul.
    Maybe run some external services by docker-compose.yml would be nice.
    e.g.:
    https://github.com/AsynkronIT/protoactor-go/blob/dev/cluster/etcd/docker-compose.yml

@DvpDevelop
Copy link

Disable go molules for this instalation and now it works

@cupen cupen mentioned this issue Jun 22, 2021
Closed
@cupen
Copy link
Contributor

cupen commented Aug 16, 2021 •
edited
Loading

@yossidab @DvpDevelop Hello, it's improved. Just retry it.

docker-compose up -d
make test

Then, you'll get what you want.
Well, except cluster/zookeeper. @qjpcpu

@cupen
Copy link
Contributor

cupen commented Aug 16, 2021

@qjpcpu Hello, have a good day.
I'm not familiar with zookeeper, could you fix it if you have time 😃

$ docker-compose up -d
$ make test
?   	github.com/AsynkronIT/protoactor-go	[no test files]
ok  	github.com/AsynkronIT/protoactor-go/actor	1.188s
?   	github.com/AsynkronIT/protoactor-go/actor/middleware	[no test files]
ok  	github.com/AsynkronIT/protoactor-go/actor/middleware/opentracing	0.009s [no tests to run]
ok  	github.com/AsynkronIT/protoactor-go/actor/middleware/propagator	0.013s
?   	github.com/AsynkronIT/protoactor-go/actor/middleware/protozip	[no test files]
?   	github.com/AsynkronIT/protoactor-go/cli	[no test files]
ok  	github.com/AsynkronIT/protoactor-go/cluster	1.026s
ok  	github.com/AsynkronIT/protoactor-go/cluster/automanaged	0.007s [no tests to run]
?   	github.com/AsynkronIT/protoactor-go/cluster/chash	[no test files]
ok  	github.com/AsynkronIT/protoactor-go/cluster/consul	2.227s
ok  	github.com/AsynkronIT/protoactor-go/cluster/etcd	0.116s
2021/08/16 12:49:24 WARN [CLU/ZK]	OnRoleChanged. error="don't worry, should panic here\ngoroutine 14 [running]:\ngithub.com/AsynkronIT/protoactor-go/cluster/zk.getRunTimeStack(...)\n\t/home/cupen/workbench/repos/protoactor-go/cluster/zk/utils.go:70\ngithub.com/AsynkronIT/protoactor-go/cluster/zk.safeRun.func1()\n\t/home/cupen/workbench/repos/protoactor-go/cluster/zk/utils.go:61 +0xbd\npanic(0xaa0cc0, 0xc40a70)\n\t/usr/lib/go/src/runtime/panic.go:965 +0x1b9\ngithub.com/AsynkronIT/protoactor-go/cluster/zk.(*MiscTestSuite).TestSafeRun.func1.1()\n\t/home/cupen/workbench/repos/protoactor-go/cluster/zk/misc_test.go:51 +0x39\ngithub.com/AsynkronIT/protoactor-go/cluster/zk.safeRun(0xbbcef0)\n\t/home/cupen/workbench/repos/protoactor-go/cluster/zk/utils.go:64 +0x49\ngithub.com/AsynkronIT/protoactor-go/cluster/zk.(*MiscTestSuite).TestSafeRun.func1()\n\t/home/cupen/workbench/repos/protoactor-go/cluster/zk/misc_test.go:51 +0x2d\ngithub.com/stretchr/testify/assert.didPanic.func1(0xc00005f938, 0xc00005f927, 0xc00005f928, 0xbbcef8)\n\t/home/cupen/go/pkg/mod/github.com/stretchr/testify@v1.7.0/assert/assertions.go:1018 +0x6c\ngithub.com/stretchr/testify/assert.didPanic(0xbbcef8, 0xc4dbc0, 0xc0001ccd80, 0x7f8c71b2ffc8, 0xc0001ccd80, 0xc0001ccd01)\n\t/home/cupen/go/pkg/mod/github.com/stretchr/testify@v1.7.0/assert/assertions.go:1020 +0x5f\ngithub.com/stretchr/testify/assert.NotPanics(0xc4dbc0, 0xc0001ccd80, 0xbbcef8, 0x0, 0x0, 0x0, 0x47ee85)\n\t/home/cupen/go/pkg/mod/github.com/stretchr/testify@v1.7.0/assert/assertions.go:1091 +0x77\ngithub.com/stretchr/testify/assert.(*Assertions).NotPanics(0xc0001fd480, 0xbbcef8, 0x0, 0x0, 0x0, 0x0)\n\t/home/cupen/go/pkg/mod/github.com/stretchr/testify@v1.7.0/assert/assertion_forward.go:1143 +0x9a\ngithub.com/AsynkronIT/protoactor-go/cluster/zk.(*MiscTestSuite).TestSafeRun(0xc00006c640)\n\t/home/cupen/workbench/repos/protoactor-go/cluster/zk/misc_test.go:51 +0x4b\nreflect.Value.call(0xc000202a20, 0xc000010f88, 0x13, 0xb8dad3, 0x4, 0xc00005fe30, 0x1, 0x1, 0xc00005fcf8, 0x40da6a, ...)\n\t/usr/lib/go/src/reflect/value.go:476 +0x8e7\nreflect.Value.Call(0xc000202a20, 0xc000010f88, 0x13, 0xc00005fe30, 0x1, 0x1, 0xd4b3c1, 0x22, 0x438)\n\t/usr/lib/go/src/reflect/value.go:337 +0xb9\ngithub.com/stretchr/testify/suite.Run.func1(0xc0001ccd80)\n\t/home/cupen/go/pkg/mod/github.com/stretchr/testify@v1.7.0/suite/suite.go:158 +0x379\ntesting.tRunner(0xc0001ccd80, 0xc0001a0a20)\n\t/usr/lib/go/src/testing/testing.go:1193 +0xef\ncreated by testing.(*T).Run\n\t/usr/lib/go/src/testing/testing.go:1238 +0x2b3\n" 
2021/08/16 12:49:24 INFO  [CLU/ZK]	RegisterService. id="mycluster2@127.0.0.1:8001" seq=1 
2021/08/16 12:49:24 INFO  [CLU/ZK]	StartMember register service. node="mycluster2@127.0.0.1:8001" seq="1" 
2021/08/16 12:49:24 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:24 INFO  [CLU/ZK]	Update cluster. members=1 
2021/08/16 12:49:24 INFO  [CLUSTER]	Updated ClusterTopology eventId=1 members=1 joined=1 left=0 alives=1 
2021/08/16 12:49:24 INFO  [CLU/ZK]	Role changed. from="FOLLOWER" to="LEADER" 
2021/08/16 12:49:24 INFO  [CLU/ZK]	RegisterService. id="mycluster2@127.0.0.1:8002" seq=2 
2021/08/16 12:49:24 INFO  [CLU/ZK]	StartMember register service. node="mycluster2@127.0.0.1:8002" seq="2" 
2021/08/16 12:49:24 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:24 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:24 INFO  [CLU/ZK]	Update cluster. members=2 
2021/08/16 12:49:24 INFO  [CLUSTER]	Updated ClusterTopology eventId=2 members=2 joined=2 left=0 alives=2 
2021/08/16 12:49:24 INFO  [CLU/ZK]	RegisterService. id="mycluster2@127.0.0.1:8003" seq=3 
2021/08/16 12:49:24 INFO  [CLU/ZK]	StartMember register service. node="mycluster2@127.0.0.1:8003" seq="3" 
2021/08/16 12:49:24 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:24 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:24 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:24 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:24 INFO  [CLUSTER]	Updated ClusterTopology eventId=3 members=3 joined=3 left=0 alives=3 
2021/08/16 12:49:24 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:24 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:24 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:24 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:24 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:24 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:24 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:24 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:24 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:24 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:24 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:24 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:24 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:24 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=2 new_revison=1 
2021/08/16 12:49:25 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:25 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:25 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:25 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:25 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:25 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:25 INFO  [CLU/ZK]	RegisterService. id="zk_test_cluster@127.0.0.1:8000" seq=1 
2021/08/16 12:49:25 INFO  [CLU/ZK]	StartMember register service. node="zk_test_cluster@127.0.0.1:8000" seq="1" 
2021/08/16 12:49:25 INFO  [CLU/ZK]	FetchNodes new node. id="zk_test_cluster@127.0.0.1:8000" path="/protoactor/zk_test_cluster/actor-1" seq=1 
2021/08/16 12:49:25 INFO  [CLU/ZK]	Update cluster. members=1 
2021/08/16 12:49:25 INFO  [CLUSTER]	Updated ClusterTopology eventId=1 members=1 joined=1 left=0 alives=1 
2021/08/16 12:49:25 INFO  [CLU/ZK]	Role changed. from="FOLLOWER" to="LEADER" 
2021/08/16 12:49:25 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/zk_test_cluster" children=1 
2021/08/16 12:49:25 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:25 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:25 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:25 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:25 ERROR [CLUSTER]	member.Kinds is different to the old one old="&Member{Host:127.0.0.1,Port:8002,Id:mycluster2@127.0.0.1:8002,Kinds:[],}" new="&Member{Host:127.0.0.1,Port:8002,Id:mycluster2@127.0.0.1:8002,Kinds:[kind1],}" 
2021/08/16 12:49:25 INFO  [CLUSTER]	Updated ClusterTopology eventId=3 members=3 joined=1 left=0 alives=3 
2021/08/16 12:49:25 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:25 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:26 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:26 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:26 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:26 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:26 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:26 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:26 INFO  [CLU/ZK]	RegisterService. id="mycluster3@127.0.0.1:8000" seq=1 
2021/08/16 12:49:26 INFO  [CLU/ZK]	StartMember register service. node="mycluster3@127.0.0.1:8000" seq="1" 
2021/08/16 12:49:26 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster3@127.0.0.1:8000" path="/protoactor/mycluster3/actor-1" seq=1 
2021/08/16 12:49:26 INFO  [CLU/ZK]	Update cluster. members=1 
2021/08/16 12:49:26 INFO  [CLUSTER]	Updated ClusterTopology eventId=1 members=1 joined=1 left=0 alives=1 
2021/08/16 12:49:26 INFO  [CLU/ZK]	Role changed. from="FOLLOWER" to="LEADER" 
2021/08/16 12:49:26 INFO  [CLU/ZK]	RegisterService. id="mycluster3@127.0.0.1:8000" seq=1 
2021/08/16 12:49:26 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster3" children=1 
2021/08/16 12:49:26 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:26 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:26 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:26 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:26 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:26 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:27 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:27 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:27 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:27 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:27 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:27 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:27 INFO  [CLU/ZK]	RegisterService. id="mycluster4@127.0.0.1:8000" seq=1 
2021/08/16 12:49:27 INFO  [CLU/ZK]	StartMember register service. node="mycluster4@127.0.0.1:8000" seq="1" 
2021/08/16 12:49:27 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster4@127.0.0.1:8000" path="/protoactor/mycluster4/actor-1" seq=1 
2021/08/16 12:49:27 INFO  [CLU/ZK]	Update cluster. members=1 
2021/08/16 12:49:27 INFO  [CLUSTER]	Updated ClusterTopology eventId=1 members=1 joined=1 left=0 alives=1 
2021/08/16 12:49:27 INFO  [CLU/ZK]	Role changed. from="FOLLOWER" to="LEADER" 
2021/08/16 12:49:27 INFO  [CLU/ZK]	RegisterService. id="mycluster4@127.0.0.1:8000" seq=1 
2021/08/16 12:49:27 INFO  [CLU/ZK]	Role changed. from="LEADER" to="FOLLOWER" 
2021/08/16 12:49:27 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:27 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:27 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:27 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:27 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:27 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:28 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:28 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:28 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:28 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:28 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:28 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:28 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:28 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:28 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:28 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:28 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:28 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:29 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:29 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:29 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:29 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:29 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:29 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:29 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:29 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:29 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:29 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:29 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:29 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:30 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:30 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:30 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:30 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:30 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:30 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:30 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:30 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:30 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:30 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:30 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:30 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:31 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:31 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:31 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:31 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:31 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:31 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:31 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:31 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:31 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:31 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:31 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:31 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:32 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:32 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:32 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:32 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:32 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:32 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:32 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:32 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:32 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:32 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:32 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:32 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:33 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:33 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:33 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:33 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:33 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:33 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:33 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:33 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:33 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:33 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:33 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:33 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:34 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:34 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:34 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:34 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:34 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:34 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:34 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:34 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:34 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:34 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:34 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:34 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:35 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:35 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:35 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:35 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:35 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:35 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:35 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:35 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:35 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:35 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:35 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:35 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:36 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:36 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:36 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:36 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:36 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:36 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:36 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:36 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:36 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:36 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:36 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:36 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:37 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:37 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:37 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:37 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:37 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:37 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:37 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:37 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:37 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:37 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:37 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:37 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:38 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:38 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:38 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:38 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:38 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:38 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:38 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:38 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:38 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:38 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:38 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:38 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:39 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:39 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:39 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:39 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:39 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:39 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:39 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:39 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:39 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:39 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:39 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:39 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:40 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:40 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:40 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:40 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:40 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:40 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:40 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:40 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:40 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:40 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:40 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:40 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:41 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:41 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:41 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:41 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:41 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:41 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:41 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:41 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:41 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:41 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:41 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:41 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:42 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:42 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:42 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:42 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:42 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:42 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:42 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:42 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:42 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:42 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:42 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:42 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:43 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:43 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:43 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:43 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:43 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:43 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:43 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:43 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:43 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:43 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:43 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:43 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:44 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:44 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:44 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:44 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:44 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:44 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:44 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:44 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:44 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:44 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:44 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:44 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:45 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:45 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:45 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:45 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:45 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:45 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:45 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:45 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:45 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:45 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:45 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:45 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:46 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:46 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:46 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:46 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:46 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:46 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:46 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:46 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:46 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:46 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:46 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:46 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:47 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:47 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:47 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:47 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:47 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:47 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:47 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:47 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:47 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:47 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:47 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:47 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:48 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:48 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:48 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:48 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:48 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:48 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:48 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:48 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:48 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:48 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:48 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:48 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:49 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:49 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:49 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:49 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:49 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:49 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:49 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:49 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:49 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:49 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:49 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:49 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:50 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:50 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:50 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:50 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:50 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:50 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:50 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:50 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:50 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:50 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:50 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:50 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:51 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:51 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:51 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:51 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:51 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:51 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:51 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:51 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:51 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:51 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:51 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:51 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:52 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:52 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:52 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:52 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:52 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:52 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:52 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:52 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:52 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:52 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:52 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:52 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:53 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:53 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:53 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:53 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:53 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:53 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
2021/08/16 12:49:53 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8001" path="/protoactor/mycluster2/actor-1" seq=1 
2021/08/16 12:49:53 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8002" path="/protoactor/mycluster2/actor-2" seq=2 
2021/08/16 12:49:53 INFO  [CLU/ZK]	FetchNodes new node. id="mycluster2@127.0.0.1:8003" path="/protoactor/mycluster2/actor-3" seq=3 
2021/08/16 12:49:53 INFO  [CLU/ZK]	Update cluster. members=3 
2021/08/16 12:49:53 INFO  [CLU/ZK]	KeepWatching cluster. cluster="/protoactor/mycluster2" children=1 
2021/08/16 12:49:53 INFO  [CLU/ZK]	Chilren changed, wait 1 sec and watch again old_cversion=3 new_revison=1 
panic: test timed out after 30s

goroutine 40 [running]:
testing.(*M).startAlarm.func1()
	/usr/lib/go/src/testing/testing.go:1700 +0xe5
created by time.goFunc
	/usr/lib/go/src/time/sleep.go:180 +0x45

goroutine 1 [chan receive]:
testing.(*T).Run(0xc0001cd200, 0xb9bfaa, 0x17, 0xbbcf48, 0x493a01)
	/usr/lib/go/src/testing/testing.go:1239 +0x2da
testing.runTests.func1(0xc000001c80)
	/usr/lib/go/src/testing/testing.go:1511 +0x78
testing.tRunner(0xc000001c80, 0xc00015fde0)
	/usr/lib/go/src/testing/testing.go:1193 +0xef
testing.runTests(0xc00000e678, 0x1023ba0, 0x2, 0x2, 0xc03e997cad444dd7, 0x6fc3b9259, 0x10378a0, 0xb95445)
	/usr/lib/go/src/testing/testing.go:1509 +0x2fe
testing.(*M).Run(0xc0001bc080, 0x0)
	/usr/lib/go/src/testing/testing.go:1417 +0x1eb
main.main()
	_testmain.go:45 +0x138

goroutine 6 [chan receive]:
github.com/AsynkronIT/protoactor-go/log.(*ioLogger).listenEvent(0xc00007c1e0)
	/home/cupen/workbench/repos/protoactor-go/log/string_encoder.go:42 +0x7d
created by github.com/AsynkronIT/protoactor-go/log.init.1
	/home/cupen/workbench/repos/protoactor-go/log/string_encoder.go:29 +0xf1

goroutine 18 [chan receive]:
testing.(*T).Run(0xc00008a300, 0xa7ba9e, 0x34, 0xc0001a0ea0, 0xc0001cd201)
	/usr/lib/go/src/testing/testing.go:1239 +0x2da
github.com/stretchr/testify/suite.runTests(0xc628b0, 0xc0001cd200, 0xc000268180, 0x4, 0x4)
	/home/cupen/go/pkg/mod/github.com/stretchr/testify@v1.7.0/suite/suite.go:203 +0xbc
github.com/stretchr/testify/suite.Run(0xc0001cd200, 0xc52e50, 0xc00006db40)
	/home/cupen/go/pkg/mod/github.com/stretchr/testify@v1.7.0/suite/suite.go:176 +0x75d
github.com/AsynkronIT/protoactor-go/cluster/zk.TestZkProviderTestSuite(0xc0001cd200)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider_test.go:275 +0x51
testing.tRunner(0xc0001cd200, 0xbbcf48)
	/usr/lib/go/src/testing/testing.go:1193 +0xef
created by testing.(*T).Run
	/usr/lib/go/src/testing/testing.go:1238 +0x2b3

goroutine 50 [chan send]:
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).updateLeadership(0xc0000c4000, 0x0, 0x0, 0x0)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:362 +0x2d8
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).Shutdown(0xc0000c4000, 0x1, 0x0, 0x0)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:166 +0x77
github.com/AsynkronIT/protoactor-go/cluster/zk.(*ZkProviderTestSuite).TestUpdateMemberState_DoesNotReregisterAfterShutdown(0xc00006db40)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider_test.go:209 +0xd91
reflect.Value.call(0xc000253b00, 0xc000011dc0, 0x13, 0xb8dad3, 0x4, 0xc00005ae30, 0x1, 0x1, 0xc00005acf8, 0x40da6a, ...)
	/usr/lib/go/src/reflect/value.go:476 +0x8e7
reflect.Value.Call(0xc000253b00, 0xc000011dc0, 0x13, 0xc00005ae30, 0x1, 0x1, 0xd4b3c1, 0x22, 0x438)
	/usr/lib/go/src/reflect/value.go:337 +0xb9
github.com/stretchr/testify/suite.Run.func1(0xc00008a300)
	/home/cupen/go/pkg/mod/github.com/stretchr/testify@v1.7.0/suite/suite.go:158 +0x379
testing.tRunner(0xc00008a300, 0xc0001a0ea0)
	/usr/lib/go/src/testing/testing.go:1193 +0xef
created by testing.(*T).Run
	/usr/lib/go/src/testing/testing.go:1238 +0x2b3

goroutine 20 [chan receive]:
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).startRoleChangedNotifyLoop.func1(0xc00026abe0)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:346 +0x4f
created by github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).startRoleChangedNotifyLoop
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:344 +0x3f

goroutine 21 [chan receive]:
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider)._keepWatching(0xc00026abe0, 0xc5a601, 0xc000268720, 0xc00009a000, 0x16)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:290 +0x77
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).keepWatching(0xc00026abe0, 0xc5a6d0, 0xc000024188, 0x1, 0x0, 0x0)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:257 +0x47d
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).startWatching.func1(0xc00026abe0, 0xc5a6d0, 0xc000024188, 0x1)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:404 +0x75
created by github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).startWatching
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:402 +0x65

goroutine 22 [chan receive]:
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).startRoleChangedNotifyLoop.func1(0xc00026ac80)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:346 +0x4f
created by github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).startRoleChangedNotifyLoop
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:344 +0x3f

goroutine 23 [sleep]:
time.Sleep(0x3b9aca00)
	/usr/lib/go/src/runtime/time.go:193 +0xd2
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:273 +0x6f4
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0xc00009a018, 0x16, 0x1, 0x1, 0x2)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).keepWatching(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0x1, 0x0, 0x0)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:251 +0x16c
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).startWatching.func1(0xc00026ac80, 0xc5a6d0, 0xc000024188, 0x1)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:404 +0x75
created by github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).startWatching
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:402 +0x65

goroutine 24 [chan receive]:
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).startRoleChangedNotifyLoop.func1(0xc00026ad20)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:346 +0x4f
created by github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).startRoleChangedNotifyLoop
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:344 +0x3f

goroutine 25 [sleep]:
time.Sleep(0x3b9aca00)
	/usr/lib/go/src/runtime/time.go:193 +0xd2
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:273 +0x6f4
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x0, 0x0, 0xc000268720)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).addWatcher(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0xc0000269a8, 0x16, 0x1, 0x1, 0x2)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:282 +0x7f9
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).keepWatching(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0x1, 0x0, 0x0)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:251 +0x16c
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).startWatching.func1(0xc00026ad20, 0xc5a6d0, 0xc000024188, 0x1)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:404 +0x75
created by github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).startWatching
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:402 +0x65

goroutine 35 [chan receive]:
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).startRoleChangedNotifyLoop.func1(0xc000352000)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:346 +0x4f
created by github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).startRoleChangedNotifyLoop
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:344 +0x3f

goroutine 36 [chan receive]:
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider)._keepWatching(0xc000352000, 0xc5a601, 0xc00034e000, 0xc000308300, 0x1b)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:290 +0x77
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).keepWatching(0xc000352000, 0xc5a6d0, 0xc000024188, 0x1, 0x0, 0x0)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:257 +0x47d
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).startWatching.func1(0xc000352000, 0xc5a6d0, 0xc000024188, 0x1)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:404 +0x75
created by github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).startWatching
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:402 +0x65

goroutine 38 [chan receive]:
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).startRoleChangedNotifyLoop.func1(0xc0003520a0)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:346 +0x4f
created by github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).startRoleChangedNotifyLoop
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:344 +0x3f

goroutine 39 [chan receive]:
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider)._keepWatching(0xc0003520a0, 0xc5a601, 0xc00034e2a0, 0xc00009a030, 0x16)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:290 +0x77
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).keepWatching(0xc0003520a0, 0xc5a6d0, 0xc000024188, 0x1, 0x0, 0x0)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:257 +0x47d
github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).startWatching.func1(0xc0003520a0, 0xc5a6d0, 0xc000024188, 0x1)
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:404 +0x75
created by github.com/AsynkronIT/protoactor-go/cluster/zk.(*Provider).startWatching
	/home/cupen/workbench/repos/protoactor-go/cluster/zk/zk_provider.go:402 +0x65
FAIL	github.com/AsynkronIT/protoactor-go/cluster/zk	30.021s
ok  	github.com/AsynkronIT/protoactor-go/eventstream	0.030s
?   	github.com/AsynkronIT/protoactor-go/extensions	[no test files]
?   	github.com/AsynkronIT/protoactor-go/internal/core	[no test files]
ok  	github.com/AsynkronIT/protoactor-go/internal/queue/goring	1.892s
ok  	github.com/AsynkronIT/protoactor-go/internal/queue/mpsc	1.515s
ok  	github.com/AsynkronIT/protoactor-go/log	0.002s
ok  	github.com/AsynkronIT/protoactor-go/mailbox	2.659s
ok  	github.com/AsynkronIT/protoactor-go/persistence	0.012s
?   	github.com/AsynkronIT/protoactor-go/persistence/protocb	[no test files]
ok  	github.com/AsynkronIT/protoactor-go/plugin	1.213s
?   	github.com/AsynkronIT/protoactor-go/protobuf/protoc-gen-gograin	[no test files]
?   	github.com/AsynkronIT/protoactor-go/protobuf/protoc-gen-gograinv2	[no test files]
ok  	github.com/AsynkronIT/protoactor-go/remote	0.009s
ok  	github.com/AsynkronIT/protoactor-go/router	2.109s
ok  	github.com/AsynkronIT/protoactor-go/scheduler	0.043s
ok  	github.com/AsynkronIT/protoactor-go/stream	0.002s
FAIL
make: *** [Makefile:39: test] Error 1

@qjpcpu qjpcpu mentioned this issue May 7, 2022
Merged
@qjpcpu
Copy link
Contributor

qjpcpu commented May 7, 2022

@cupen sorry for the late fix #668

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

fix: zk cluster provider qjpcpu/protoactor-go
5 participants
@rogeralsing @cupen @qjpcpu @yossidab @DvpDevelop