Skip to content
This repository has been archived by the owner on Dec 4, 2024. It is now read-only.

panic: No dial addresses found causes node crash #235

Closed
mrwillis opened this issue Nov 22, 2021 · 4 comments
Closed

panic: No dial addresses found causes node crash #235

mrwillis opened this issue Nov 22, 2021 · 4 comments
Assignees
@zivkovicmilos
Labels
info needed More information needed

Comments

@mrwillis
Copy link
Contributor

mrwillis commented Nov 22, 2021 •
edited
Loading

No dial addresses found causes panic

Description

While investigating a chain halt #232, we noticed 5 out of 15 nodes crash around the same time due to a panic

Your environment

  • OS and version Ubuntu 20
  • version of the Polygon SDK 2bebf50
  • branch that causes this issue develop

Steps to reproduce

Expected behaviour

The node should not crash

Actual behaviour

The node crashes

Logs

Node 1:

Nov 18 23:00:16 ip-172-31-42-69 main[64291]: 2021-11-18T23:00:16.328Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:00:16 ip-172-31-42-69 main[64291]: 2021-11-18T23:00:16.329Z [INFO]  polygon.consensus.ibft.acceptState: we are the proposer: block=173590
Nov 18 23:00:16 ip-172-31-42-69 main[64291]: 2021-11-18T23:00:16.329Z [INFO]  polygon.consensus.ibft: picked out txns from pool: num=1 remaining=0
Nov 18 23:00:16 ip-172-31-42-69 main[64291]: 2021-11-18T23:00:16.330Z [INFO]  polygon.consensus.ibft: build block: number=173590 txns=1
Nov 18 23:00:18 ip-172-31-42-69 main[64291]: 2021-11-18T23:00:18.071Z [INFO]  polygon.blockchain: write block: num=173590 parent=0x93490231ed969471e2d3686fa2f3e24e36925c2857b3b17df2748d380b18e6e2
Nov 18 23:00:18 ip-172-31-42-69 main[64291]: 2021-11-18T23:00:18.086Z [INFO]  polygon.blockchain: new block: number=173590 hash=0x9fcee98faac2bfac2282429969b4ba190ed62424cbff6738ee5693639c66a4f1 txns=1 generation_time_in_sec=2
Nov 18 23:00:18 ip-172-31-42-69 main[64291]: 2021-11-18T23:00:18.086Z [INFO]  polygon.blockchain: new head: hash=0x9fcee98faac2bfac2282429969b4ba190ed62424cbff6738ee5693639c66a4f1 number=173590
Nov 18 23:00:18 ip-172-31-42-69 main[64291]: 2021-11-18T23:00:18.086Z [INFO]  polygon.consensus.ibft: block committed: sequence=173590 hash=0x9fcee98faac2bfac2282429969b4ba190ed62424cbff6738ee5693639c66a4f1 validators=15 rounds=1 committed=9
Nov 18 23:01:18 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:18.248Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:01:18 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:18.248Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:01:18 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:18.249Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x1AC502B21b8b73d881dA7F5af6abDe15FC22EB33 block=173591
Nov 18 23:01:20 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:20.277Z [ERROR] polygon.network: failed to dial bootnode: err="rpc error: code = Unavailable desc = transport is closing"
Nov 18 23:01:20 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:20.278Z [INFO]  polygon.network: Peer disconnected: id=16Uiu2HAmFpTiQcctV2KNpdKm9FehHKFLTUC13oaBGVzvZta7iFMc
Nov 18 23:01:28 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:28.255Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:01:28 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:28.256Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:01:28 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:28.257Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x097F8AB58FaAa6f282C3a50cAb0c1F43b26AA9aF block=173591
Nov 18 23:01:40 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:40.259Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:01:40 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:40.259Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:01:40 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:40.260Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0xB73a1fBE13bAc3b92d6fc9c10a6068C8Edb3b19c block=173591
Nov 18 23:01:54 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:54.276Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:01:54 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:54.277Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:01:54 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:54.278Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x369a595Acea231aEA9809ddab58117204838EA71 block=173591
Nov 18 23:02:12 ip-172-31-42-69 main[64291]: 2021-11-18T23:02:12.286Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:02:12 ip-172-31-42-69 main[64291]: 2021-11-18T23:02:12.287Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:02:12 ip-172-31-42-69 main[64291]: 2021-11-18T23:02:12.287Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x7C482A9234255433A96c1431ef92A8DaC5ebF488 block=173591
Nov 18 23:02:38 ip-172-31-42-69 main[64291]: 2021-11-18T23:02:38.304Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:02:38 ip-172-31-42-69 main[64291]: 2021-11-18T23:02:38.305Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:02:38 ip-172-31-42-69 main[64291]: 2021-11-18T23:02:38.305Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x10Bb1c04c6B8906BBDc5Bae8272006e57F7EFB7E block=173591
Nov 18 23:02:42 ip-172-31-42-69 main[64291]: 2021-11-18T23:02:42.421Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:02:42 ip-172-31-42-69 main[64291]: 2021-11-18T23:02:42.421Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:02:42 ip-172-31-42-69 main[64291]: 2021-11-18T23:02:42.422Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x033a47156DD82CDdb2fD426B80088a9ae6101ac5 block=173591
Nov 18 23:03:56 ip-172-31-42-69 main[64291]: 2021-11-18T23:03:56.482Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:03:56 ip-172-31-42-69 main[64291]: 2021-11-18T23:03:56.484Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:03:56 ip-172-31-42-69 main[64291]: 2021-11-18T23:03:56.484Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x38FCBEbc15A6D9091082C369d0734B2FBC7d455C block=173591
Nov 18 23:06:14 ip-172-31-42-69 main[64291]: 2021-11-18T23:06:14.504Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:06:14 ip-172-31-42-69 main[64291]: 2021-11-18T23:06:14.504Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:06:14 ip-172-31-42-69 main[64291]: 2021-11-18T23:06:14.505Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0xC3E0c7fC6543cdf478F15a842FE0c1a2c3b516F6 block=173591
Nov 18 23:08:18 ip-172-31-42-69 main[64291]: 2021-11-18T23:08:18.134Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmFpTiQcctV2KNpdKm9FehHKFLTUC13oaBGVzvZta7iFMc
Nov 18 23:08:23 ip-172-31-42-69 main[64291]: 2021-11-18T23:08:23.478Z [ERROR] polygon.txpool: Discarding invalid transaction: hash=0x1fa841e9c8887d830005f09119424529c87773bd9825386b9727be9041f6cde4 err="nonce too low"
Nov 18 23:08:23 ip-172-31-42-69 main[64291]: 2021-11-18T23:08:23.479Z [ERROR] polygon.txpool: failed to add broadcasted txn: err="nonce too low"
Nov 18 23:09:16 ip-172-31-42-69 main[64291]: 2021-11-18T23:09:16.231Z [INFO]  polygon.network: Peer disconnected: id=16Uiu2HAmFpTiQcctV2KNpdKm9FehHKFLTUC13oaBGVzvZta7iFMc
Nov 18 23:09:27 ip-172-31-42-69 main[64291]: 2021-11-18T23:09:27.849Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmFpTiQcctV2KNpdKm9FehHKFLTUC13oaBGVzvZta7iFMc
Nov 18 23:09:37 ip-172-31-42-69 main[64291]: 2021-11-18T23:09:37.827Z [ERROR] polygon.txpool: Discarding invalid transaction: hash=0x1fa841e9c8887d830005f09119424529c87773bd9825386b9727be9041f6cde4 err="nonce too low"
Nov 18 23:09:37 ip-172-31-42-69 main[64291]: 2021-11-18T23:09:37.827Z [ERROR] polygon.txpool: failed to add broadcasted txn: err="nonce too low"
Nov 18 23:10:40 ip-172-31-42-69 main[64291]: 2021-11-18T23:10:40.512Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:10:40 ip-172-31-42-69 main[64291]: 2021-11-18T23:10:40.513Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:10:40 ip-172-31-42-69 main[64291]: 2021-11-18T23:10:40.513Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x97b73C76aF21704Bd3EE2c1DC28F6AA015A203A6 block=173591
Nov 18 23:11:29 ip-172-31-42-69 main[64291]: 2021-11-18T23:11:29.895Z [INFO]  polygon.network: Peer disconnected: id=16Uiu2HAmFpTiQcctV2KNpdKm9FehHKFLTUC13oaBGVzvZta7iFMc
Nov 18 23:13:49 ip-172-31-42-69 main[64291]: 2021-11-18T23:13:49.817Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmFpTiQcctV2KNpdKm9FehHKFLTUC13oaBGVzvZta7iFMc
Nov 18 23:19:22 ip-172-31-42-69 main[64291]: 2021-11-18T23:19:22.559Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:19:22 ip-172-31-42-69 main[64291]: 2021-11-18T23:19:22.560Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:19:22 ip-172-31-42-69 main[64291]: 2021-11-18T23:19:22.560Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x25BAfc38a950837E0CCb49D10E0E98cce6CC8a44 block=173591
Nov 18 23:29:18 ip-172-31-42-69 main[64291]: 2021-11-18T23:29:18.362Z [INFO]  polygon.network: Peer disconnected: id=16Uiu2HAmTvfiVHL6v7V9JmLdkM4jHHTWC34mMHqYDdw4HhLoFTYD
Nov 18 23:29:26 ip-172-31-42-69 main[64291]: 2021-11-18T23:29:26.156Z [INFO]  polygon.network: Peer disconnected: id=16Uiu2HAm2Kdu9ecpvXViUv3n21AMdNtvWMe56RmaS4XUnKrQAZ1L
Nov 18 23:29:26 ip-172-31-42-69 main[64291]: 2021-11-18T23:29:26.329Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmTvfiVHL6v7V9JmLdkM4jHHTWC34mMHqYDdw4HhLoFTYD
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: panic: No dial addresses found
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: goroutine 40836 [running]:
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: github.com/0xPolygon/polygon-sdk/network.AddrInfoToString(0xc0065d4a68, 0xc005e67170, 0x27)
Nov 18 23:29:28 ip-172-31-42-69 main[64291]:         /home/ubuntu/sx-node/network/server.go:638 +0x331
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: github.com/0xPolygon/polygon-sdk/network.(*discovery).FindPeers(0xc0004e3140, 0x1259100, 0xc005b4f640, 0xc0028a4100, 0xc0004e3140, 0xd83501, 0xc005b4f640)
Nov 18 23:29:28 ip-172-31-42-69 main[64291]:         /home/ubuntu/sx-node/network/discovery.go:256 +0x25a
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: github.com/0xPolygon/polygon-sdk/network/proto._Discovery_FindPeers_Handler.func1(0x1259100, 0xc005b4f640, 0xe859a0, 0xc0028a4100, 0xc005b4f5e0, 0x18, 0xe2afe0, 0xc004d18101)
Nov 18 23:29:28 ip-172-31-42-69 main[64291]:         /home/ubuntu/sx-node/network/proto/discovery_grpc.pb.go:82 +0x89
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: github.com/0xPolygon/polygon-sdk/network/grpc.interceptor(0x1258f40, 0xc004d181b0, 0xe859a0, 0xc0028a4100, 0xc005b4f620, 0xc006286090, 0xc0065d4ba0, 0x52eca6, 0xea00c0, 0xc004d181b0)
Nov 18 23:29:28 ip-172-31-42-69 main[64291]:         /home/ubuntu/sx-node/network/grpc/grpc.go:53 +0x10f
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: github.com/0xPolygon/polygon-sdk/network/proto._Discovery_FindPeers_Handler(0xe9e3e0, 0xc0004e3140, 0x1258f40, 0xc004d181b0, 0xc006225920, 0x116ff88, 0x1258f40, 0xc004d181b0, 0xc002507890, 0x2)
Nov 18 23:29:28 ip-172-31-42-69 main[64291]:         /home/ubuntu/sx-node/network/proto/discovery_grpc.pb.go:84 +0x150
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: google.golang.org/grpc.(*Server).processUnaryRPC(0xc0004c88c0, 0x1261578, 0xc003e76a80, 0xc000f48100, 0xc00070db30, 0x1a48ef0, 0x0, 0x0, 0x0)
Nov 18 23:29:28 ip-172-31-42-69 main[64291]:         /home/ubuntu/sx-node/vendor/google.golang.org/grpc/server.go:1217 +0x52b
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: google.golang.org/grpc.(*Server).handleStream(0xc0004c88c0, 0x1261578, 0xc003e76a80, 0xc000f48100, 0x0)
Nov 18 23:29:28 ip-172-31-42-69 main[64291]:         /home/ubuntu/sx-node/vendor/google.golang.org/grpc/server.go:1540 +0xd0c
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: google.golang.org/grpc.(*Server).serveStreams.func1.2(0xc001290780, 0xc0004c88c0, 0x1261578, 0xc003e76a80, 0xc000f48100)
Nov 18 23:29:28 ip-172-31-42-69 main[64291]:         /home/ubuntu/sx-node/vendor/google.golang.org/grpc/server.go:878 +0xab
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: created by google.golang.org/grpc.(*Server).serveStreams.func1
Nov 18 23:29:28 ip-172-31-42-69 main[64291]:         /home/ubuntu/sx-node/vendor/google.golang.org/grpc/server.go:876 +0x1fd
Nov 18 23:29:28 ip-172-31-42-69 systemd[1]: sx-node.service: Main process exited, code=exited, status=2/INVALIDARGUMENT
Nov 18 23:29:28 ip-172-31-42-69 systemd[1]: sx-node.service: Failed with result 'exit-code'.
Nov 18 23:29:29 ip-172-31-42-69 systemd[1]: sx-node.service: Scheduled restart job, restart counter is at 2.
Nov 18 23:29:29 ip-172-31-42-69 systemd[1]: Stopped SX Node Service.
Nov 18 23:29:29 ip-172-31-42-69 systemd[1]: Started SX Node Service.
Nov 18 23:29:29 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:29.204Z [INFO]  polygon: Data dir: path=/home/ubuntu/sx-node/mynode
Nov 18 23:29:29 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:29.206Z [INFO]  polygon.network: LibP2P server running: addr=/ip4/34.207.249.106/tcp/10001/p2p/16Uiu2HAmBuezYDrZqvRxmHc7shTADWtuqSETNfPrT4Mg1NNFeseU
Nov 18 23:29:29 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:29.319Z [INFO]  polygon.consensus.ibft: validator key: addr=0xce6e21a1f84C68C9C2F45EA43B93F5525dfE2a95
Nov 18 23:29:29 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:29.320Z [INFO]  polygon.blockchain: Current header: hash=0x9fcee98faac2bfac2282429969b4ba190ed62424cbff6738ee5693639c66a4f1 number=173590
Nov 18 23:29:29 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:29.321Z [INFO]  polygon.blockchain: genesis: hash=0xf63461c6309c5832a99b2346895f8d78c8256331b85af3a43b4133532530be8d
Nov 18 23:29:29 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:29.322Z [INFO]  polygon: GRPC server running: addr=0.0.0.0:10000
Nov 18 23:29:29 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:29.323Z [INFO]  polygon.jsonrpc: http server started: addr=0.0.0.0:10002
Nov 18 23:29:29 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:29.323Z [INFO]  polygon.consensus.ibft: snapshot was not found, restore snapshot at beginning of current epoch: current epoch=1
Nov 18 23:29:29 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:29.323Z [INFO]  polygon.consensus.ibft: syncing past snapshots: from=100000 to=173590

Node 2:

Nov 18 23:00:16 ip-172-31-42-69 main[64291]: 2021-11-18T23:00:16.328Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:00:16 ip-172-31-42-69 main[64291]: 2021-11-18T23:00:16.329Z [INFO]  polygon.consensus.ibft.acceptState: we are the proposer: block=173590
Nov 18 23:00:16 ip-172-31-42-69 main[64291]: 2021-11-18T23:00:16.329Z [INFO]  polygon.consensus.ibft: picked out txns from pool: num=1 remaining=0
Nov 18 23:00:16 ip-172-31-42-69 main[64291]: 2021-11-18T23:00:16.330Z [INFO]  polygon.consensus.ibft: build block: number=173590 txns=1
Nov 18 23:00:18 ip-172-31-42-69 main[64291]: 2021-11-18T23:00:18.071Z [INFO]  polygon.blockchain: write block: num=173590 parent=0x93490231ed969471e2d3686fa2f3e24e36925c2857b3b17df2748d380b18e6e2
Nov 18 23:00:18 ip-172-31-42-69 main[64291]: 2021-11-18T23:00:18.086Z [INFO]  polygon.blockchain: new block: number=173590 hash=0x9fcee98faac2bfac2282429969b4ba190ed62424cbff6738ee5693639c66a4f1 txns=1 generation_time_in_sec=2
Nov 18 23:00:18 ip-172-31-42-69 main[64291]: 2021-11-18T23:00:18.086Z [INFO]  polygon.blockchain: new head: hash=0x9fcee98faac2bfac2282429969b4ba190ed62424cbff6738ee5693639c66a4f1 number=173590
Nov 18 23:00:18 ip-172-31-42-69 main[64291]: 2021-11-18T23:00:18.086Z [INFO]  polygon.consensus.ibft: block committed: sequence=173590 hash=0x9fcee98faac2bfac2282429969b4ba190ed62424cbff6738ee5693639c66a4f1 validators=15 rounds=1 committed=9
Nov 18 23:01:18 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:18.248Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:01:18 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:18.248Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:01:18 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:18.249Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x1AC502B21b8b73d881dA7F5af6abDe15FC22EB33 block=173591
Nov 18 23:01:20 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:20.277Z [ERROR] polygon.network: failed to dial bootnode: err="rpc error: code = Unavailable desc = transport is closing"
Nov 18 23:01:20 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:20.278Z [INFO]  polygon.network: Peer disconnected: id=16Uiu2HAmFpTiQcctV2KNpdKm9FehHKFLTUC13oaBGVzvZta7iFMc
Nov 18 23:01:28 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:28.255Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:01:28 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:28.256Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:01:28 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:28.257Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x097F8AB58FaAa6f282C3a50cAb0c1F43b26AA9aF block=173591
Nov 18 23:01:40 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:40.259Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:01:40 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:40.259Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:01:40 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:40.260Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0xB73a1fBE13bAc3b92d6fc9c10a6068C8Edb3b19c block=173591
Nov 18 23:01:54 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:54.276Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:01:54 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:54.277Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:01:54 ip-172-31-42-69 main[64291]: 2021-11-18T23:01:54.278Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x369a595Acea231aEA9809ddab58117204838EA71 block=173591
Nov 18 23:02:12 ip-172-31-42-69 main[64291]: 2021-11-18T23:02:12.286Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:02:12 ip-172-31-42-69 main[64291]: 2021-11-18T23:02:12.287Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:02:12 ip-172-31-42-69 main[64291]: 2021-11-18T23:02:12.287Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x7C482A9234255433A96c1431ef92A8DaC5ebF488 block=173591
Nov 18 23:02:38 ip-172-31-42-69 main[64291]: 2021-11-18T23:02:38.304Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:02:38 ip-172-31-42-69 main[64291]: 2021-11-18T23:02:38.305Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:02:38 ip-172-31-42-69 main[64291]: 2021-11-18T23:02:38.305Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x10Bb1c04c6B8906BBDc5Bae8272006e57F7EFB7E block=173591
Nov 18 23:02:42 ip-172-31-42-69 main[64291]: 2021-11-18T23:02:42.421Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:02:42 ip-172-31-42-69 main[64291]: 2021-11-18T23:02:42.421Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:02:42 ip-172-31-42-69 main[64291]: 2021-11-18T23:02:42.422Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x033a47156DD82CDdb2fD426B80088a9ae6101ac5 block=173591
Nov 18 23:03:56 ip-172-31-42-69 main[64291]: 2021-11-18T23:03:56.482Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:03:56 ip-172-31-42-69 main[64291]: 2021-11-18T23:03:56.484Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:03:56 ip-172-31-42-69 main[64291]: 2021-11-18T23:03:56.484Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x38FCBEbc15A6D9091082C369d0734B2FBC7d455C block=173591
Nov 18 23:06:14 ip-172-31-42-69 main[64291]: 2021-11-18T23:06:14.504Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:06:14 ip-172-31-42-69 main[64291]: 2021-11-18T23:06:14.504Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:06:14 ip-172-31-42-69 main[64291]: 2021-11-18T23:06:14.505Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0xC3E0c7fC6543cdf478F15a842FE0c1a2c3b516F6 block=173591
Nov 18 23:08:18 ip-172-31-42-69 main[64291]: 2021-11-18T23:08:18.134Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmFpTiQcctV2KNpdKm9FehHKFLTUC13oaBGVzvZta7iFMc
Nov 18 23:08:23 ip-172-31-42-69 main[64291]: 2021-11-18T23:08:23.478Z [ERROR] polygon.txpool: Discarding invalid transaction: hash=0x1fa841e9c8887d830005f09119424529c87773bd9825386b9727be9041f6cde4 err="nonce too low"
Nov 18 23:08:23 ip-172-31-42-69 main[64291]: 2021-11-18T23:08:23.479Z [ERROR] polygon.txpool: failed to add broadcasted txn: err="nonce too low"
Nov 18 23:09:16 ip-172-31-42-69 main[64291]: 2021-11-18T23:09:16.231Z [INFO]  polygon.network: Peer disconnected: id=16Uiu2HAmFpTiQcctV2KNpdKm9FehHKFLTUC13oaBGVzvZta7iFMc
Nov 18 23:09:27 ip-172-31-42-69 main[64291]: 2021-11-18T23:09:27.849Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmFpTiQcctV2KNpdKm9FehHKFLTUC13oaBGVzvZta7iFMc
Nov 18 23:09:37 ip-172-31-42-69 main[64291]: 2021-11-18T23:09:37.827Z [ERROR] polygon.txpool: Discarding invalid transaction: hash=0x1fa841e9c8887d830005f09119424529c87773bd9825386b9727be9041f6cde4 err="nonce too low"
Nov 18 23:09:37 ip-172-31-42-69 main[64291]: 2021-11-18T23:09:37.827Z [ERROR] polygon.txpool: failed to add broadcasted txn: err="nonce too low"
Nov 18 23:10:40 ip-172-31-42-69 main[64291]: 2021-11-18T23:10:40.512Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:10:40 ip-172-31-42-69 main[64291]: 2021-11-18T23:10:40.513Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:10:40 ip-172-31-42-69 main[64291]: 2021-11-18T23:10:40.513Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x97b73C76aF21704Bd3EE2c1DC28F6AA015A203A6 block=173591
Nov 18 23:11:29 ip-172-31-42-69 main[64291]: 2021-11-18T23:11:29.895Z [INFO]  polygon.network: Peer disconnected: id=16Uiu2HAmFpTiQcctV2KNpdKm9FehHKFLTUC13oaBGVzvZta7iFMc
Nov 18 23:13:49 ip-172-31-42-69 main[64291]: 2021-11-18T23:13:49.817Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmFpTiQcctV2KNpdKm9FehHKFLTUC13oaBGVzvZta7iFMc
Nov 18 23:19:22 ip-172-31-42-69 main[64291]: 2021-11-18T23:19:22.559Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:19:22 ip-172-31-42-69 main[64291]: 2021-11-18T23:19:22.560Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:19:22 ip-172-31-42-69 main[64291]: 2021-11-18T23:19:22.560Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x25BAfc38a950837E0CCb49D10E0E98cce6CC8a44 block=173591
Nov 18 23:29:18 ip-172-31-42-69 main[64291]: 2021-11-18T23:29:18.362Z [INFO]  polygon.network: Peer disconnected: id=16Uiu2HAmTvfiVHL6v7V9JmLdkM4jHHTWC34mMHqYDdw4HhLoFTYD
Nov 18 23:29:26 ip-172-31-42-69 main[64291]: 2021-11-18T23:29:26.156Z [INFO]  polygon.network: Peer disconnected: id=16Uiu2HAm2Kdu9ecpvXViUv3n21AMdNtvWMe56RmaS4XUnKrQAZ1L
Nov 18 23:29:26 ip-172-31-42-69 main[64291]: 2021-11-18T23:29:26.329Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmTvfiVHL6v7V9JmLdkM4jHHTWC34mMHqYDdw4HhLoFTYD
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: panic: No dial addresses found
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: goroutine 40836 [running]:
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: github.com/0xPolygon/polygon-sdk/network.AddrInfoToString(0xc0065d4a68, 0xc005e67170, 0x27)
Nov 18 23:29:28 ip-172-31-42-69 main[64291]:         /home/ubuntu/sx-node/network/server.go:638 +0x331
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: github.com/0xPolygon/polygon-sdk/network.(*discovery).FindPeers(0xc0004e3140, 0x1259100, 0xc005b4f640, 0xc0028a4100, 0xc0004e3140, 0xd83501, 0xc005b4f640)
Nov 18 23:29:28 ip-172-31-42-69 main[64291]:         /home/ubuntu/sx-node/network/discovery.go:256 +0x25a
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: github.com/0xPolygon/polygon-sdk/network/proto._Discovery_FindPeers_Handler.func1(0x1259100, 0xc005b4f640, 0xe859a0, 0xc0028a4100, 0xc005b4f5e0, 0x18, 0xe2afe0, 0xc004d18101)
Nov 18 23:29:28 ip-172-31-42-69 main[64291]:         /home/ubuntu/sx-node/network/proto/discovery_grpc.pb.go:82 +0x89
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: github.com/0xPolygon/polygon-sdk/network/grpc.interceptor(0x1258f40, 0xc004d181b0, 0xe859a0, 0xc0028a4100, 0xc005b4f620, 0xc006286090, 0xc0065d4ba0, 0x52eca6, 0xea00c0, 0xc004d181b0)
Nov 18 23:29:28 ip-172-31-42-69 main[64291]:         /home/ubuntu/sx-node/network/grpc/grpc.go:53 +0x10f
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: github.com/0xPolygon/polygon-sdk/network/proto._Discovery_FindPeers_Handler(0xe9e3e0, 0xc0004e3140, 0x1258f40, 0xc004d181b0, 0xc006225920, 0x116ff88, 0x1258f40, 0xc004d181b0, 0xc002507890, 0x2)
Nov 18 23:29:28 ip-172-31-42-69 main[64291]:         /home/ubuntu/sx-node/network/proto/discovery_grpc.pb.go:84 +0x150
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: google.golang.org/grpc.(*Server).processUnaryRPC(0xc0004c88c0, 0x1261578, 0xc003e76a80, 0xc000f48100, 0xc00070db30, 0x1a48ef0, 0x0, 0x0, 0x0)
Nov 18 23:29:28 ip-172-31-42-69 main[64291]:         /home/ubuntu/sx-node/vendor/google.golang.org/grpc/server.go:1217 +0x52b
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: google.golang.org/grpc.(*Server).handleStream(0xc0004c88c0, 0x1261578, 0xc003e76a80, 0xc000f48100, 0x0)
Nov 18 23:29:28 ip-172-31-42-69 main[64291]:         /home/ubuntu/sx-node/vendor/google.golang.org/grpc/server.go:1540 +0xd0c
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: google.golang.org/grpc.(*Server).serveStreams.func1.2(0xc001290780, 0xc0004c88c0, 0x1261578, 0xc003e76a80, 0xc000f48100)
Nov 18 23:29:28 ip-172-31-42-69 main[64291]:         /home/ubuntu/sx-node/vendor/google.golang.org/grpc/server.go:878 +0xab
Nov 18 23:29:28 ip-172-31-42-69 main[64291]: created by google.golang.org/grpc.(*Server).serveStreams.func1
Nov 18 23:29:28 ip-172-31-42-69 main[64291]:         /home/ubuntu/sx-node/vendor/google.golang.org/grpc/server.go:876 +0x1fd
Nov 18 23:29:28 ip-172-31-42-69 systemd[1]: sx-node.service: Main process exited, code=exited, status=2/INVALIDARGUMENT
Nov 18 23:29:28 ip-172-31-42-69 systemd[1]: sx-node.service: Failed with result 'exit-code'.
Nov 18 23:29:29 ip-172-31-42-69 systemd[1]: sx-node.service: Scheduled restart job, restart counter is at 2.
Nov 18 23:29:29 ip-172-31-42-69 systemd[1]: Stopped SX Node Service.
Nov 18 23:29:29 ip-172-31-42-69 systemd[1]: Started SX Node Service.
Nov 18 23:29:29 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:29.204Z [INFO]  polygon: Data dir: path=/home/ubuntu/sx-node/mynode
Nov 18 23:29:29 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:29.206Z [INFO]  polygon.network: LibP2P server running: addr=/ip4/34.207.249.106/tcp/10001/p2p/16Uiu2HAmBuezYDrZqvRxmHc7shTADWtuqSETNfPrT4Mg1NNFeseU
Nov 18 23:29:29 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:29.319Z [INFO]  polygon.consensus.ibft: validator key: addr=0xce6e21a1f84C68C9C2F45EA43B93F5525dfE2a95
Nov 18 23:29:29 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:29.320Z [INFO]  polygon.blockchain: Current header: hash=0x9fcee98faac2bfac2282429969b4ba190ed62424cbff6738ee5693639c66a4f1 number=173590
Nov 18 23:29:29 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:29.321Z [INFO]  polygon.blockchain: genesis: hash=0xf63461c6309c5832a99b2346895f8d78c8256331b85af3a43b4133532530be8d
Nov 18 23:29:29 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:29.322Z [INFO]  polygon: GRPC server running: addr=0.0.0.0:10000
Nov 18 23:29:29 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:29.323Z [INFO]  polygon.jsonrpc: http server started: addr=0.0.0.0:10002
Nov 18 23:29:29 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:29.323Z [INFO]  polygon.consensus.ibft: snapshot was not found, restore snapshot at beginning of current epoch: current epoch=1
Nov 18 23:29:29 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:29.323Z [INFO]  polygon.consensus.ibft: syncing past snapshots: from=100000 to=173590
Nov 18 23:29:34 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:34.222Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmP2bpgr3sLUUzt61bEzAL7ptdNXnvsfnwcxyrfCMFjxDf
Nov 18 23:29:34 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:34.228Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmERLox5fG95J9SRrrv8YQ1oEMF5XxU5L5Ew1VyXa3qrHF
Nov 18 23:29:34 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:34.237Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmFpTiQcctV2KNpdKm9FehHKFLTUC13oaBGVzvZta7iFMc
Nov 18 23:29:34 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:34.461Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmTvfiVHL6v7V9JmLdkM4jHHTWC34mMHqYDdw4HhLoFTYD
Nov 18 23:29:35 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:35.962Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAkztynubfLkDDMggZxJNbZTU65M7x2vFNwyYzQm9Dz5Nuv
Nov 18 23:29:36 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:36.080Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAkxUUzBnXb1iwjktg1K2t1Ai2f3wDEUBW9NsMHZSBvcruV
Nov 18 23:29:37 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:37.476Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAm2Kdu9ecpvXViUv3n21AMdNtvWMe56RmaS4XUnKrQAZ1L
Nov 18 23:29:37 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:37.507Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmGufbQZfBgkk6jvF7axaXKE7kbXq5CSfEokchmv2D3uiK
Nov 18 23:29:38 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:38.447Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmC2AvVqyvjMr8BMPth9Lnf1fkFAc5bMGH2Y3E5NXRk3gR
Nov 18 23:29:39 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:39.224Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmSWw35R2y5FJonwUMaoRmKt1WhCzgjCAGD1fsGtLzeBwf
Nov 18 23:29:39 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:39.234Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAm6MdtxtjRUG7PnG7h1RjTRwnAniRmBnBy6u5athYpfSSU
Nov 18 23:29:39 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:39.238Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmD2i4cysbCm3Kd6AdSjydMfV7idbB1fhjcxUMJkcDmRoP
Nov 18 23:29:39 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:39.246Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmSYhVdFw1ShS372r3yDi5ecVDesNW14VwNce6KavMoDRM
Nov 18 23:29:40 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:40.461Z [INFO]  polygon.network: Peer disconnected: id=16Uiu2HAmERLox5fG95J9SRrrv8YQ1oEMF5XxU5L5Ew1VyXa3qrHF
Nov 18 23:29:40 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:40.850Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmHPKMSKgbaLkRTgz9D6SstMoaiEwWUtCNn3UYD8HR6JJj
Nov 18 23:29:42 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:42.267Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmDyESKCkJ4kMF7tJYKNaQkz5xWAVnP9L1o3JkA3soJqyB
Nov 18 23:29:44 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:44.484Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmVNa5jRxiLkDtVRirUTHLZ2CYCbyR1VeFH5eYVdyY4wUF
Nov 18 23:29:54 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:54.592Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:29:54 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:54.592Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:29:54 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:54.592Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x1AC502B21b8b73d881dA7F5af6abDe15FC22EB33 block=173591
Nov 18 23:29:59 ip-172-31-42-69 main[64551]: 2021-11-18T23:29:59.237Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAmERLox5fG95J9SRrrv8YQ1oEMF5XxU5L5Ew1VyXa3qrHF
Nov 18 23:30:30 ip-172-31-42-69 main[64551]: 2021-11-18T23:30:30.990Z [INFO]  polygon.network: Peer disconnected: id=16Uiu2HAkxUUzBnXb1iwjktg1K2t1Ai2f3wDEUBW9NsMHZSBvcruV
Nov 18 23:30:42 ip-172-31-42-69 main[64551]: 2021-11-18T23:30:42.152Z [INFO]  polygon.network: Peer connected: id=16Uiu2HAkxUUzBnXb1iwjktg1K2t1Ai2f3wDEUBW9NsMHZSBvcruV
Nov 18 23:36:36 ip-172-31-42-69 main[64551]: 2021-11-18T23:36:36.596Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173591
Nov 18 23:36:36 ip-172-31-42-69 main[64551]: 2021-11-18T23:36:36.598Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:36:36 ip-172-31-42-69 main[64551]: 2021-11-18T23:36:36.598Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x9a5566c24a96Dc08e0A2404F23e93350a85f686e block=173591
Nov 18 23:36:36 ip-172-31-42-69 main[64551]: 2021-11-18T23:36:36.624Z [INFO]  polygon.blockchain: write block: num=173591 parent=0x9fcee98faac2bfac2282429969b4ba190ed62424cbff6738ee5693639c66a4f1
Nov 18 23:36:36 ip-172-31-42-69 main[64551]: 2021-11-18T23:36:36.629Z [INFO]  polygon.blockchain: new block: number=173591 hash=0xa8eaf9be701a2d9b8df4f6d60f25c3f77bf650d2c6f184aac62b8e48a8090fe6 txns=0 generation_time_in_sec=2178
Nov 18 23:36:36 ip-172-31-42-69 main[64551]: 2021-11-18T23:36:36.629Z [INFO]  polygon.blockchain: new head: hash=0xa8eaf9be701a2d9b8df4f6d60f25c3f77bf650d2c6f184aac62b8e48a8090fe6 number=173591
Nov 18 23:36:36 ip-172-31-42-69 main[64551]: 2021-11-18T23:36:36.630Z [INFO]  polygon.consensus.ibft: block committed: sequence=173591 hash=0xa8eaf9be701a2d9b8df4f6d60f25c3f77bf650d2c6f184aac62b8e48a8090fe6 validators=15 rounds=12 committed=9
Nov 18 23:37:15 ip-172-31-42-69 main[64551]: 2021-11-18T23:37:15.537Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173592
Nov 18 23:37:15 ip-172-31-42-69 main[64551]: 2021-11-18T23:37:15.538Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:37:15 ip-172-31-42-69 main[64551]: 2021-11-18T23:37:15.538Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x64B1845355e8D85D62d7ea01CAec8Df7ecB09e84 block=173592
Nov 18 23:37:25 ip-172-31-42-69 main[64551]: 2021-11-18T23:37:25.719Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173592
Nov 18 23:37:25 ip-172-31-42-69 main[64551]: 2021-11-18T23:37:25.719Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:37:25 ip-172-31-42-69 main[64551]: 2021-11-18T23:37:25.720Z [INFO]  polygon.consensus.ibft: proposer calculated: proposer=0x27F6Ae1f03986A374Cca5A4CF4f9d43324B9F09E block=173592
Nov 18 23:37:37 ip-172-31-42-69 main[64551]: 2021-11-18T23:37:37.733Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173592
Nov 18 23:37:37 ip-172-31-42-69 main[64551]: 2021-11-18T23:37:37.733Z [INFO]  polygon.consensus.ibft: current snapshot: validators=15 votes=0
Nov 18 23:37:37 ip-172-31-42-69 main[64551]: 2021-11-18T23:37:37.734Z [INFO]  polygon.consensus.ibft.acceptState: we are the proposer: block=173592
Nov 18 23:37:51 ip-172-31-42-69 main[64551]: 2021-11-18T23:37:51.860Z [INFO]  polygon.consensus.ibft.acceptState: Accept state: sequence=173592

Proposed solution

If you have an idea of how to fix this issue, please write it down here, so we can begin discussing it
@zivkovicmilos
Copy link
Contributor

zivkovicmilos commented Nov 23, 2021 •
edited
Loading

Hey @mrwillis,

Thank you for reaching out.

Do you have any idea why node 16Uiu2HAmERLox5fG95J9SRrrv8YQ1oEMF5XxU5L5Ew1VyXa3qrHF disconnects?
Is the node itself failing?

I notice from the logs that other nodes are also connecting then disconnecting.

Additionally, I'm curious about the up status of the bootnodes you're using.

@zivkovicmilos zivkovicmilos self-assigned this Nov 23, 2021
@zivkovicmilos
Copy link
Contributor

One more thing I'm curious about:

You've put down that you're running on commit 2bebf50

Is there any reason why you're running on this commit? It's part of a PR that at the time wasn't ready for review and was still a WIP.

Are you experiencing this issue with the latest pulls from the develop branch?

Keep in mind we've changed the ibft init command to secrets init with the latest PR that was merged into develop, so any scripts that you have automating this process should be changed as well to reflect it. (#209)

@zivkovicmilos zivkovicmilos added the info needed More information needed label Nov 23, 2021
@zivkovicmilos zivkovicmilos mentioned this issue Nov 24, 2021
Closed
@mrwillis
Copy link
Contributor Author

Hey @zivkovicmilos this was a mistake running on an old version. We have a fork we didn't pull from upstream. We're going to add better logging. Have not been able to reproduce this yet.

@mrwillis mrwillis mentioned this issue Nov 25, 2021
Closed
@lazartravica
Copy link
Contributor

We can reopen this issue if it pops up on the develop branch. Thank you guys!

igorcrevar pushed a commit that referenced this issue Jun 12, 2023
@ferranbt
Bug decode abi bytes (#235)
6a4d025 
* Add test

* Fix abi decode dynamic length items

* Add Decode panic test
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@zivkovicmilos zivkovicmilos

Labels
info needed More information needed
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@mrwillis @lazartravica @zivkovicmilos