Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WaitDone on Update does not wait till vpp interfaces are up #1751

Open
edwarnicke opened this issue Oct 20, 2020 · 12 comments
Open

WaitDone on Update does not wait till vpp interfaces are up #1751

edwarnicke opened this issue Oct 20, 2020 · 12 comments

Comments

@edwarnicke
Copy link
Contributor

No description provided.

@edwarnicke edwarnicke changed the title Linux Kernel Interface IP not configured on return with WaitDone==true WaitDone on Update does not wait till Linux Interfaces are up Oct 20, 2020
@edwarnicke
Copy link
Contributor Author

Logs:

Oct 20 02:37:38.345�[36m [INFO] �[0mSENDING UPDATE COMMIT: 
{
  "update": {
    "vpp_config": {
      "interfaces": [
        {
          "name": "server-e0e98333-e169-4692-a673-72f15126f7e3",
          "type": "AF_PACKET",
          "enabled": true,
          "afpacket": {
            "hostIfName": "server-e0e98333"
          }
        },
        {
          "name": "client-e0e98333-e169-4692-a673-72f15126f7e3",
          "type": "AF_PACKET",
          "enabled": true,
          "afpacket": {
            "hostIfName": "client-e0e98333"
          }
        }
      ],
      "xconnect_pairs": [
        {
          "receive_interface": "server-e0e98333-e169-4692-a673-72f15126f7e3",
          "transmit_interface": "client-e0e98333-e169-4692-a673-72f15126f7e3"
        },
        {
          "receive_interface": "client-e0e98333-e169-4692-a673-72f15126f7e3",
          "transmit_interface": "server-e0e98333-e169-4692-a673-72f15126f7e3"
        }
      ]
    },
    "linux_config": {
      "interfaces": [
        {
          "name": "server-e0e98333-e169-4692-a673-72f15126f7e3-veth",
          "type": "VETH",
          "hostIfName": "server-e0e98333",
          "enabled": true,
          "veth": {
            "peerIfName": "server-e0e98333-e169-4692-a673-72f15126f7e3",
            "rxChecksumOffloading": "CHKSM_OFFLOAD_DISABLED",
            "txChecksumOffloading": "CHKSM_OFFLOAD_DISABLED"
          }
        },
        {
          "name": "server-e0e98333-e169-4692-a673-72f15126f7e3",
          "type": "VETH",
          "namespace": {
            "type": "FD",
            "reference": "/proc/3635/fd/18"
          },
          "hostIfName": "k2kns-e0e98333-",
          "enabled": true,
          "ipAddresses": [
            "10.0.0.1/32"
          ],
          "veth": {
            "peerIfName": "server-e0e98333-e169-4692-a673-72f15126f7e3-veth",
            "rxChecksumOffloading": "CHKSM_OFFLOAD_DISABLED",
            "txChecksumOffloading": "CHKSM_OFFLOAD_DISABLED"
          }
        },
        {
          "name": "client-e0e98333-e169-4692-a673-72f15126f7e3-veth",
          "type": "VETH",
          "hostIfName": "client-e0e98333",
          "enabled": true,
          "veth": {
            "peerIfName": "client-e0e98333-e169-4692-a673-72f15126f7e3",
            "rxChecksumOffloading": "CHKSM_OFFLOAD_DISABLED",
            "txChecksumOffloading": "CHKSM_OFFLOAD_DISABLED"
          }
        },
        {
          "name": "client-e0e98333-e169-4692-a673-72f15126f7e3",
          "type": "VETH",
          "namespace": {
            "type": "FD",
            "reference": "/proc/3635/fd/22"
          },
          "hostIfName": "k2kns-e0e98333-",
          "enabled": true,
          "ipAddresses": [
            "10.0.0.0/32"
          ],
          "veth": {
            "peerIfName": "client-e0e98333-e169-4692-a673-72f15126f7e3-veth",
            "rxChecksumOffloading": "CHKSM_OFFLOAD_DISABLED",
            "txChecksumOffloading": "CHKSM_OFFLOAD_DISABLED"
          }
        }
      ],
      "routes": [
        {
          "outgoing_interface": "client-e0e98333-e169-4692-a673-72f15126f7e3",
          "scope": 3,
          "dst_network": "10.0.0.1/32"
        },
        {
          "outgoing_interface": "server-e0e98333-e169-4692-a673-72f15126f7e3",
          "scope": 3,
          "dst_network": "10.0.0.0/32"
        }
      ]
    },
    "netalloc_config": {}
  },
  "wait_done": true
}
time="2020-10-20 02:37:38.34629" level=debug msg="Push data with 10 KV pairs (source: grpc)" loc="orchestrator/dispatcher.go(110)" logger=dispatcher
time="2020-10-20 02:37:38.34635" level=debug msg=" - UPDATE: \"config/vpp/v2/interfaces/server-e0e98333-e169-4692-a673-72f15126f7e3\" " loc="orchestrator/dispatcher.go(137)" logger=dispatcher
time="2020-10-20 02:37:38.34639" level=debug msg=" - UPDATE: \"config/vpp/v2/interfaces/client-e0e98333-e169-4692-a673-72f15126f7e3\" " loc="orchestrator/dispatcher.go(137)" logger=dispatcher
time="2020-10-20 02:37:38.34642" level=debug msg=" - UPDATE: \"config/vpp/l2/v2/xconnect/server-e0e98333-e169-4692-a673-72f15126f7e3\" " loc="orchestrator/dispatcher.go(137)" logger=dispatcher
time="2020-10-20 02:37:38.34646" level=debug msg=" - UPDATE: \"config/vpp/l2/v2/xconnect/client-e0e98333-e169-4692-a673-72f15126f7e3\" " loc="orchestrator/dispatcher.go(137)" logger=dispatcher
time="2020-10-20 02:37:38.34651" level=debug msg=" - UPDATE: \"config/linux/interfaces/v2/interface/server-e0e98333-e169-4692-a673-72f15126f7e3-veth\" " loc="orchestrator/dispatcher.go(137)" logger=dispatcher
time="2020-10-20 02:37:38.34656" level=debug msg=" - UPDATE: \"config/linux/interfaces/v2/interface/server-e0e98333-e169-4692-a673-72f15126f7e3\" " loc="orchestrator/dispatcher.go(137)" logger=dispatcher
time="2020-10-20 02:37:38.34659" level=debug msg=" - UPDATE: \"config/linux/interfaces/v2/interface/client-e0e98333-e169-4692-a673-72f15126f7e3-veth\" " loc="orchestrator/dispatcher.go(137)" logger=dispatcher
time="2020-10-20 02:37:38.34664" level=debug msg=" - UPDATE: \"config/linux/interfaces/v2/interface/client-e0e98333-e169-4692-a673-72f15126f7e3\" " loc="orchestrator/dispatcher.go(137)" logger=dispatcher
time="2020-10-20 02:37:38.34667" level=debug msg=" - UPDATE: \"config/linux/l3/v2/route/10.0.0.1/32/client-e0e98333-e169-4692-a673-72f15126f7e3\" " loc="orchestrator/dispatcher.go(137)" logger=dispatcher
time="2020-10-20 02:37:38.34672" level=debug msg=" - UPDATE: \"config/linux/l3/v2/route/10.0.0.0/32/server-e0e98333-e169-4692-a673-72f15126f7e3\" " loc="orchestrator/dispatcher.go(137)" logger=dispatcher
+======================================================================================================================+
| #86 - NBTransaction                                                                                                  |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 86
      - type: NB Transaction
      - values:
          - key: config/linux/interfaces/v2/interface/client-e0e98333-e169-4692-a673-72f15126f7e3
            val: { name:"client-e0e98333-e169-4692-a673-72f15126f7e3"  type:VETH  namespace:{type:FD  reference:"/proc/3635/fd/22"}  host_if_name:"k2kns-e0e98333-"  enabled:true  ip_addresses:"10.0.0.0/32"  veth:{peer_if_name:"client-e0e98333-e169-4692-a673-72f15126f7e3-veth"  rx_checksum_offloading:CHKSM_OFFLOAD_DISABLED  tx_checksum_offloading:CHKSM_OFFLOAD_DISABLED} }
          - key: config/linux/interfaces/v2/interface/client-e0e98333-e169-4692-a673-72f15126f7e3-veth
            val: { name:"client-e0e98333-e169-4692-a673-72f15126f7e3-veth"  type:VETH  host_if_name:"client-e0e98333"  enabled:true  veth:{peer_if_name:"client-e0e98333-e169-4692-a673-72f15126f7e3"  rx_checksum_offloading:CHKSM_OFFLOAD_DISABLED  tx_checksum_offloading:CHKSM_OFFLOAD_DISABLED} }
          - key: config/linux/interfaces/v2/interface/server-e0e98333-e169-4692-a673-72f15126f7e3
            val: { name:"server-e0e98333-e169-4692-a673-72f15126f7e3"  type:VETH  namespace:{type:FD  reference:"/proc/3635/fd/18"}  host_if_name:"k2kns-e0e98333-"  enabled:true  ip_addresses:"10.0.0.1/32"  veth:{peer_if_name:"server-e0e98333-e169-4692-a673-72f15126f7e3-veth"  rx_checksum_offloading:CHKSM_OFFLOAD_DISABLED  tx_checksum_offloading:CHKSM_OFFLOAD_DISABLED} }
          - key: config/linux/interfaces/v2/interface/server-e0e98333-e169-4692-a673-72f15126f7e3-veth
            val: { name:"server-e0e98333-e169-4692-a673-72f15126f7e3-veth"  type:VETH  host_if_name:"server-e0e98333"  enabled:true  veth:{peer_if_name:"server-e0e98333-e169-4692-a673-72f15126f7e3"  rx_checksum_offloading:CHKSM_OFFLOAD_DISABLED  tx_checksum_offloading:CHKSM_OFFLOAD_DISABLED} }
          - key: config/linux/l3/v2/route/10.0.0.0/32/server-e0e98333-e169-4692-a673-72f15126f7e3
            val: { outgoing_interface:"server-e0e98333-e169-4692-a673-72f15126f7e3"  scope:LINK  dst_network:"10.0.0.0/32" }
          - key: config/linux/l3/v2/route/10.0.0.1/32/client-e0e98333-e169-4692-a673-72f15126f7e3
            val: { outgoing_interface:"client-e0e98333-e169-4692-a673-72f15126f7e3"  scope:LINK  dst_network:"10.0.0.1/32" }
          - key: config/vpp/l2/v2/xconnect/client-e0e98333-e169-4692-a673-72f15126f7e3
            val: { receive_interface:"client-e0e98333-e169-4692-a673-72f15126f7e3"  transmit_interface:"server-e0e98333-e169-4692-a673-72f15126f7e3" }
          - key: config/vpp/l2/v2/xconnect/server-e0e98333-e169-4692-a673-72f15126f7e3
            val: { receive_interface:"server-e0e98333-e169-4692-a673-72f15126f7e3"  transmit_interface:"client-e0e98333-e169-4692-a673-72f15126f7e3" }
          - key: config/vpp/v2/interfaces/client-e0e98333-e169-4692-a673-72f15126f7e3
            val: { name:"client-e0e98333-e169-4692-a673-72f15126f7e3"  type:AF_PACKET  enabled:true  afpacket:{host_if_name:"client-e0e98333"} }
          - key: config/vpp/v2/interfaces/server-e0e98333-e169-4692-a673-72f15126f7e3
            val: { name:"server-e0e98333-e169-4692-a673-72f15126f7e3"  type:AF_PACKET  enabled:true  afpacket:{host_if_name:"server-e0e98333"} }

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 02:37:38.347 +0000 UTC -> 2020-10-20 02:37:38.445 +0000 UTC, dur: 99ms):
      1. CREATE:
          - key: config/linux/interfaces/v2/interface/client-e0e98333-e169-4692-a673-72f15126f7e3-veth
          - value: { name:"client-e0e98333-e169-4692-a673-72f15126f7e3-veth"  type:VETH  host_if_name:"client-e0e98333"  enabled:true  veth:{peer_if_name:"client-e0e98333-e169-4692-a673-72f15126f7e3"  rx_checksum_offloading:CHKSM_OFFLOAD_DISABLED  tx_checksum_offloading:CHKSM_OFFLOAD_DISABLED} } 
      2. CREATE:
          - key: config/linux/interfaces/v2/interface/client-e0e98333-e169-4692-a673-72f15126f7e3
          - value: { name:"client-e0e98333-e169-4692-a673-72f15126f7e3"  type:VETH  namespace:{type:FD  reference:"/proc/3635/fd/22"}  host_if_name:"k2kns-e0e98333-"  enabled:true  ip_addresses:"10.0.0.0/32"  veth:{peer_if_name:"client-e0e98333-e169-4692-a673-72f15126f7e3-veth"  rx_checksum_offloading:CHKSM_OFFLOAD_DISABLED  tx_checksum_offloading:CHKSM_OFFLOAD_DISABLED} } 
      3. CREATE [DERIVED]:
          - key: linux/interface/client-e0e98333-e169-4692-a673-72f15126f7e3/address/static/10.0.0.0/32
          - value: <EMPTY> 
      4. CREATE [PROPERTY]:
          - key: linux/interface/state/client-e0e98333-e169-4692-a673-72f15126f7e3/UP
          - value: <EMPTY> 
      5. CREATE [PROPERTY]:
          - key: linux/interface/state/client-e0e98333-e169-4692-a673-72f15126f7e3-veth/UP
          - value: <EMPTY> 
      6. CREATE:
          - key: config/linux/interfaces/v2/interface/server-e0e98333-e169-4692-a673-72f15126f7e3-veth
          - value: { name:"server-e0e98333-e169-4692-a673-72f15126f7e3-veth"  type:VETH  host_if_name:"server-e0e98333"  enabled:true  veth:{peer_if_name:"server-e0e98333-e169-4692-a673-72f15126f7e3"  rx_checksum_offloading:CHKSM_OFFLOAD_DISABLED  tx_checksum_offloading:CHKSM_OFFLOAD_DISABLED} } 
      7. CREATE:
          - key: config/linux/interfaces/v2/interface/server-e0e98333-e169-4692-a673-72f15126f7e3
          - value: { name:"server-e0e98333-e169-4692-a673-72f15126f7e3"  type:VETH  namespace:{type:FD  reference:"/proc/3635/fd/18"}  host_if_name:"k2kns-e0e98333-"  enabled:true  ip_addresses:"10.0.0.1/32"  veth:{peer_if_name:"server-e0e98333-e169-4692-a673-72f15126f7e3-veth"  rx_checksum_offloading:CHKSM_OFFLOAD_DISABLED  tx_checksum_offloading:CHKSM_OFFLOAD_DISABLED} } 
      8. CREATE [DERIVED]:
          - key: linux/interface/server-e0e98333-e169-4692-a673-72f15126f7e3/address/static/10.0.0.1/32
          - value: <EMPTY> 
      9. CREATE [PROPERTY]:
          - key: linux/interface/state/server-e0e98333-e169-4692-a673-72f15126f7e3/UP
          - value: <EMPTY> 
      10. CREATE [PROPERTY]:
          - key: linux/interface/state/server-e0e98333-e169-4692-a673-72f15126f7e3-veth/UP
          - value: <EMPTY> 
      11. CREATE:
          - key: config/linux/l3/v2/route/10.0.0.0/32/server-e0e98333-e169-4692-a673-72f15126f7e3
          - value: { outgoing_interface:"server-e0e98333-e169-4692-a673-72f15126f7e3"  scope:LINK  dst_network:"10.0.0.0/32" } 
      12. CREATE [PROPERTY]:
          - key: linux/link-local-route/server-e0e98333-e169-4692-a673-72f15126f7e3/dest-address/10.0.0.0/32
          - value: <EMPTY> 
      13. CREATE:
          - key: config/linux/l3/v2/route/10.0.0.1/32/client-e0e98333-e169-4692-a673-72f15126f7e3
          - value: { outgoing_interface:"client-e0e98333-e169-4692-a673-72f15126f7e3"  scope:LINK  dst_network:"10.0.0.1/32" } 
      14. CREATE [PROPERTY]:
          - key: linux/link-local-route/client-e0e98333-e169-4692-a673-72f15126f7e3/dest-address/10.0.0.1/32
          - value: <EMPTY> 
      15. CREATE [NOOP IS-PENDING]:
          - key: config/vpp/l2/v2/xconnect/client-e0e98333-e169-4692-a673-72f15126f7e3
          - value: { receive_interface:"client-e0e98333-e169-4692-a673-72f15126f7e3"  transmit_interface:"server-e0e98333-e169-4692-a673-72f15126f7e3" } 
      16. CREATE [NOOP IS-PENDING]:
          - key: config/vpp/l2/v2/xconnect/server-e0e98333-e169-4692-a673-72f15126f7e3
          - value: { receive_interface:"server-e0e98333-e169-4692-a673-72f15126f7e3"  transmit_interface:"client-e0e98333-e169-4692-a673-72f15126f7e3" } 
      17. CREATE [NOOP IS-PENDING]:
          - key: config/vpp/v2/interfaces/client-e0e98333-e169-4692-a673-72f15126f7e3
          - value: { name:"client-e0e98333-e169-4692-a673-72f15126f7e3"  type:AF_PACKET  enabled:true  afpacket:{host_if_name:"client-e0e98333"} } 
      18. CREATE [NOOP IS-PENDING]:
          - key: config/vpp/v2/interfaces/server-e0e98333-e169-4692-a673-72f15126f7e3
          - value: { name:"server-e0e98333-e169-4692-a673-72f15126f7e3"  type:AF_PACKET  enabled:true  afpacket:{host_if_name:"server-e0e98333"} } 
x----------------------------------------------------------------------------------------------------------------------x
| #86 - NBTransaction                                                                                      took 98.6ms |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 02:37:38.44634" level=info msg="Transaction #86 successful! (took 99.5ms)" loc="orchestrator/dispatcher.go(178)" logger=dispatcher
time="2020-10-20 02:37:38.44643" level=info msg="waiting for 4 pending keys to be done" loc="configurator/configurator.go(137)" logger=configurator.configurator
+======================================================================================================================+
| #87 - SBNotification                                                                                                 |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 87
      - type: SB Notification
      - values:
          - key: linux/interface/host-name/client-e0e98333
            val: <EMPTY>

+======================================================================================================================+
| #34 - SBNotification                                                                                                 |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 34
      - type: SB Notification
      - values:
          - key: linux/interface/host-name/client-e0e98333
            val: <EMPTY>

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 02:37:38.863 +0000 UTC -> 2020-10-20 02:37:38.863 +0000 UTC, dur: 0s):
      1. CREATE [OBTAINED]:
          - key: linux/interface/host-name/client-e0e98333
          - value: <EMPTY> 
x----------------------------------------------------------------------------------------------------------------------x
| #34 - SBNotification                                                                                      took 200µs |
x----------------------------------------------------------------------------------------------------------------------x

+======================================================================================================================+
| #34 - SBNotification                                                                                                 |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 34
      - type: SB Notification
      - values:
          - key: linux/interface/host-name/client-e0e98333
            val: <EMPTY>

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 02:37:38.863 +0000 UTC -> 2020-10-20 02:37:38.863 +0000 UTC, dur: 0s):
      1. CREATE [OBTAINED]:
          - key: linux/interface/host-name/client-e0e98333
          - value: <EMPTY> 
x----------------------------------------------------------------------------------------------------------------------x
| #34 - SBNotification                                                                                      took 200µs |
x----------------------------------------------------------------------------------------------------------------------x
time="2020-10-20 02:37:38.86351" level=info msg="Transaction 34 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler

time="2020-10-20 02:37:38.86337" level=info msg="Transaction 34 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler
time="2020-10-20 02:37:38.90226" level=debug msg="publish add to ifplugin_ifstate{{client-e0e98333-e169-4692-a673-72f15126f7e3 false false vpp-interface-index} 0xc000a41540}" loc="mem/inmemory_name_mapping.go(277)" logger=vpp-ifplugin.if-descriptor
o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 02:37:38.863 +0000 UTC -> 2020-10-20 02:37:38.903 +0000 UTC, dur: 40ms):
      1. CREATE [OBTAINED]:
          - key: linux/interface/host-name/client-e0e98333
          - value: <EMPTY> 
      2. CREATE [WAS-PENDING]:
          - key: config/vpp/v2/interfaces/client-e0e98333-e169-4692-a673-72f15126f7e3
          - value: { name:"client-e0e98333-e169-4692-a673-72f15126f7e3"  type:AF_PACKET  enabled:true  afpacket:{host_if_name:"client-e0e98333"} } 
x----------------------------------------------------------------------------------------------------------------------x
| #87 - SBNotification                                                                                     took 39.5ms |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 02:37:38.90293" level=info msg="Transaction 87 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler
+======================================================================================================================+
| #88 - SBNotification                                                                                                 |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 88
      - type: SB Notification
      - values:
          - key: vpp/interface/client-e0e98333-e169-4692-a673-72f15126f7e3/link-state/DOWN
            val: <EMPTY>

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 02:37:38.903 +0000 UTC -> 2020-10-20 02:37:38.903 +0000 UTC, dur: 0s):
      1. CREATE [OBTAINED]:
          - key: vpp/interface/client-e0e98333-e169-4692-a673-72f15126f7e3/link-state/DOWN
          - value: <EMPTY> 
x----------------------------------------------------------------------------------------------------------------------x
| #88 - SBNotification                                                                                      took 100µs |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 02:37:38.90340" level=info msg="Transaction 88 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler
+======================================================================================================================+
| #89 - SBNotification                                                                                                 |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 89
      - type: SB Notification
      - values:
          - key: linux/interface/host-name/server-e0e98333
            val: <EMPTY>

+======================================================================================================================+
| #35 - SBNotification                                                                                                 |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 35
      - type: SB Notification
      - values:
          - key: linux/interface/host-name/server-e0e98333
            val: <EMPTY>

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 02:37:38.913 +0000 UTC -> 2020-10-20 02:37:38.913 +0000 UTC, dur: 0s):
      1. CREATE [OBTAINED]:
          - key: linux/interface/host-name/server-e0e98333
+======================================================================================================================+
| #35 - SBNotification                                                                                                 |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 35
      - type: SB Notification
      - values:
          - key: linux/interface/host-name/server-e0e98333
            val: <EMPTY>

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 02:37:38.913 +0000 UTC -> 2020-10-20 02:37:38.913 +0000 UTC, dur: 0s):
      1. CREATE [OBTAINED]:
          - key: linux/interface/host-name/server-e0e98333
          - value: <EMPTY> 
x----------------------------------------------------------------------------------------------------------------------x
| #35 - SBNotification                                                                                      took 100µs |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 02:37:38.91315" level=info msg="Transaction 35 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler
          - value: <EMPTY> 
x----------------------------------------------------------------------------------------------------------------------x
| #35 - SBNotification                                                                                      took 100µs |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 02:37:38.91317" level=info msg="Transaction 35 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler
time="2020-10-20 02:37:38.94312" level=debug msg="publish add to ifplugin_ifstate{{server-e0e98333-e169-4692-a673-72f15126f7e3 false false vpp-interface-index} 0xc000a41bd0}" loc="mem/inmemory_name_mapping.go(277)" logger=vpp-ifplugin.if-descriptor
o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 02:37:38.913 +0000 UTC -> 2020-10-20 02:37:38.945 +0000 UTC, dur: 32ms):
      1. CREATE [OBTAINED]:
          - key: linux/interface/host-name/server-e0e98333
          - value: <EMPTY> 
      2. CREATE [WAS-PENDING]:
          - key: config/vpp/v2/interfaces/server-e0e98333-e169-4692-a673-72f15126f7e3
          - value: { name:"server-e0e98333-e169-4692-a673-72f15126f7e3"  type:AF_PACKET  enabled:true  afpacket:{host_if_name:"server-e0e98333"} } 
      3. CREATE [WAS-PENDING]:
          - key: config/vpp/l2/v2/xconnect/client-e0e98333-e169-4692-a673-72f15126f7e3
          - value: { receive_interface:"client-e0e98333-e169-4692-a673-72f15126f7e3"  transmit_interface:"server-e0e98333-e169-4692-a673-72f15126f7e3" } 
      4. CREATE [WAS-PENDING]:
          - key: config/vpp/l2/v2/xconnect/server-e0e98333-e169-4692-a673-72f15126f7e3
          - value: { receive_interface:"server-e0e98333-e169-4692-a673-72f15126f7e3"  transmit_interface:"client-e0e98333-e169-4692-a673-72f15126f7e3" } 
x----------------------------------------------------------------------------------------------------------------------x
| #89 - SBNotification                                                                                     took 32.4ms |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 02:37:38.94549" level=info msg="Transaction 89 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler
time="2020-10-20 02:37:38.94556" level=info msg="finished waiting for pending keys to be done (took 499.107436ms)" loc="configurator/configurator.go(147)" logger=configurator.configurator
time="2020-10-20 02:37:38.94562" level=debug msg="config update finished with 11 results" loc="configurator/configurator.go(153)" logger=configurator.configurator
+======================================================================================================================+
| #90 - SBNotification                                                                                                 |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 90
      - type: SB Notification
      - values:
          - key: vpp/interface/server-e0e98333-e169-4692-a673-72f15126f7e3/link-state/DOWN
            val: <EMPTY>

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 02:37:38.946 +0000 UTC -> 2020-10-20 02:37:38.946 +0000 UTC, dur: 0s):
      1. CREATE [OBTAINED]:
          - key: vpp/interface/server-e0e98333-e169-4692-a673-72f15126f7e3/link-state/DOWN
          - value: <EMPTY> 
x----------------------------------------------------------------------------------------------------------------------x
| #90 - SBNotification                                                                                      took 100µs |
x----------------------------------------------------------------------------------------------------------------------x
Oct 20 02:37:38.945�[36m [INFO] �[0mUPDATE COMMIT TOOK 600.061266ms
Oct 20 02:37:38.945�[36m [INFO] [cmd:forwarder] �[0m==----------------------------------------> github.com/networkservicemesh/sdk/pkg/networkservice/common/mechanisms/sendfd/sendFDServer.Request() span:{}
Oct 20 02:37:38.945�[36m [INFO] [cmd:forwarder] �[0m>><<---------------------------------------- request={"connection":{"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"file:///proc/3635/fd/18","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}},"mechanism_preferences":[{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"file:///proc/3635/fd/18","name":""}}]} span={}

time="2020-10-20 02:37:38.94586" level=info msg="Transaction 90 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler
Oct 20 02:37:38.946�[36m [INFO] [cmd:forwarder] �[0m>><<---------------------------------------- response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.946�[36m [INFO] [cmd:forwarder] �[0m>><<-------------------------------------- response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.946�[37m [DEBU] [operation:github.com/networkservicemesh/sdk-vppagent/pkg/networkservice/metrics/metricsServer.Request] [span:{}] �[0mMetricsServer: Request Metrics
time="2020-10-20 02:37:38.94726" level=debug msg="streaming 4 interface stats" loc="telemetry/stats_poller.go(106)" logger=telemetry.stats-poller
time="2020-10-20 02:37:38.94742" level=debug msg="sending vpp stats: interface:{name:\"UNTAGGED-local0\"  rx:{}  tx:{}  rx_unicast:{}  rx_multicast:{}  rx_broadcast:{}  tx_unicast:{}  tx_multicast:{}  tx_broadcast:{}}" loc="telemetry/stats_poller.go(48)" logger=telemetry.stats-poller
time="2020-10-20 02:37:38.94760" level=debug msg="sending vpp stats: interface:{name:\"eth0\"  rx:{packets:5  bytes:294}  tx:{packets:1  bytes:42}  rx_unicast:{}  rx_multicast:{}  rx_broadcast:{}  tx_unicast:{}  tx_multicast:{}  tx_broadcast:{}  drops:5  ip4:1  ip6:1}" loc="telemetry/stats_poller.go(48)" logger=telemetry.stats-poller
time="2020-10-20 02:37:38.94773" level=debug msg="sending vpp stats: interface:{name:\"client-e0e98333-e169-4692-a673-72f15126f7e3\"  rx:{}  tx:{}  rx_unicast:{}  rx_multicast:{}  rx_broadcast:{}  tx_unicast:{}  tx_multicast:{}  tx_broadcast:{}}" loc="telemetry/stats_poller.go(48)" logger=telemetry.stats-poller
time="2020-10-20 02:37:38.94799" level=debug msg="sending vpp stats: interface:{name:\"server-e0e98333-e169-4692-a673-72f15126f7e3\"  rx:{}  tx:{}  rx_unicast:{}  rx_multicast:{}  rx_broadcast:{}  tx_unicast:{}  tx_multicast:{}  tx_broadcast:{}}" loc="telemetry/stats_poller.go(48)" logger=telemetry.stats-poller
Oct 20 02:37:38.948�[37m [DEBU] [operation:github.com/networkservicemesh/sdk-vppagent/pkg/networkservice/metrics/metricsServer.Request] [span:{}] �[0mMetricsServer: GetStats(): interface:{name:"UNTAGGED-local0"  rx:{}  tx:{}  rx_unicast:{}  rx_multicast:{}  rx_broadcast:{}  tx_unicast:{}  tx_multicast:{}  tx_broadcast:{}}
Oct 20 02:37:38.948�[37m [DEBU] [operation:github.com/networkservicemesh/sdk-vppagent/pkg/networkservice/metrics/metricsServer.Request] [span:{}] �[0mMetricsServer: GetStats(): interface:{name:"eth0"  rx:{packets:5  bytes:294}  tx:{packets:1  bytes:42}  rx_unicast:{}  rx_multicast:{}  rx_broadcast:{}  tx_unicast:{}  tx_multicast:{}  tx_broadcast:{}  drops:5  ip4:1  ip6:1}
Oct 20 02:37:38.948�[37m [DEBU] [operation:github.com/networkservicemesh/sdk-vppagent/pkg/networkservice/metrics/metricsServer.Request] [span:{}] �[0mMetricsServer: GetStats(): interface:{name:"client-e0e98333-e169-4692-a673-72f15126f7e3"  rx:{}  tx:{}  rx_unicast:{}  rx_multicast:{}  rx_broadcast:{}  tx_unicast:{}  tx_multicast:{}  tx_broadcast:{}}
Oct 20 02:37:38.948�[36m [INFO] [cmd:forwarder] �[0m>><<------------------------------------ response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.948�[36m [INFO] [cmd:forwarder] �[0m>><<---------------------------------- response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.948�[36m [INFO] [cmd:forwarder] �[0m>><<-------------------------------- response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.948�[36m [INFO] [cmd:forwarder] �[0m>><<------------------------------ response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.948�[36m [INFO] [cmd:forwarder] �[0m>><<---------------------------- response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.948�[36m [INFO] [cmd:forwarder] �[0m>><<-------------------------- response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.948�[36m [INFO] [cmd:forwarder] �[0m>><<------------------------ response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.948�[36m [INFO] [cmd:forwarder] �[0m>><<---------------------- response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.948�[36m [INFO] [cmd:forwarder] �[0m>><<-------------------- response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.948�[36m [INFO] [cmd:forwarder] �[0m>><<------------------ response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.948�[36m [INFO] [cmd:forwarder] �[0m>><<---------------- response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.948�[36m [INFO] [cmd:forwarder] �[0m>><<-------------- response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.948�[36m [INFO] [cmd:forwarder] �[0m>><<------------ response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.948�[36m [INFO] [cmd:forwarder] �[0m>><<---------- response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.948�[36m [INFO] [cmd:forwarder] �[0m>><<-------- response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.948�[36m [INFO] [cmd:forwarder] �[0m>><<------ response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.948�[36m [INFO] [cmd:forwarder] �[0m>><<---- response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.948�[36m [INFO] [cmd:forwarder] �[0m>><<-- response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.949�[36m [INFO] [cmd:/tmp/go-build668129005/b001/cmd-forwarder-vppagent.test] �[0m>><<---------------------- response={"id":"e0e98333-e169-4692-a673-72f15126f7e3","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.949�[36m [INFO] [cmd:/tmp/go-build668129005/b001/cmd-forwarder-vppagent.test] �[0m>><<-------------------- response={"id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.949�[36m [INFO] [cmd:/tmp/go-build668129005/b001/cmd-forwarder-vppagent.test] �[0m>><<------------------ response={"id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.949�[36m [INFO] [cmd:/tmp/go-build668129005/b001/cmd-forwarder-vppagent.test] �[0m>><<---------------- response={"id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533693","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.949�[36m [INFO] [cmd:/tmp/go-build668129005/b001/cmd-forwarder-vppagent.test] �[0m>><<-------------- response={"id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"file:///proc/thread-self/ns/net","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.949�[36m [INFO] [cmd:/tmp/go-build668129005/b001/cmd-forwarder-vppagent.test] �[0m>><<------------ response={"id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"file:///proc/thread-self/ns/net","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.949�[36m [INFO] [cmd:/tmp/go-build668129005/b001/cmd-forwarder-vppagent.test] �[0m>><<---------- response={"id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"file:///proc/thread-self/ns/net","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.949�[36m [INFO] [cmd:/tmp/go-build668129005/b001/cmd-forwarder-vppagent.test] �[0m>><<-------- response={"id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"file:///proc/thread-self/ns/net","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.950�[36m [INFO] [cmd:/tmp/go-build668129005/b001/cmd-forwarder-vppagent.test] �[0m>><<------ response={"id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"file:///proc/thread-self/ns/net","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.951�[36m [INFO] [cmd:/tmp/go-build668129005/b001/cmd-forwarder-vppagent.test] �[0m>><<---- response={"id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"file:///proc/thread-self/ns/net","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.951�[36m [INFO] [cmd:/tmp/go-build668129005/b001/cmd-forwarder-vppagent.test] �[0m>><<-- response={"id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"file:///proc/thread-self/ns/net","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"path_segments":[{"name":"testClient","id":"e56095c5-2b95-405b-80f3-5e6b2ce7ed74","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.o9_ceBJkt-bGFelHguzG1ev_Un92eqt7Cnc978ikQHOaPrH4E1mJa6EirCsdyF0slDQTwPC_VPkcmVsygrb1Fw","expires":{"seconds":1603165036}},{"name":"forwarder","id":"e0e98333-e169-4692-a673-72f15126f7e3","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9._H02wQT6DDZbGO7PLvhaoWbWkQ9lxzY49xT4YOn8khIW-Qzt_h4EtBJkNoBA4i9d6rSUUWCbqeZGZwFS8a64Vw","expires":{"seconds":1603165036},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"dbd747ff-e1bd-4915-973d-7e38dba48f39","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjUwMzYsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.nFbTyD-rpiaSrJn4JekEsqpTRmpZF_tpBUTZcfztFpVkhPGaVRPlIrMKiP15FDZ4Pb1rKrd7sDllX9n7850NXg","expires":{"seconds":1603165036}}]}} span={}
Oct 20 02:37:38.951�[36m [INFO] �[0mChecking we can ping both ways (time since start: 620.242903ms)
10.0.0.0 via 172.17.0.1 dev eth0 src 172.17.0.2 uid 0 
    cache 
time="2020-10-20 02:37:44.09878" level=debug msg="updating interface states for 2 interfaces" loc="ifplugin/interface_state.go(254)" logger=vpp-ifplugin.if-state
time="2020-10-20 02:37:44.10199" level=debug msg="Global interface state data added: internal_name:\"host-server-e0e98333\" index:3 status:\"UP\" mac_address:\"02:fe:87:06:2b:a8\" " loc="statuscheck/plugin_impl_statuscheck.go(248)" logger=status-check
time="2020-10-20 02:37:44.10212" level=debug msg="Global interface state data added: internal_name:\"host-client-e0e98333\" index:2 status:\"UP\" mac_address:\"02:fe:52:d3:d7:cd\" " loc="statuscheck/plugin_impl_statuscheck.go(248)" logger=status-check
+======================================================================================================================+
| #91 - SBNotification                                                                                                 |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 91
      - type: SB Notification
      - values:
          - key: vpp/interface/server-e0e98333-e169-4692-a673-72f15126f7e3/link-state/DOWN
            val: <NIL>
          - key: vpp/interface/server-e0e98333-e169-4692-a673-72f15126f7e3/link-state/UP
            val: <EMPTY>

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 02:37:44.102 +0000 UTC -> 2020-10-20 02:37:44.103 +0000 UTC, dur: 0s):
      1. DELETE [WAS-OBTAINED]:
          - key: vpp/interface/server-e0e98333-e169-4692-a673-72f15126f7e3/link-state/DOWN
          - value: <EMPTY> 
      2. CREATE [OBTAINED]:
          - key: vpp/interface/server-e0e98333-e169-4692-a673-72f15126f7e3/link-state/UP
          - value: <EMPTY> 
x----------------------------------------------------------------------------------------------------------------------x
| #91 - SBNotification                                                                                      took 300µs |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 02:37:44.10288" level=info msg="Transaction 91 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler
+======================================================================================================================+
| #92 - SBNotification                                                                                                 |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 92
      - type: SB Notification
      - values:
          - key: vpp/interface/client-e0e98333-e169-4692-a673-72f15126f7e3/link-state/DOWN
            val: <NIL>
          - key: vpp/interface/client-e0e98333-e169-4692-a673-72f15126f7e3/link-state/UP
            val: <EMPTY>

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 02:37:44.103 +0000 UTC -> 2020-10-20 02:37:44.103 +0000 UTC, dur: 0s):
      1. DELETE [WAS-OBTAINED]:
          - key: vpp/interface/client-e0e98333-e169-4692-a673-72f15126f7e3/link-state/DOWN
          - value: <EMPTY> 
      2. CREATE [OBTAINED]:
          - key: vpp/interface/client-e0e98333-e169-4692-a673-72f15126f7e3/link-state/UP
          - value: <EMPTY> 
x----------------------------------------------------------------------------------------------------------------------x
| #92 - SBNotification                                                                                      took 100µs |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 02:37:44.10323" level=info msg="Transaction 92 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler
PING 10.0.0.0 (10.0.0.0) 56(84) bytes of data.

--- 10.0.0.0 ping statistics ---
1 packets transmitted, 0 received, 100% packet loss, time 0ms

10.0.0.1 dev k2kns-e0e98333- src 10.0.0.0 uid 0 
    cache 
PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data.
64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=4.45 ms

--- 10.0.0.1 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 4.450/4.450/4.450/0.000 ms
Oct 20 02:37:48.967�[36m [INFO] �[0mChecking that the expected interfaces exist (time since start: 10.63634787s)

@edwarnicke
Copy link
Contributor Author

The timestamp on my return from Update (Oct 20 02:37:38.945) is before the timestamp on the interface coming up for SB Notification #91 (2020-10-20 02:37:44.102)

Oct 20 02:37:38.945�[36m [INFO] �[0mUPDATE COMMIT TOOK 600.061266ms
+======================================================================================================================+
| #91 - SBNotification                                                                                                 |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 91
      - type: SB Notification
      - values:
          - key: vpp/interface/server-e0e98333-e169-4692-a673-72f15126f7e3/link-state/DOWN
            val: <NIL>
          - key: vpp/interface/server-e0e98333-e169-4692-a673-72f15126f7e3/link-state/UP
            val: <EMPTY>

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 02:37:44.102 +0000 UTC -> 2020-10-20 02:37:44.103 +0000 UTC, dur: 0s):
      1. DELETE [WAS-OBTAINED]:
          - key: vpp/interface/server-e0e98333-e169-4692-a673-72f15126f7e3/link-state/DOWN
          - value: <EMPTY> 
      2. CREATE [OBTAINED]:
          - key: vpp/interface/server-e0e98333-e169-4692-a673-72f15126f7e3/link-state/UP
          - value: <EMPTY> 
x----------------------------------------------------------------------------------------------------------------------x
| #91 - SBNotification                                                                                      took 300µs |
x----------------------------------------------------------------------------------------------------------------------x

Similarly for SB #92

@edwarnicke edwarnicke changed the title WaitDone on Update does not wait till Linux Interfaces are up WaitDone on Update does not wait till vpp interfaces are up Oct 20, 2020
@edwarnicke
Copy link
Contributor Author

Here are a second set of logs showing a similar effect for memif interfaces being DOWN at the time of the WaitDone Update return:

Oct 20 03:01:38.283�[36m [INFO] �[0mSENDING UPDATE COMMIT: 
{
  "update": {
    "vpp_config": {
      "interfaces": [
        {
          "name": "server-beb60510-b8b0-41c0-960c-74d9100a1c8b",
          "type": "MEMIF",
          "enabled": true,
          "ipAddresses": [
            "10.0.0.0/32"
          ],
          "memif": {
            "master": true,
            "socketFilename": "/tmp/forwarder.test-100721224/beb60510-b8b0-41c0-960c-74d9100a1c8b.memif.socket"
          }
        }
      ],
      "routes": [
        {
          "dst_network": "10.0.0.1/32",
          "outgoing_interface": "server-beb60510-b8b0-41c0-960c-74d9100a1c8b"
        }
      ]
    },
    "linux_config": {},
    "netalloc_config": {}
  },
  "full_resync": true,
  "wait_done": true
}
time="2020-10-20 03:01:38.28790" level=debug msg="Push data with 2 KV pairs (source: grpc)" loc="orchestrator/dispatcher.go(110)" logger=dispatcher
time="2020-10-20 03:01:38.28797" level=debug msg=" - PUT: \"config/vpp/v2/interfaces/server-beb60510-b8b0-41c0-960c-74d9100a1c8b\" " loc="orchestrator/dispatcher.go(122)" logger=dispatcher
time="2020-10-20 03:01:38.28800" level=debug msg=" - PUT: \"config/vpp/v2/route/if/server-beb60510-b8b0-41c0-960c-74d9100a1c8b/vrf/0/dst/10.0.0.1/32\" " loc="orchestrator/dispatcher.go(122)" logger=dispatcher
time="2020-10-20 03:01:38.28805" level=debug msg="will resync 2 pairs" loc="orchestrator/dispatcher.go(126)" logger=dispatcher
time="2020-10-20 03:01:38.29042" level=debug msg="dhcp-proxy descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.29052" level=debug msg="linux-interface-watcher descriptor retrieved 2 items: \n -  1. [linux-interface-watcher]: \"linux/interface/host-name/lo\" (from-SB)\n   <EMPTY>\n -  2. [linux-interface-watcher]: \"linux/interface/host-name/eth0\" (from-SB)\n   <EMPTY>" loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.29092" level=debug msg="microservice descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.29102" level=debug msg="netalloc-ip-address descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.29197" level=debug msg="linux-interface descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.29209" level=debug msg="linux-arp descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.29212" level=debug msg="linux-ipt-rulechain-descriptor descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.29215" level=debug msg="linux-route descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.29227" level=debug msg="vpp-flowprobe-feature descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.29232" level=debug msg="vpp-flowprobe-params descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.29419" level=debug msg="Memif socket dump completed, found 1 entries: map[/run/vpp/memif.sock:0]" loc="vpp2005/memif_vppcalls.go(133)" logger=vpp-ifplugin
time="2020-10-20 03:01:38.30580" level=debug msg="Memif socket dump completed, found 1 entries: map[/run/vpp/memif.sock:0]" loc="vpp2005/memif_vppcalls.go(133)" logger=vpp-ifplugin
time="2020-10-20 03:01:38.31662" level=debug msg="vpp-interface descriptor retrieved 1 item: \n -  1. [vpp-interface]: \"config/vpp/v2/interfaces/UNTAGGED-local0\" (from-SB)\n   { name:\"UNTAGGED-local0\"  type:SOFTWARE_LOOPBACK  phys_address:\"00:00:00:00:00:00\" }\n   Metadata: &{SwIfIndex:0 Vrf:0 IPAddresses:[] TAPHostIfName: InternalName:local0 DevType:local}" loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.31712" level=debug msg="publish add to ifplugin_ifstate{{UNTAGGED-local0 false false vpp-interface-index} 0xc000a1e960}" loc="mem/inmemory_name_mapping.go(277)" logger=vpp-ifplugin.if-descriptor
time="2020-10-20 03:01:38.31883" level=debug msg="vpp-acl descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.32113" level=debug msg="vpp-abf descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.32331" level=debug msg="vpp-arp descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.32563" level=debug msg="vpp-bridge-domain descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.32677" level=debug msg="vpp-dhcp descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.32826" level=debug msg="vpp-interface-link-state descriptor retrieved 1 item: \n -  1. [vpp-interface-link-state]: \"vpp/interface/UNTAGGED-local0/link-state/DOWN\" (from-SB)\n   <EMPTY>" loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.32847" level=debug msg="GetIPScanNeighbor failed:ip neighbor config not implemented" loc="descriptor/ip_scan_neighbor.go(106)" logger=vpp-l3plugin.ip-scan-neigh-descriptor
time="2020-10-20 03:01:38.32852" level=debug msg="vpp-ip-scan-neighbor descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.32975" level=debug msg="vpp-ipfix descriptor retrieved 1 item: \n -  1. [vpp-ipfix]: \"config/vpp/ipfix/v2/ipfix\" (from-SB)\n   { collector:{address:\"0.0.0.0\"}  source_address:\"0.0.0.0\"  vrf_id:4294967295 }" loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.33104" level=debug msg="vpp-ipsec-sa descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.33215" level=debug msg="vpp-ipsec-sp descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.33323" level=debug msg="vpp-ipsec-spd descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.33487" level=debug msg="vpp-l2-fib descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.33600" level=debug msg="vpp-l3xc descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.33961" level=debug msg="vpp-nat44-dnat descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.34089" level=debug msg="vpp-nat44-global descriptor retrieved 1 item: \n -  1. [vpp-nat44-global]: \"config/vpp/nat/v2/nat44-global\" (from-SB)\n   {  }" loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.34190" level=debug msg="vpp-nat44-address-pool descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.34439" level=debug msg="vpp-nat44-interface descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.34662" level=debug msg="vpp-proxy-arp descriptor retrieved 1 item: \n -  1. [vpp-proxy-arp]: \"config/vpp/v2/proxyarp-global\" (unknown)\n   {  }" loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.34891" level=debug msg="vpp-punt-exception descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.35136" level=debug msg="vpp-punt-ipredirect descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.35255" level=debug msg="vpp-punt-to-host descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.35508" level=debug msg="vpp-span descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.35620" level=debug msg="vpp-stn-rules descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.35734" level=debug msg="vpp-teib descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.35849" level=debug msg="vpp-tun-protect descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.35984" level=debug msg="vpp-vrf-table descriptor retrieved 2 items: \n -  1. [vpp-vrf-table]: \"config/vpp/v2/vrf-table/id/0/protocol/IPV4\" (unknown)\n   { label:\"ipv4-VRF:0\" }\n   Metadata: &{Index:0 Protocol:IPV4}\n -  2. [vpp-vrf-table]: \"config/vpp/v2/vrf-table/id/0/protocol/IPV6\" (unknown)\n   { protocol:IPV6  label:\"ipv6-VRF:0\" }\n   Metadata: &{Index:0 Protocol:IPV6}" loc="kvscheduler/refresh.go(143)" logger=kvscheduler
vpp[3647]: vat-plug/load: vat_plugin_register: gtpu plugin not loaded...


Oct 20 03:01:38.170�[36m [INFO] [cmd:vpp] �[0mvpp[3647]: vat-plug/load: vat_plugin_register: gtpu plugin not loaded...
vpp[3647]: vat-plug/load: vat_plugin_register: oddbuf plugin not loaded...


Oct 20 03:01:38.170�[36m [INFO] [cmd:vpp] �[0mvpp[3647]: vat-plug/load: vat_plugin_register: oddbuf plugin not loaded...
vpp[3647]: vat-plug/load: vat_plugin_register: avf plugin not loaded...


Oct 20 03:01:38.170�[36m [INFO] [cmd:vpp] �[0mvpp[3647]: vat-plug/load: vat_plugin_register: avf plugin not loaded...
vpp[3647]: vat-plug/load: vat_plugin_register: pppoe plugin not loaded...


vpp[3647]: vat-plug/load: vat_plugin_register: dhcp plugin not loaded...


vpp[3647]: vat-plug/load: vat_plugin_register: rdma plugin not loaded...


Oct 20 03:01:38.170�[36m [INFO] [cmd:vpp] �[0mvpp[3647]: vat-plug/load: vat_plugin_register: pppoe plugin not loaded...
Oct 20 03:01:38.170�[36m [INFO] [cmd:vpp] �[0mvpp[3647]: vat-plug/load: vat_plugin_register: dhcp plugin not loaded...
Oct 20 03:01:38.170�[36m [INFO] [cmd:vpp] �[0mvpp[3647]: vat-plug/load: vat_plugin_register: rdma plugin not loaded...
time="2020-10-20 03:01:38.36237" level=debug msg="vpp-route descriptor retrieved 7 items: \n -  1. [vpp-route]: \"config/vpp/v2/route/vrf/0/dst/0.0.0.0/0/gw/0.0.0.0\" (unknown)\n   { type:DROP  dst_network:\"0.0.0.0/0\"  next_hop_addr:\"0.0.0.0\"  weight:1 }\n -  2. [vpp-route]: \"config/vpp/v2/route/vrf/0/dst/240.0.0.0/4/gw/0.0.0.0\" (unknown)\n   { type:DROP  dst_network:\"240.0.0.0/4\"  next_hop_addr:\"0.0.0.0\"  weight:1 }\n -  3. [vpp-route]: \"config/vpp/v2/route/vrf/0/dst/224.0.0.0/4/gw/0.0.0.0\" (unknown)\n   { type:DROP  dst_network:\"224.0.0.0/4\"  next_hop_addr:\"0.0.0.0\"  weight:1 }\n -  4. [vpp-route]: \"config/vpp/v2/route/vrf/0/dst/0.0.0.0/32/gw/0.0.0.0\" (unknown)\n   { type:DROP  dst_network:\"0.0.0.0/32\"  next_hop_addr:\"0.0.0.0\"  weight:1 }\n -  5. [vpp-route]: \"config/vpp/v2/route/vrf/0/dst/255.255.255.255/32/gw/0.0.0.0\" (unknown)\n   { type:DROP  dst_network:\"255.255.255.255/32\"  next_hop_addr:\"0.0.0.0\"  weight:1 }\n -  6. [vpp-route]: \"config/vpp/v2/route/vrf/0/dst/::/0/gw/::\" (unknown)\n   { type:DROP  dst_network:\"::/0\"  next_hop_addr:\"::\"  weight:1 }\n -  7. [vpp-route]: \"config/vpp/v2/route/vrf/0/dst/fe80::/10/gw/::\" (unknown)\n   { dst_network:\"fe80::/10\"  next_hop_addr:\"::\"  weight:1 }" loc="kvscheduler/refresh.go(143)" logger=kvscheduler
time="2020-10-20 03:01:38.36447" level=debug msg="vpp-xconnect descriptor retrieved 0 items: " loc="kvscheduler/refresh.go(143)" logger=kvscheduler
+======================================================================================================================+
| #0 - NBTransaction                                                                                        FullResync |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 0
      - type: NB Transaction, Full Resync
      - values:
          - key: config/vpp/v2/interfaces/server-beb60510-b8b0-41c0-960c-74d9100a1c8b
            val: { name:"server-beb60510-b8b0-41c0-960c-74d9100a1c8b"  type:MEMIF  enabled:true  ip_addresses:"10.0.0.0/32"  memif:{master:true  socket_filename:"/tmp/forwarder.test-100721224/beb60510-b8b0-41c0-960c-74d9100a1c8b.memif.socket"} }
          - key: config/vpp/v2/route/if/server-beb60510-b8b0-41c0-960c-74d9100a1c8b/vrf/0/dst/10.0.0.1/32
            val: { dst_network:"10.0.0.1/32"  outgoing_interface:"server-beb60510-b8b0-41c0-960c-74d9100a1c8b" }

time="2020-10-20 03:01:38.36686" level=debug msg="Memif socket filename /tmp/forwarder.test-100721224/beb60510-b8b0-41c0-960c-74d9100a1c8b.memif.socket registered under ID 1" loc="descriptor/interface.go(949)" logger=vpp-ifplugin.if-descriptor
vpp[3197]: memif_plugin: clib_file_add fd 14 private_data 1 idx 5

Oct 20 03:01:37.000�[36m [INFO] [cmd:vpp] �[0mvpp[3197]: memif_plugin: clib_file_add fd 14 private_data 1 idx 5
Oct 20 03:01:38.170�[36m [INFO] [cmd:vpp-agent] �[0mtime="2020-10-20 03:01:38.37107" level=debug msg="connection to VPP established (took 143ms)" loc="govppmux/plugin_impl_govppmux.go(147)" logger=govpp
Oct 20 03:01:38.170�[36m [INFO] [cmd:vpp-agent] �[0mtime="2020-10-20 03:01:38.37139" level=debug msg="binapi version 20.05.1 fully COMPATIBLE (637 messages)" loc="logging/log_api.go(37)" logger=defaultLogger
Oct 20 03:01:38.170�[36m [INFO] [cmd:vpp-agent] �[0mtime="2020-10-20 03:01:38.37146" level=debug msg="VPP handler core using preferred version: 20.05.1" loc="logging/log_api.go(37)" logger=defaultLogger
time="2020-10-20 03:01:38.37125" level=debug msg="publish add to ifplugin_ifstate{{server-beb60510-b8b0-41c0-960c-74d9100a1c8b false false vpp-interface-index} 0xc0006194f0}" loc="mem/inmemory_name_mapping.go(277)" logger=vpp-ifplugin.if-descriptor
time="2020-10-20 03:01:38.37165" level=debug msg="Interface 1 set to VRF 0" loc="vpp2005/vrf_vppcalls.go(50)" logger=vpp-ifplugin
Oct 20 03:01:38.170�[36m [INFO] [cmd:vpp-agent] �[0mtime="2020-10-20 03:01:38.37206" level=debug msg="vpp# show version verbose\nVersion:                  v20.05.1-5~g09f167997~b57\nCompiled by:              root\nCompile host:             b7fe526372e5\nCompile date:             2020-09-09T02:23:38\nCompile location:         /w/workspace/vpp-merge-2005-ubuntu1804\nCompiler:                 Clang/LLVM 9.0.0 (tags/RELEASE_900/final)\nCurrent PID:              3647\n" loc="govppmux/plugin_impl_govppmux.go(299)" logger=govpp
Oct 20 03:01:38.170�[36m [INFO] [cmd:vpp-agent] �[0mtime="2020-10-20 03:01:38.37322" level=debug msg="vpp# show version cmdline:\nCommand line arguments:    vpp  unix    {    nodaemon    log    /var/log/vpp/vpp.log    full-coredump    cli-listen    /var/run/vpp/cli.sock    gid    vpp    poll-sleep-usec    1000    }  api-trace    {    on    }  api-segment    {    gid    vpp    }  socksvr    {    socket-name    /var/run/vpp/api.sock    }  statseg    {    socket-name    /var/run/vpp/stats.sock    }  cpu    {    }  plugins    {    plugin    dpdk_plugin.so      {      disable      }    }" loc="govppmux/plugin_impl_govppmux.go(306)" logger=govpp
o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 03:01:38.288 +0000 UTC -> 2020-10-20 03:01:38.374 +0000 UTC, dur: 86ms):
      1. CREATE:
          - key: config/vpp/v2/interfaces/server-beb60510-b8b0-41c0-960c-74d9100a1c8b
          - value: { name:"server-beb60510-b8b0-41c0-960c-74d9100a1c8b"  type:MEMIF  enabled:true  ip_addresses:"10.0.0.0/32"  memif:{master:true  socket_filename:"/tmp/forwarder.test-100721224/beb60510-b8b0-41c0-960c-74d9100a1c8b.memif.socket"} } 
      2. CREATE [DERIVED]:
          - key: vpp/interface/server-beb60510-b8b0-41c0-960c-74d9100a1c8b/vrf/0/ip-version/v4
          - value: <EMPTY> 
      3. CREATE [DERIVED]:
          - key: vpp/interface/server-beb60510-b8b0-41c0-960c-74d9100a1c8b/address/static/10.0.0.0/32
          - value: <EMPTY> 
      4. CREATE [DERIVED]:
          - key: vpp/interface/server-beb60510-b8b0-41c0-960c-74d9100a1c8b/has-IP-address
          - value: <EMPTY> 
      5. CREATE:
          - key: config/vpp/v2/route/if/server-beb60510-b8b0-41c0-960c-74d9100a1c8b/vrf/0/dst/10.0.0.1/32
          - value: { dst_network:"10.0.0.1/32"  outgoing_interface:"server-beb60510-b8b0-41c0-960c-74d9100a1c8b" } 
x----------------------------------------------------------------------------------------------------------------------x
| #0 - NBTransaction                                                                                       took 86.1ms |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 03:01:38.37467" level=info msg="Transaction #0 successful! (took 86.6ms)" loc="orchestrator/dispatcher.go(178)" logger=dispatcher
time="2020-10-20 03:01:38.37475" level=debug msg="no pendings keys to wait for" loc="configurator/configurator.go(149)" logger=configurator.configurator
time="2020-10-20 03:01:38.37478" level=debug msg="config update finished with 3 results" loc="configurator/configurator.go(153)" logger=configurator.configurator
Oct 20 03:01:38.375�[36m [INFO] �[0mUPDATE COMMIT TOOK 91.589506ms
Oct 20 03:01:38.375�[36m [INFO] [cmd:/tmp/go-build940761299/b001/cmd-forwarder-vppagent.test] �[0m==--------------------------------> github.com/networkservicemesh/cmd-forwarder-vppagent/internal/ns/nsServer.Request() span:{}
Oct 20 03:01:38.375�[36m [INFO] [cmd:/tmp/go-build940761299/b001/cmd-forwarder-vppagent.test] �[0m>><<-------------------------------- request={"connection":{"id":"beb60510-b8b0-41c0-960c-74d9100a1c8b","network_service":"m2mns","mechanism":{"cls":"LOCAL","type":"MEMIF","parameters":{"inodeURL":"file:///tmp/forwarder.test-100721224/beb60510-b8b0-41c0-960c-74d9100a1c8b.memif.socket"}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":2,"path_segments":[{"name":"testClient","id":"46f663f2-0b25-4031-8fda-adfed234c25b","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjY0OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.Gvoe0BJoTe90OV4ZNzmf3PJf16mvc1kkTimKapmMo40hr-gO25i0x_64oX0hDU6ItJP3FzUnE6zB1pvgBT8b8g","expires":{"seconds":1603166497}},{"name":"forwarder","id":"4b75396f-f1d2-44a5-b854-f167176ad9a7","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjY0OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.kHSd3AxcmIPu0zK_jwKyUiLGJHHGTrTVlpW0G2bfpMKclYLJ7PVFySktrUBG_kfZhMbzmiFgTzrMcO_yNfGh8A","expires":{"seconds":1603166497}},{"name":"testServer","id":"beb60510-b8b0-41c0-960c-74d9100a1c8b","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjY0OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.zZ3xsoecM_S7obw32l8mvGtaFmtNMEkjbMkQGdDRHE0ut1fGgreDE4DJZfiyU9dn1PTESJKYw3_JBjMhjtxEJg","expires":{"seconds":1603166497}}]}},"mechanism_preferences":[{"cls":"LOCAL","type":"MEMIF"},{"cls":"LOCAL","type":"KERNEL_INTERFACE"},{"cls":"REMOTE","type":"VXLAN","parameters":{"src_ip":"\u003cnil\u003e"}},{"cls":"REMOTE","type":"SRV6"}]} span={}
Oct 20 03:01:38.375�[36m [INFO] [cmd:/tmp/go-build940761299/b001/cmd-forwarder-vppagent.test] �[0m==----------------------------------> github.com/networkservicemesh/sdk/pkg/networkservice/common/mechanisms/sendfd/sendFDServer.Request() span:{}
+======================================================================================================================+
| #1 - SBNotification                                                                                                  |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 1
      - type: SB Notification
      - values:
          - key: vpp/interface/server-beb60510-b8b0-41c0-960c-74d9100a1c8b/link-state/DOWN
            val: <EMPTY>

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 03:01:38.375 +0000 UTC -> 2020-10-20 03:01:38.375 +0000 UTC, dur: 0s):
Oct 20 03:01:38.375�[36m [INFO] [cmd:/tmp/go-build940761299/b001/cmd-forwarder-vppagent.test] �[0m>><<---------------------------------- request={"connection":{"id":"beb60510-b8b0-41c0-960c-74d9100a1c8b","network_service":"m2mns","mechanism":{"cls":"LOCAL","type":"MEMIF","parameters":{"inodeURL":"file:///tmp/forwarder.test-100721224/beb60510-b8b0-41c0-960c-74d9100a1c8b.memif.socket"}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":2,"path_segments":[{"name":"testClient","id":"46f663f2-0b25-4031-8fda-adfed234c25b","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjY0OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.Gvoe0BJoTe90OV4ZNzmf3PJf16mvc1kkTimKapmMo40hr-gO25i0x_64oX0hDU6ItJP3FzUnE6zB1pvgBT8b8g","expires":{"seconds":1603166497}},{"name":"forwarder","id":"4b75396f-f1d2-44a5-b854-f167176ad9a7","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjY0OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.kHSd3AxcmIPu0zK_jwKyUiLGJHHGTrTVlpW0G2bfpMKclYLJ7PVFySktrUBG_kfZhMbzmiFgTzrMcO_yNfGh8A","expires":{"seconds":1603166497}},{"name":"testServer","id":"beb60510-b8b0-41c0-960c-74d9100a1c8b","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjY0OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.zZ3xsoecM_S7obw32l8mvGtaFmtNMEkjbMkQGdDRHE0ut1fGgreDE4DJZfiyU9dn1PTESJKYw3_JBjMhjtxEJg","expires":{"seconds":1603166497}}]}},"mechanism_preferences":[{"cls":"LOCAL","type":"MEMIF"},{"cls":"LOCAL","type":"KERNEL_INTERFACE"},{"cls":"REMOTE","type":"VXLAN","parameters":{"src_ip":"\u003cnil\u003e"}},{"cls":"REMOTE","type":"SRV6"}]} span={}
Oct 20 03:01:38.375�[36m [INFO] [cmd:/tmp/go-build940761299/b001/cmd-forwarder-vppagent.test] �[0m==------------------------------------> github.com/networkservicemesh/cmd-forwarder-vppagent/internal/ns/nsServer.Request() span:{}
Oct 20 03:01:38.375�[36m [INFO] [cmd:/tmp/go-build940761299/b001/cmd-forwarder-vppagent.test] �[0m>><<------------------------------------ request={"connection":{"id":"beb60510-b8b0-41c0-960c-74d9100a1c8b","network_service":"m2mns","mechanism":{"cls":"LOCAL","type":"MEMIF","parameters":{"inodeURL":"file:///tmp/forwarder.test-100721224/beb60510-b8b0-41c0-960c-74d9100a1c8b.memif.socket"}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":2,"path_segments":[{"name":"testClient","id":"46f663f2-0b25-4031-8fda-adfed234c25b","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjY0OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.Gvoe0BJoTe90OV4ZNzmf3PJf16mvc1kkTimKapmMo40hr-gO25i0x_64oX0hDU6ItJP3FzUnE6zB1pvgBT8b8g","expires":{"seconds":1603166497}},{"name":"forwarder","id":"4b75396f-f1d2-44a5-b854-f167176ad9a7","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjY0OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.kHSd3AxcmIPu0zK_jwKyUiLGJHHGTrTVlpW0G2bfpMKclYLJ7PVFySktrUBG_kfZhMbzmiFgTzrMcO_yNfGh8A","expires":{"seconds":1603166497}},{"name":"testServer","id":"beb60510-b8b0-41c0-960c-74d9100a1c8b","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjY0OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.zZ3xsoecM_S7obw32l8mvGtaFmtNMEkjbMkQGdDRHE0ut1fGgreDE4DJZfiyU9dn1PTESJKYw3_JBjMhjtxEJg","expires":{"seconds":1603166497}}]}},"mechanism_preferences":[{"cls":"LOCAL","type":"MEMIF"},{"cls":"LOCAL","type":"KERNEL_INTERFACE"},{"cls":"REMOTE","type":"VXLAN","parameters":{"src_ip":"\u003cnil\u003e"}},{"cls":"REMOTE","type":"SRV6"}]} span={}
Oct 20 03:01:38.375�[36m [INFO] [cmd:/tmp/go-build940761299/b001/cmd-forwarder-vppagent.test] �[0m>><<------------------------------------ response={"id":"beb60510-b8b0-41c0-960c-74d9100a1c8b","network_service":"m2mns","mechanism":{"cls":"LOCAL","type":"MEMIF","parameters":{"inodeURL":"file:///tmp/forwarder.test-100721224/beb60510-b8b0-41c0-960c-74d9100a1c8b.memif.socket"}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":2,"path_segments":[{"name":"testClient","id":"46f663f2-0b25-4031-8fda-adfed234c25b","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMxNjY0OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.Gvoe0BJoTe90OV4ZNzmf3PJf16mvc1kkTimKapmMo40hr-gO25i0x_64oX0hDU6ItJP3FzUnE6zB1pvgBT8b8g","expires":{"seconds":1603166497}},{"name":"forwarder","id":"4b75396f-f1d2-44a5-b854-f167176ad9a7","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMxNjY0OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.kHSd3AxcmIPu0zK_jwKyUiLGJHHGTrTVlpW0G2bfpMKclYLJ7PVFySktrUBG_kfZhMbzmiFgTzrMcO_yNfGh8A","expires":{"seconds":1603166497}},{"name":"testServer","id":"beb60510-b8b0-41c0-960c-74d9100a1c8b","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMxNjY0OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.zZ3xsoecM_S7obw32l8mvGtaFmtNMEkjbMkQGdDRHE0ut1fGgreDE4DJZfiyU9dn1PTESJKYw3_JBjMhjtxEJg","expires":{"seconds":1603166497}}]}} span={}
      1. CREATE [OBTAINED]:
          - key: vpp/interface/server-beb60510-b8b0-41c0-960c-74d9100a1c8b/link-state/DOWN
          - value: <EMPTY> 
x----------------------------------------------------------------------------------------------------------------------x
| #1 - SBNotification                                                                                       took 100µs |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 03:01:38.37525" level=info msg="Transaction 1 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler

@edwarnicke
Copy link
Contributor Author

vppagent version from the go.mod:

go.ligato.io/vpp-agent/v3 v3.2.0-alpha.0.20201016122127-eca11ab3bbca

And the Dockerfile:

FROM ligato/vpp-agent:latest as go

@edwarnicke
Copy link
Contributor Author

Seeing interface UP after return again. First the log of the image stamp:

                                       __
  _  _____  ___ _______ ____ ____ ___ / /_  
 | |/ / _ \/ _ /___/ _ '/ _ '/ -_/ _ / __/  vpp-agent v3.2.0-alpha-75-geca11ab3b
 |___/ .__/ .__/   \_'_/\_' /\__/_//_\__/   Fri Oct 16 12:28:00 UTC 2020 (4 days ago)
    /_/  /_/           /___/                root@0971011abbd0 (go1.15.2 linux/amd64)

@edwarnicke
Copy link
Contributor Author

Logs:

Oct 20 21:46:45.221�[36m [INFO] �[0mSENDING UPDATE COMMIT: 
{
  "update": {
    "vpp_config": {
      "interfaces": [
        {
          "name": "server-ca990142-4258-4791-a794-32d87dce05c1",
          "type": "AF_PACKET",
          "enabled": true,
          "afpacket": {
            "hostIfName": "server-ca990142"
          }
        },
        {
          "name": "client-ca990142-4258-4791-a794-32d87dce05c1",
          "type": "AF_PACKET",
          "enabled": true,
          "afpacket": {
            "hostIfName": "client-ca990142"
          }
        }
      ],
      "xconnect_pairs": [
        {
          "receive_interface": "server-ca990142-4258-4791-a794-32d87dce05c1",
          "transmit_interface": "client-ca990142-4258-4791-a794-32d87dce05c1"
        },
        {
          "receive_interface": "client-ca990142-4258-4791-a794-32d87dce05c1",
          "transmit_interface": "server-ca990142-4258-4791-a794-32d87dce05c1"
        }
      ]
    },
    "linux_config": {
      "interfaces": [
        {
          "name": "server-ca990142-4258-4791-a794-32d87dce05c1-veth",
          "type": "VETH",
          "hostIfName": "server-ca990142",
          "enabled": true,
          "veth": {
            "peerIfName": "server-ca990142-4258-4791-a794-32d87dce05c1",
            "rxChecksumOffloading": "CHKSM_OFFLOAD_DISABLED",
            "txChecksumOffloading": "CHKSM_OFFLOAD_DISABLED"
          }
        },
        {
          "name": "server-ca990142-4258-4791-a794-32d87dce05c1",
          "type": "VETH",
          "namespace": {
            "type": "FD",
            "reference": "/proc/3588/fd/19"
          },
          "hostIfName": "k2kns-ca990142-",
          "enabled": true,
          "ipAddresses": [
            "10.0.0.1/32"
          ],
          "veth": {
            "peerIfName": "server-ca990142-4258-4791-a794-32d87dce05c1-veth",
            "rxChecksumOffloading": "CHKSM_OFFLOAD_DISABLED",
            "txChecksumOffloading": "CHKSM_OFFLOAD_DISABLED"
          }
        },
        {
          "name": "client-ca990142-4258-4791-a794-32d87dce05c1-veth",
          "type": "VETH",
          "hostIfName": "client-ca990142",
          "enabled": true,
          "veth": {
            "peerIfName": "client-ca990142-4258-4791-a794-32d87dce05c1",
            "rxChecksumOffloading": "CHKSM_OFFLOAD_DISABLED",
            "txChecksumOffloading": "CHKSM_OFFLOAD_DISABLED"
          }
        },
        {
          "name": "client-ca990142-4258-4791-a794-32d87dce05c1",
          "type": "VETH",
          "namespace": {
            "type": "FD",
            "reference": "/proc/3588/fd/22"
          },
          "hostIfName": "k2kns-ca990142-",
          "enabled": true,
          "ipAddresses": [
            "10.0.0.0/32"
          ],
          "veth": {
            "peerIfName": "client-ca990142-4258-4791-a794-32d87dce05c1-veth",
            "rxChecksumOffloading": "CHKSM_OFFLOAD_DISABLED",
            "txChecksumOffloading": "CHKSM_OFFLOAD_DISABLED"
          }
        }
      ],
      "routes": [
        {
          "outgoing_interface": "client-ca990142-4258-4791-a794-32d87dce05c1",
          "scope": 3,
          "dst_network": "10.0.0.1/32"
        },
        {
          "outgoing_interface": "server-ca990142-4258-4791-a794-32d87dce05c1",
          "scope": 3,
          "dst_network": "10.0.0.0/32"
        }
      ]
    },
    "netalloc_config": {}
  },
  "wait_done": true
}
time="2020-10-20 21:46:45.22253" level=debug msg="Push data with 10 KV pairs (source: grpc)" loc="orchestrator/dispatcher.go(110)" logger=dispatcher
time="2020-10-20 21:46:45.22259" level=debug msg=" - UPDATE: \"config/vpp/v2/interfaces/server-ca990142-4258-4791-a794-32d87dce05c1\" " loc="orchestrator/dispatcher.go(137)" logger=dispatcher
time="2020-10-20 21:46:45.22266" level=debug msg=" - UPDATE: \"config/vpp/v2/interfaces/client-ca990142-4258-4791-a794-32d87dce05c1\" " loc="orchestrator/dispatcher.go(137)" logger=dispatcher
time="2020-10-20 21:46:45.22271" level=debug msg=" - UPDATE: \"config/vpp/l2/v2/xconnect/server-ca990142-4258-4791-a794-32d87dce05c1\" " loc="orchestrator/dispatcher.go(137)" logger=dispatcher
time="2020-10-20 21:46:45.22274" level=debug msg=" - UPDATE: \"config/vpp/l2/v2/xconnect/client-ca990142-4258-4791-a794-32d87dce05c1\" " loc="orchestrator/dispatcher.go(137)" logger=dispatcher
time="2020-10-20 21:46:45.22278" level=debug msg=" - UPDATE: \"config/linux/interfaces/v2/interface/server-ca990142-4258-4791-a794-32d87dce05c1-veth\" " loc="orchestrator/dispatcher.go(137)" logger=dispatcher
time="2020-10-20 21:46:45.22283" level=debug msg=" - UPDATE: \"config/linux/interfaces/v2/interface/server-ca990142-4258-4791-a794-32d87dce05c1\" " loc="orchestrator/dispatcher.go(137)" logger=dispatcher
time="2020-10-20 21:46:45.22287" level=debug msg=" - UPDATE: \"config/linux/interfaces/v2/interface/client-ca990142-4258-4791-a794-32d87dce05c1-veth\" " loc="orchestrator/dispatcher.go(137)" logger=dispatcher
time="2020-10-20 21:46:45.22290" level=debug msg=" - UPDATE: \"config/linux/interfaces/v2/interface/client-ca990142-4258-4791-a794-32d87dce05c1\" " loc="orchestrator/dispatcher.go(137)" logger=dispatcher
time="2020-10-20 21:46:45.22295" level=debug msg=" - UPDATE: \"config/linux/l3/v2/route/10.0.0.1/32/client-ca990142-4258-4791-a794-32d87dce05c1\" " loc="orchestrator/dispatcher.go(137)" logger=dispatcher
time="2020-10-20 21:46:45.22298" level=debug msg=" - UPDATE: \"config/linux/l3/v2/route/10.0.0.0/32/server-ca990142-4258-4791-a794-32d87dce05c1\" " loc="orchestrator/dispatcher.go(137)" logger=dispatcher
+======================================================================================================================+
| #100 - NBTransaction                                                                                                 |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 100
      - type: NB Transaction
      - values:
          - key: config/linux/interfaces/v2/interface/client-ca990142-4258-4791-a794-32d87dce05c1
            val: { name:"client-ca990142-4258-4791-a794-32d87dce05c1"  type:VETH  namespace:{type:FD  reference:"/proc/3588/fd/22"}  host_if_name:"k2kns-ca990142-"  enabled:true  ip_addresses:"10.0.0.0/32"  veth:{peer_if_name:"client-ca990142-4258-4791-a794-32d87dce05c1-veth"  rx_checksum_offloading:CHKSM_OFFLOAD_DISABLED  tx_checksum_offloading:CHKSM_OFFLOAD_DISABLED} }
          - key: config/linux/interfaces/v2/interface/client-ca990142-4258-4791-a794-32d87dce05c1-veth
            val: { name:"client-ca990142-4258-4791-a794-32d87dce05c1-veth"  type:VETH  host_if_name:"client-ca990142"  enabled:true  veth:{peer_if_name:"client-ca990142-4258-4791-a794-32d87dce05c1"  rx_checksum_offloading:CHKSM_OFFLOAD_DISABLED  tx_checksum_offloading:CHKSM_OFFLOAD_DISABLED} }
          - key: config/linux/interfaces/v2/interface/server-ca990142-4258-4791-a794-32d87dce05c1
            val: { name:"server-ca990142-4258-4791-a794-32d87dce05c1"  type:VETH  namespace:{type:FD  reference:"/proc/3588/fd/19"}  host_if_name:"k2kns-ca990142-"  enabled:true  ip_addresses:"10.0.0.1/32"  veth:{peer_if_name:"server-ca990142-4258-4791-a794-32d87dce05c1-veth"  rx_checksum_offloading:CHKSM_OFFLOAD_DISABLED  tx_checksum_offloading:CHKSM_OFFLOAD_DISABLED} }
          - key: config/linux/interfaces/v2/interface/server-ca990142-4258-4791-a794-32d87dce05c1-veth
            val: { name:"server-ca990142-4258-4791-a794-32d87dce05c1-veth"  type:VETH  host_if_name:"server-ca990142"  enabled:true  veth:{peer_if_name:"server-ca990142-4258-4791-a794-32d87dce05c1"  rx_checksum_offloading:CHKSM_OFFLOAD_DISABLED  tx_checksum_offloading:CHKSM_OFFLOAD_DISABLED} }
          - key: config/linux/l3/v2/route/10.0.0.0/32/server-ca990142-4258-4791-a794-32d87dce05c1
            val: { outgoing_interface:"server-ca990142-4258-4791-a794-32d87dce05c1"  scope:LINK  dst_network:"10.0.0.0/32" }
          - key: config/linux/l3/v2/route/10.0.0.1/32/client-ca990142-4258-4791-a794-32d87dce05c1
            val: { outgoing_interface:"client-ca990142-4258-4791-a794-32d87dce05c1"  scope:LINK  dst_network:"10.0.0.1/32" }
          - key: config/vpp/l2/v2/xconnect/client-ca990142-4258-4791-a794-32d87dce05c1
            val: { receive_interface:"client-ca990142-4258-4791-a794-32d87dce05c1"  transmit_interface:"server-ca990142-4258-4791-a794-32d87dce05c1" }
          - key: config/vpp/l2/v2/xconnect/server-ca990142-4258-4791-a794-32d87dce05c1
            val: { receive_interface:"server-ca990142-4258-4791-a794-32d87dce05c1"  transmit_interface:"client-ca990142-4258-4791-a794-32d87dce05c1" }
          - key: config/vpp/v2/interfaces/client-ca990142-4258-4791-a794-32d87dce05c1
            val: { name:"client-ca990142-4258-4791-a794-32d87dce05c1"  type:AF_PACKET  enabled:true  afpacket:{host_if_name:"client-ca990142"} }
          - key: config/vpp/v2/interfaces/server-ca990142-4258-4791-a794-32d87dce05c1
            val: { name:"server-ca990142-4258-4791-a794-32d87dce05c1"  type:AF_PACKET  enabled:true  afpacket:{host_if_name:"server-ca990142"} }

+======================================================================================================================+
| #56 - SBNotification                                                                                                 |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 56
      - type: SB Notification
      - values:
          - key: linux/interface/host-name/client-ca990142
            val: <EMPTY>

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 21:46:45.238 +0000 UTC -> 2020-10-20 21:46:45.238 +0000 UTC, dur: 0s):
      1. CREATE [OBTAINED]:
          - key: linux/interface/host-name/client-ca990142
          - value: <EMPTY> 
x----------------------------------------------------------------------------------------------------------------------x
| #56 - SBNotification                                                                                      took 200µs |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 21:46:45.23836" level=info msg="Transaction 56 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler
+======================================================================================================================+
| #56 - SBNotification                                                                                                 |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 56
      - type: SB Notification
      - values:
          - key: linux/interface/host-name/client-ca990142
            val: <EMPTY>

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 21:46:45.239 +0000 UTC -> 2020-10-20 21:46:45.239 +0000 UTC, dur: 0s):
      1. CREATE [OBTAINED]:
          - key: linux/interface/host-name/client-ca990142
          - value: <EMPTY> 
x----------------------------------------------------------------------------------------------------------------------x
| #56 - SBNotification                                                                                      took 100µs |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 21:46:45.23887" level=info msg="Transaction 56 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler
+======================================================================================================================+
| #57 - SBNotification                                                                                                 |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 57
      - type: SB Notification
      - values:
          - key: linux/interface/host-name/server-ca990142
            val: <EMPTY>

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 21:46:45.283 +0000 UTC -> 2020-10-20 21:46:45.283 +0000 UTC, dur: 0s):
      1. CREATE [OBTAINED]:
          - key: linux/interface/host-name/server-ca990142
          - value: <EMPTY> 
x----------------------------------------------------------------------------------------------------------------------x
| #57 - SBNotification                                                                                      took 100µs |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 21:46:45.28293" level=info msg="Transaction 57 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler
+======================================================================================================================+
| #57 - SBNotification                                                                                                 |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 57
      - type: SB Notification
      - values:
          - key: linux/interface/host-name/server-ca990142
            val: <EMPTY>

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 21:46:45.283 +0000 UTC -> 2020-10-20 21:46:45.283 +0000 UTC, dur: 0s):
      1. CREATE [OBTAINED]:
          - key: linux/interface/host-name/server-ca990142
          - value: <EMPTY> 
x----------------------------------------------------------------------------------------------------------------------x
| #57 - SBNotification                                                                                      took 100µs |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 21:46:45.28292" level=info msg="Transaction 57 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler
o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 21:46:45.223 +0000 UTC -> 2020-10-20 21:46:45.32 +0000 UTC, dur: 97ms):
      1. CREATE:
          - key: config/linux/interfaces/v2/interface/client-ca990142-4258-4791-a794-32d87dce05c1-veth
          - value: { name:"client-ca990142-4258-4791-a794-32d87dce05c1-veth"  type:VETH  host_if_name:"client-ca990142"  enabled:true  veth:{peer_if_name:"client-ca990142-4258-4791-a794-32d87dce05c1"  rx_checksum_offloading:CHKSM_OFFLOAD_DISABLED  tx_checksum_offloading:CHKSM_OFFLOAD_DISABLED} } 
      2. CREATE:
          - key: config/linux/interfaces/v2/interface/client-ca990142-4258-4791-a794-32d87dce05c1
          - value: { name:"client-ca990142-4258-4791-a794-32d87dce05c1"  type:VETH  namespace:{type:FD  reference:"/proc/3588/fd/22"}  host_if_name:"k2kns-ca990142-"  enabled:true  ip_addresses:"10.0.0.0/32"  veth:{peer_if_name:"client-ca990142-4258-4791-a794-32d87dce05c1-veth"  rx_checksum_offloading:CHKSM_OFFLOAD_DISABLED  tx_checksum_offloading:CHKSM_OFFLOAD_DISABLED} } 
      3. CREATE [DERIVED]:
          - key: linux/interface/client-ca990142-4258-4791-a794-32d87dce05c1/address/static/10.0.0.0/32
          - value: <EMPTY> 
      4. CREATE [PROPERTY]:
          - key: linux/interface/state/client-ca990142-4258-4791-a794-32d87dce05c1/UP
          - value: <EMPTY> 
      5. CREATE [PROPERTY]:
          - key: linux/interface/state/client-ca990142-4258-4791-a794-32d87dce05c1-veth/UP
          - value: <EMPTY> 
      6. CREATE:
          - key: config/linux/interfaces/v2/interface/server-ca990142-4258-4791-a794-32d87dce05c1-veth
          - value: { name:"server-ca990142-4258-4791-a794-32d87dce05c1-veth"  type:VETH  host_if_name:"server-ca990142"  enabled:true  veth:{peer_if_name:"server-ca990142-4258-4791-a794-32d87dce05c1"  rx_checksum_offloading:CHKSM_OFFLOAD_DISABLED  tx_checksum_offloading:CHKSM_OFFLOAD_DISABLED} } 
      7. CREATE:
          - key: config/linux/interfaces/v2/interface/server-ca990142-4258-4791-a794-32d87dce05c1
          - value: { name:"server-ca990142-4258-4791-a794-32d87dce05c1"  type:VETH  namespace:{type:FD  reference:"/proc/3588/fd/19"}  host_if_name:"k2kns-ca990142-"  enabled:true  ip_addresses:"10.0.0.1/32"  veth:{peer_if_name:"server-ca990142-4258-4791-a794-32d87dce05c1-veth"  rx_checksum_offloading:CHKSM_OFFLOAD_DISABLED  tx_checksum_offloading:CHKSM_OFFLOAD_DISABLED} } 
      8. CREATE [DERIVED]:
          - key: linux/interface/server-ca990142-4258-4791-a794-32d87dce05c1/address/static/10.0.0.1/32
          - value: <EMPTY> 
      9. CREATE [PROPERTY]:
          - key: linux/interface/state/server-ca990142-4258-4791-a794-32d87dce05c1/UP
          - value: <EMPTY> 
      10. CREATE [PROPERTY]:
          - key: linux/interface/state/server-ca990142-4258-4791-a794-32d87dce05c1-veth/UP
          - value: <EMPTY> 
      11. CREATE:
          - key: config/linux/l3/v2/route/10.0.0.0/32/server-ca990142-4258-4791-a794-32d87dce05c1
          - value: { outgoing_interface:"server-ca990142-4258-4791-a794-32d87dce05c1"  scope:LINK  dst_network:"10.0.0.0/32" } 
      12. CREATE [PROPERTY]:
          - key: linux/link-local-route/server-ca990142-4258-4791-a794-32d87dce05c1/dest-address/10.0.0.0/32
          - value: <EMPTY> 
      13. CREATE:
          - key: config/linux/l3/v2/route/10.0.0.1/32/client-ca990142-4258-4791-a794-32d87dce05c1
          - value: { outgoing_interface:"client-ca990142-4258-4791-a794-32d87dce05c1"  scope:LINK  dst_network:"10.0.0.1/32" } 
      14. CREATE [PROPERTY]:
          - key: linux/link-local-route/client-ca990142-4258-4791-a794-32d87dce05c1/dest-address/10.0.0.1/32
          - value: <EMPTY> 
      15. CREATE [NOOP IS-PENDING]:
          - key: config/vpp/l2/v2/xconnect/client-ca990142-4258-4791-a794-32d87dce05c1
          - value: { receive_interface:"client-ca990142-4258-4791-a794-32d87dce05c1"  transmit_interface:"server-ca990142-4258-4791-a794-32d87dce05c1" } 
      16. CREATE [NOOP IS-PENDING]:
          - key: config/vpp/l2/v2/xconnect/server-ca990142-4258-4791-a794-32d87dce05c1
          - value: { receive_interface:"server-ca990142-4258-4791-a794-32d87dce05c1"  transmit_interface:"client-ca990142-4258-4791-a794-32d87dce05c1" } 
      17. CREATE [NOOP IS-PENDING]:
          - key: config/vpp/v2/interfaces/client-ca990142-4258-4791-a794-32d87dce05c1
          - value: { name:"client-ca990142-4258-4791-a794-32d87dce05c1"  type:AF_PACKET  enabled:true  afpacket:{host_if_name:"client-ca990142"} } 
      18. CREATE [NOOP IS-PENDING]:
          - key: config/vpp/v2/interfaces/server-ca990142-4258-4791-a794-32d87dce05c1
          - value: { name:"server-ca990142-4258-4791-a794-32d87dce05c1"  type:AF_PACKET  enabled:true  afpacket:{host_if_name:"server-ca990142"} } 
x----------------------------------------------------------------------------------------------------------------------x
| #100 - NBTransaction                                                                                     took 96.6ms |
x----------------------------------------------------------------------------------------------------------------------x

+======================================================================================================================+
| #101 - SBNotification                                                                                                |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 101
      - type: SB Notification
      - values:
          - key: linux/interface/host-name/client-ca990142
            val: <EMPTY>

time="2020-10-20 21:46:45.35882" level=debug msg="publish add to ifplugin_ifstate{{client-ca990142-4258-4791-a794-32d87dce05c1 false false vpp-interface-index} 0xc000891a40}" loc="mem/inmemory_name_mapping.go(277)" logger=vpp-ifplugin.if-descriptor
o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 21:46:45.32 +0000 UTC -> 2020-10-20 21:46:45.359 +0000 UTC, dur: 39ms):
      1. CREATE [OBTAINED]:
          - key: linux/interface/host-name/client-ca990142
          - value: <EMPTY> 
      2. CREATE [WAS-PENDING]:
          - key: config/vpp/v2/interfaces/client-ca990142-4258-4791-a794-32d87dce05c1
          - value: { name:"client-ca990142-4258-4791-a794-32d87dce05c1"  type:AF_PACKET  enabled:true  afpacket:{host_if_name:"client-ca990142"} } 
x----------------------------------------------------------------------------------------------------------------------x
| #101 - SBNotification                                                                                      took 39ms |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 21:46:45.35901" level=info msg="Transaction 101 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler
+======================================================================================================================+
| #102 - SBNotification                                                                                                |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 102
      - type: SB Notification
      - values:
          - key: linux/interface/host-name/server-ca990142
            val: <EMPTY>

time="2020-10-20 21:46:45.39089" level=debug msg="publish add to ifplugin_ifstate{{server-ca990142-4258-4791-a794-32d87dce05c1 false false vpp-interface-index} 0xc0009a4320}" loc="mem/inmemory_name_mapping.go(277)" logger=vpp-ifplugin.if-descriptor
o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 21:46:45.359 +0000 UTC -> 2020-10-20 21:46:45.393 +0000 UTC, dur: 34ms):
      1. CREATE [OBTAINED]:
          - key: linux/interface/host-name/server-ca990142
          - value: <EMPTY> 
      2. CREATE [WAS-PENDING]:
          - key: config/vpp/v2/interfaces/server-ca990142-4258-4791-a794-32d87dce05c1
          - value: { name:"server-ca990142-4258-4791-a794-32d87dce05c1"  type:AF_PACKET  enabled:true  afpacket:{host_if_name:"server-ca990142"} } 
      3. CREATE [WAS-PENDING]:
          - key: config/vpp/l2/v2/xconnect/client-ca990142-4258-4791-a794-32d87dce05c1
          - value: { receive_interface:"client-ca990142-4258-4791-a794-32d87dce05c1"  transmit_interface:"server-ca990142-4258-4791-a794-32d87dce05c1" } 
      4. CREATE [WAS-PENDING]:
          - key: config/vpp/l2/v2/xconnect/server-ca990142-4258-4791-a794-32d87dce05c1
          - value: { receive_interface:"server-ca990142-4258-4791-a794-32d87dce05c1"  transmit_interface:"client-ca990142-4258-4791-a794-32d87dce05c1" } 
x----------------------------------------------------------------------------------------------------------------------x
| #102 - SBNotification                                                                                      took 34ms |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 21:46:45.39322" level=info msg="Transaction 102 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler
time="2020-10-20 21:46:45.39339" level=info msg="Transaction #100 successful! (took 170.4ms)" loc="orchestrator/dispatcher.go(178)" logger=dispatcher
time="2020-10-20 21:46:45.39345" level=debug msg="no pendings keys to wait for" loc="configurator/configurator.go(148)" logger=configurator.configurator
time="2020-10-20 21:46:45.39350" level=info msg="finished waiting for done (took 58.451µs)" loc="configurator/configurator.go(150)" logger=configurator.configurator
time="2020-10-20 21:46:45.39354" level=debug msg="config update finished with 11 results" loc="configurator/configurator.go(153)" logger=configurator.configurator
Oct 20 21:46:45.394�[36m [INFO] �[0mUPDATE COMMIT TOOK 172.388621ms
Oct 20 21:46:45.394�[36m [INFO] [cmd:forwarder] �[0m==----------------------------------------> github.com/networkservicemesh/sdk/pkg/networkservice/common/mechanisms/sendfd/sendFDServer.Request() span:{}
Oct 20 21:46:45.394�[36m [INFO] [cmd:forwarder] �[0m>><<---------------------------------------- request={"connection":{"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"file:///proc/3588/fd/19","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}},"mechanism_preferences":[{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"file:///proc/3588/fd/19","name":""}}]} span={}
Oct 20 21:46:45.394�[36m [INFO] [cmd:forwarder] �[0m>><<---------------------------------------- response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.394�[36m [INFO] [cmd:forwarder] �[0m>><<-------------------------------------- response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
+======================================================================================================================+
| #103 - SBNotification                                                                                                |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 103
      - type: SB Notification
      - values:
          - key: vpp/interface/client-ca990142-4258-4791-a794-32d87dce05c1/link-state/DOWN
            val: <EMPTY>

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 21:46:45.394 +0000 UTC -> 2020-10-20 21:46:45.394 +0000 UTC, dur: 0s):
      1. CREATE [OBTAINED]:
          - key: vpp/interface/client-ca990142-4258-4791-a794-32d87dce05c1/link-state/DOWN
          - value: <EMPTY> 
x----------------------------------------------------------------------------------------------------------------------x
| #103 - SBNotification                                                                                     took 200µs |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 21:46:45.39397" level=info msg="Transaction 103 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler
+======================================================================================================================+
| #104 - SBNotification                                                                                                |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 104
      - type: SB Notification
      - values:
          - key: vpp/interface/server-ca990142-4258-4791-a794-32d87dce05c1/link-state/DOWN
            val: <EMPTY>

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 21:46:45.394 +0000 UTC -> 2020-10-20 21:46:45.394 +0000 UTC, dur: 0s):
      1. CREATE [OBTAINED]:
          - key: vpp/interface/server-ca990142-4258-4791-a794-32d87dce05c1/link-state/DOWN
          - value: <EMPTY> 
x----------------------------------------------------------------------------------------------------------------------x
| #104 - SBNotification                                                                                     took 100µs |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 21:46:45.39414" level=info msg="Transaction 104 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler
time="2020-10-20 21:46:45.39571" level=debug msg="streaming 4 interface stats" loc="telemetry/stats_poller.go(106)" logger=telemetry.stats-poller
time="2020-10-20 21:46:45.39593" level=debug msg="sending vpp stats: interface:{name:\"UNTAGGED-local0\"  rx:{}  tx:{}  rx_unicast:{}  rx_multicast:{}  rx_broadcast:{}  tx_unicast:{}  tx_multicast:{}  tx_broadcast:{}}" loc="telemetry/stats_poller.go(48)" logger=telemetry.stats-poller
time="2020-10-20 21:46:45.39616" level=debug msg="sending vpp stats: interface:{name:\"eth0\"  rx:{packets:2  bytes:112}  tx:{packets:1  bytes:42}  rx_unicast:{}  rx_multicast:{}  rx_broadcast:{}  tx_unicast:{}  tx_multicast:{}  tx_broadcast:{}  drops:2  ip6:1}" loc="telemetry/stats_poller.go(48)" logger=telemetry.stats-poller
time="2020-10-20 21:46:45.39651" level=debug msg="sending vpp stats: interface:{name:\"server-ca990142-4258-4791-a794-32d87dce05c1\"  rx:{}  tx:{}  rx_unicast:{}  rx_multicast:{}  rx_broadcast:{}  tx_unicast:{}  tx_multicast:{}  tx_broadcast:{}}" loc="telemetry/stats_poller.go(48)" logger=telemetry.stats-poller
time="2020-10-20 21:46:45.39660" level=debug msg="sending vpp stats: interface:{name:\"client-ca990142-4258-4791-a794-32d87dce05c1\"  rx:{}  tx:{}  rx_unicast:{}  rx_multicast:{}  rx_broadcast:{}  tx_unicast:{}  tx_multicast:{}  tx_broadcast:{}}" loc="telemetry/stats_poller.go(48)" logger=telemetry.stats-poller
Oct 20 21:46:45.396�[36m [INFO] [cmd:forwarder] �[0m>><<------------------------------------ response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.396�[36m [INFO] [cmd:forwarder] �[0m>><<---------------------------------- response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.396�[36m [INFO] [cmd:forwarder] �[0m>><<-------------------------------- response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.396�[36m [INFO] [cmd:forwarder] �[0m>><<------------------------------ response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.396�[36m [INFO] [cmd:forwarder] �[0m>><<---------------------------- response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.396�[36m [INFO] [cmd:forwarder] �[0m>><<-------------------------- response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.396�[36m [INFO] [cmd:forwarder] �[0m>><<------------------------ response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.396�[36m [INFO] [cmd:forwarder] �[0m>><<---------------------- response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.396�[36m [INFO] [cmd:forwarder] �[0m>><<-------------------- response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.397�[36m [INFO] [cmd:forwarder] �[0m>><<------------------ response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.397�[36m [INFO] [cmd:forwarder] �[0m>><<---------------- response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.397�[36m [INFO] [cmd:forwarder] �[0m>><<-------------- response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.397�[36m [INFO] [cmd:forwarder] �[0m>><<------------ response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.397�[36m [INFO] [cmd:forwarder] �[0m>><<---------- response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.397�[36m [INFO] [cmd:forwarder] �[0m>><<-------- response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.397�[36m [INFO] [cmd:forwarder] �[0m>><<------ response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.397�[36m [INFO] [cmd:forwarder] �[0m>><<---- response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.397�[36m [INFO] [cmd:forwarder] �[0m>><<-- response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.397�[36m [INFO] [cmd:/tmp/go-build167417156/b001/cmd-forwarder-vppagent.test] �[0m>><<---------------------- response={"id":"ca990142-4258-4791-a794-32d87dce05c1","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"index":1,"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.397�[36m [INFO] [cmd:/tmp/go-build167417156/b001/cmd-forwarder-vppagent.test] �[0m>><<-------------------- response={"id":"07c6a966-46e5-44e0-9713-14587a3e721a","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.397�[36m [INFO] [cmd:/tmp/go-build167417156/b001/cmd-forwarder-vppagent.test] �[0m>><<------------------ response={"id":"07c6a966-46e5-44e0-9713-14587a3e721a","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.397�[36m [INFO] [cmd:/tmp/go-build167417156/b001/cmd-forwarder-vppagent.test] �[0m>><<---------------- response={"id":"07c6a966-46e5-44e0-9713-14587a3e721a","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"inode://3/4026533539","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.397�[36m [INFO] [cmd:/tmp/go-build167417156/b001/cmd-forwarder-vppagent.test] �[0m>><<-------------- response={"id":"07c6a966-46e5-44e0-9713-14587a3e721a","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"file:///proc/thread-self/ns/net","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.397�[36m [INFO] [cmd:/tmp/go-build167417156/b001/cmd-forwarder-vppagent.test] �[0m>><<------------ response={"id":"07c6a966-46e5-44e0-9713-14587a3e721a","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"file:///proc/thread-self/ns/net","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.397�[36m [INFO] [cmd:/tmp/go-build167417156/b001/cmd-forwarder-vppagent.test] �[0m>><<---------- response={"id":"07c6a966-46e5-44e0-9713-14587a3e721a","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"file:///proc/thread-self/ns/net","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.398�[36m [INFO] [cmd:/tmp/go-build167417156/b001/cmd-forwarder-vppagent.test] �[0m>><<-------- response={"id":"07c6a966-46e5-44e0-9713-14587a3e721a","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"file:///proc/thread-self/ns/net","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.398�[36m [INFO] [cmd:/tmp/go-build167417156/b001/cmd-forwarder-vppagent.test] �[0m>><<------ response={"id":"07c6a966-46e5-44e0-9713-14587a3e721a","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"file:///proc/thread-self/ns/net","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.399�[36m [INFO] [cmd:/tmp/go-build167417156/b001/cmd-forwarder-vppagent.test] �[0m>><<---- response={"id":"07c6a966-46e5-44e0-9713-14587a3e721a","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"file:///proc/thread-self/ns/net","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.399�[36m [INFO] [cmd:/tmp/go-build167417156/b001/cmd-forwarder-vppagent.test] �[0m>><<-- response={"id":"07c6a966-46e5-44e0-9713-14587a3e721a","network_service":"k2kns","mechanism":{"cls":"LOCAL","type":"KERNEL_INTERFACE","parameters":{"inodeURL":"file:///proc/thread-self/ns/net","name":""}},"context":{"ip_context":{"src_ip_addr":"10.0.0.1/32","dst_ip_addr":"10.0.0.0/32"}},"path":{"path_segments":[{"name":"testClient","id":"07c6a966-46e5-44e0-9713-14587a3e721a","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.xQVjd6dD9C-jq99xj7NmQ0jyAZQPmx97URLOObQHvTewPneum89wTKTdhIlrk9vOZ-Ok6m8Nllo4sJwgd7-HvQ","expires":{"seconds":1603233997}},{"name":"forwarder","id":"ca990142-4258-4791-a794-32d87dce05c1","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9jbWQtZm9yd2FyZGVyLXZwcGFnZW50LnRlc3QiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2ZvcndhcmRlciJ9.t7WZ83C57lGGNP8v6iogQY1Cm1byATIYzmhhkdPFM4b0K1ecDCRR-PwQKsrv3O0zNVGBTbvdsACyBQioBi1ENQ","expires":{"seconds":1603233997},"metrics":{"rx_bytes":"0","rx_error_packets":"0","rx_packets":"0","tx_bytes":"0","tx_error_packets":"0","tx_packets":"0"}},{"name":"testServer","id":"7fa5928f-e9ae-40ab-99dc-2a01b22f5f28","token":"eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJzcGlmZmU6Ly9leGFtcGxlLm9yZy9mb3J3YXJkZXIiLCJleHAiOjE2MDMyMzM5OTcsInN1YiI6InNwaWZmZTovL2V4YW1wbGUub3JnL2NtZC1mb3J3YXJkZXItdnBwYWdlbnQudGVzdCJ9.QgA-PG7Ow90aUetZnGAzJxAJh99O8JN9c__4DrXe_fzJMJx8OXM4hoDjKdFYT9b8AsblsyMDr_KXIh5PsWqtrg","expires":{"seconds":1603233997}}]}} span={}
Oct 20 21:46:45.399�[36m [INFO] �[0mChecking we can ping both ways (time since start: 198.644627ms)
10.0.0.0 dev k2kns-ca990142- src 10.0.0.1 uid 0 
    cache 
time="2020-10-20 21:46:50.23592" level=debug msg="updating interface states for 4 interfaces" loc="ifplugin/interface_state.go(254)" logger=vpp-ifplugin.if-state
time="2020-10-20 21:46:50.24108" level=info msg="Agent plugin state update." lastErr="<nil>" loc="statuscheck/plugin_impl_statuscheck.go(183)" logger=status-check plugin=vpp-ifplugin state=ok
time="2020-10-20 21:46:50.24132" level=debug msg="Global interface state data added: internal_name:\"host-server-ca990142\" index:2 status:\"UP\" mac_address:\"02:fe:b9:d3:10:b1\" " loc="statuscheck/plugin_impl_statuscheck.go(248)" logger=status-check
time="2020-10-20 21:46:50.24150" level=debug msg="Global interface state data added: internal_name:\"host-client-ca990142\" index:3 status:\"UP\" mac_address:\"02:fe:1d:b2:0b:49\" " loc="statuscheck/plugin_impl_statuscheck.go(248)" logger=status-check
time="2020-10-20 21:46:50.24160" level=debug msg="Global interface state data added: internal_name:\"local0\" status:\"DOWN\" mac_address:\"00:00:00:00:00:00\" " loc="statuscheck/plugin_impl_statuscheck.go(248)" logger=status-check
time="2020-10-20 21:46:50.24172" level=debug msg="Global interface state data added: internal_name:\"host-eth0\" index:1 status:\"UP\" mac_address:\"02:42:ac:11:00:02\" " loc="statuscheck/plugin_impl_statuscheck.go(248)" logger=status-check
+======================================================================================================================+
| #105 - SBNotification                                                                                                |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 105
      - type: SB Notification
      - values:
          - key: vpp/interface/server-ca990142-4258-4791-a794-32d87dce05c1/link-state/DOWN
            val: <NIL>
          - key: vpp/interface/server-ca990142-4258-4791-a794-32d87dce05c1/link-state/UP
            val: <EMPTY>

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 21:46:50.242 +0000 UTC -> 2020-10-20 21:46:50.242 +0000 UTC, dur: 0s):
      1. DELETE [WAS-OBTAINED]:
          - key: vpp/interface/server-ca990142-4258-4791-a794-32d87dce05c1/link-state/DOWN
          - value: <EMPTY> 
      2. CREATE [OBTAINED]:
          - key: vpp/interface/server-ca990142-4258-4791-a794-32d87dce05c1/link-state/UP
          - value: <EMPTY> 
x----------------------------------------------------------------------------------------------------------------------x
| #105 - SBNotification                                                                                     took 200µs |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 21:46:50.24187" level=info msg="Transaction 105 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler
+======================================================================================================================+
| #106 - SBNotification                                                                                                |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 106
      - type: SB Notification
      - values:
          - key: vpp/interface/client-ca990142-4258-4791-a794-32d87dce05c1/link-state/DOWN
            val: <NIL>
          - key: vpp/interface/client-ca990142-4258-4791-a794-32d87dce05c1/link-state/UP
            val: <EMPTY>

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 21:46:50.242 +0000 UTC -> 2020-10-20 21:46:50.242 +0000 UTC, dur: 0s):
      1. DELETE [WAS-OBTAINED]:
          - key: vpp/interface/client-ca990142-4258-4791-a794-32d87dce05c1/link-state/DOWN
          - value: <EMPTY> 
      2. CREATE [OBTAINED]:
          - key: vpp/interface/client-ca990142-4258-4791-a794-32d87dce05c1/link-state/UP
          - value: <EMPTY> 
x----------------------------------------------------------------------------------------------------------------------x
| #106 - SBNotification                                                                                     took 100µs |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 21:46:50.24210" level=info msg="Transaction 106 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler
+======================================================================================================================+
| #107 - SBNotification                                                                                                |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 107
      - type: SB Notification
      - values:
          - key: vpp/interface/eth0/link-state/DOWN
            val: <NIL>
          - key: vpp/interface/eth0/link-state/UP
            val: <EMPTY>

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 21:46:50.242 +0000 UTC -> 2020-10-20 21:46:50.242 +0000 UTC, dur: 0s):
      1. DELETE [WAS-OBTAINED]:
          - key: vpp/interface/eth0/link-state/DOWN
          - value: <EMPTY> 
      2. CREATE [OBTAINED]:
          - key: vpp/interface/eth0/link-state/UP
          - value: <EMPTY> 
x----------------------------------------------------------------------------------------------------------------------x
| #107 - SBNotification                                                                                     took 100µs |
x----------------------------------------------------------------------------------------------------------------------x

time="2020-10-20 21:46:50.24233" level=info msg="Transaction 107 successful!" loc="kvscheduler/txn_process.go(405)" logger=kvscheduler
PING 10.0.0.0 (10.0.0.0) 56(84) bytes of data.

--- 10.0.0.0 ping statistics ---
1 packets transmitted, 0 received, 100% packet loss, time 0ms

@edwarnicke
Copy link
Contributor Author

The relavent detail are:

Oct 20 21:46:45.394�[36m [INFO] �[0mUPDATE COMMIT TOOK 172.388621ms
...
+======================================================================================================================+
| #105 - SBNotification                                                                                                |
+======================================================================================================================+
  * transaction arguments:
      - seqNum: 105
      - type: SB Notification
      - values:
          - key: vpp/interface/server-ca990142-4258-4791-a794-32d87dce05c1/link-state/DOWN
            val: <NIL>
          - key: vpp/interface/server-ca990142-4258-4791-a794-32d87dce05c1/link-state/UP
            val: <EMPTY>

o----------------------------------------------------------------------------------------------------------------------o
  * executed operations (2020-10-20 21:46:50.242 +0000 UTC -> 2020-10-20 21:46:50.242 +0000 UTC, dur: 0s):
      1. DELETE [WAS-OBTAINED]:
          - key: vpp/interface/server-ca990142-4258-4791-a794-32d87dce05c1/link-state/DOWN
          - value: <EMPTY> 
      2. CREATE [OBTAINED]:
          - key: vpp/interface/server-ca990142-4258-4791-a794-32d87dce05c1/link-state/UP
          - value: <EMPTY> 

I got my return at 21:46:45.394 (almost precisely the time of SB #103 and #104 completion... which was the reporting of the creation of the vpp interfaces in DOWN state... and we didn't get the notification of SB transactions for 'UP' state for the vpp interfaces until 21:46:50.242 ... nearly 5 seconds later (which is also consistent with the ping failure).

@ondrej-fabry
Copy link
Member

Let me first mention that current implementation of WaitDone is not in any way handling interface up state. It's just waiting for all configuration that was in state PENDING as a result of the transaction for that request. Link up for interface is not a PENDING config at all. So to address this we will need to find some other way to handle this cases.

@edwarnicke
Copy link
Contributor Author

Let me first mention that current implementation of WaitDone is not in any way handling interface up state. It's just waiting for all configuration that was in state PENDING as a result of the transaction for that request. Link up for interface is not a PENDING config at all. So to address this we will need to find some other way to handle this cases.

I'm a little confused... I thought my configuration, by specifying 'enabled' for an interface had specified an 'UP' state, which I'd then expect to imply with WaitDone that we were in the specified state (ie, interfaces UP).

@milanlenco
Copy link
Collaborator

Let me first mention that current implementation of WaitDone is not in any way handling interface up state. It's just waiting for all configuration that was in state PENDING as a result of the transaction for that request. Link up for interface is not a PENDING config at all. So to address this we will need to find some other way to handle this cases.

I'm a little confused... I thought my configuration, by specifying 'enabled' for an interface had specified an 'UP' state, which I'd then expect to imply with WaitDone that we were in the specified state (ie, interfaces UP).

VPP differentiates two UP/DOWN interface states: admin state and link state
The former is what is configured (i.e. already done on return from a config request if WaitDone is enabled). The latter depends also on the other side of the interface and we learn about changes through VPP notifications. For example, memif can be configured with admin state UP, but the link will remain DOWN until it connects with the opposite memif interface.

Keys representing interface link states are pretty much unrelated from the key-value pairs representing configuration, therefore it is not being waited for even if WaitDone is enabled. The only reason we track link-state is because some configuration such us additional memif Rx/Tx queues cannot be applied until the link is up.

@edwarnicke
Copy link
Contributor Author

@milanlenco Ah... that is interesting. What is the easiest way via GRPC to find out the link-state of an interface?

@edwarnicke
Copy link
Contributor Author

Looking around, the options I see are:

configurator.Dump - basically poll for Config state from the SB - but all of it, no way to scope it down
configurator.Notify - basically get notification of any and all vpp interface changes from the SB - but all of it, not way to scope down to the parts I am interested in.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants