lot of prop mismatch of in/out edges and edges loss when leader change happends frequently

[kikimo]

Please check the FAQ documentation before raising an issue

Please check the FAQ documentation and old issues before raising an issue in case someone has asked the same question that you are asking.

Describe the bug (must be provided)

lot of prop mismatch of in/out edges and edges loss when leader change happends frequently.

Your Environments (must be provided)

• OS: uname -a
• Compliler: g++ --version or clang++ --version
• CPU: lscpu
• Commit id (e.g. a3ffc7d8)

How To Reproduce(must be provided)

Steps to reproduce the behavior:

1. 3storage + 3 graph + 1meta
2. trigger leader change frequently
3. insert lot edges

python scripts to trigger nebula leader change:

# coding: utf-8

import os
import time
import random
import signal
from subprocess import check_output

process_name = 'nebula-storaged'
pid_list = check_output(['pidof', process_name])
pids = pid_list.split()
pids = [int(pid) for pid in pids]
print(pids)

while True:
    victim = random.choice(pids)
    print("stopping {}".format(victim))
    # import pdb; pdb.set_trace()
    os.kill(victim, signal.SIGSTOP)
    time.sleep(2)
    os.kill(victim, signal.SIGCONT)
    print('resuming {}'.format(victim))
    time.sleep(2)

During a test we insert 16384 edges, and found 58 in/out edge prop mismatches, and 5248 edge loss.

Expected behavior

A clear and concise description of what you expected to happen.

Additional context

Provide logs and configs, or any other context to trace the problem.