Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Clean buffer after rebalancing for batch queue #3269

Merged
merged 18 commits into from
Apr 13, 2021
Merged

Clean buffer after rebalancing for batch queue #3269

merged 18 commits into from
Apr 13, 2021

Commits on Mar 16, 2021

  1. Clean buffer after rebalancing for batch queue

    @jliunyu
    jliunyu committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    a2cc763 View commit details
    Browse the repository at this point in the history

  2. reference checking checking

    @jliunyu
    jliunyu committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    3496289 View commit details
    Browse the repository at this point in the history

  3. Clean buffer after rebalancing for batch queue 

    Issue: Buffer is not cleaned after rebalance if messages are polled using the batch queue method, so the consumer will still get old messages.

Solution: when assign happens, a new op event with type RD_KAFKA_OP_BARRIER will be created, a new version is been created at mean time. If the consumer met this event, will clean the buffer by comparing the version of msgs and the new version just created.
    @jliunyu
    jliunyu committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    4603aac View commit details
    Browse the repository at this point in the history

  4. Clean buffer after rebalancing for batch queue thread API change in t… 

    …est case
    @jliunyu
    jliunyu committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    94d19fa View commit details
    Browse the repository at this point in the history

  5. Clean buffer after rebalancing for batch queue - Broker config

    @jliunyu
    jliunyu committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    0f20a2e View commit details
    Browse the repository at this point in the history

  6. Clean buffer after rebalancing for batch queue -initialize variable

    @jliunyu
    jliunyu committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    7ce196c View commit details
    Browse the repository at this point in the history

  7. Clean buffer after rebalancing for batch queue - Segmentation fault

    @jliunyu
    jliunyu committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    97d1b09 View commit details
    Browse the repository at this point in the history

  8. Clean buffer after rebalancing for batch queue -transactions_mock fix

    @jliunyu
    jliunyu committed Mar 16, 2021
    Configuration menu
    Copy the full SHA
    3d45be7 View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2021

  1. Review handling

    @jliunyu
    jliunyu committed Mar 18, 2021
    Configuration menu
    Copy the full SHA
    5338b2d View commit details
    Browse the repository at this point in the history

  2. format

    @jliunyu
    jliunyu committed Mar 18, 2021
    Configuration menu
    Copy the full SHA
    543ed3c View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2021

  1. Handle review request

    @jliunyu
    jliunyu committed Mar 23, 2021
    Configuration menu
    Copy the full SHA
    cf702fb View commit details
    Browse the repository at this point in the history

  2. format change

    @jliunyu
    jliunyu committed Mar 23, 2021
    Configuration menu
    Copy the full SHA
    7b6bb2d View commit details
    Browse the repository at this point in the history

  3. format

    @jliunyu
    jliunyu committed Mar 23, 2021
    Configuration menu
    Copy the full SHA
    6b80356 View commit details
    Browse the repository at this point in the history

  4. format

    @jliunyu
    jliunyu committed Mar 23, 2021
    Configuration menu
    Copy the full SHA
    fc89ebf View commit details
    Browse the repository at this point in the history

Commits on Apr 7, 2021

  1. testing handle

    @jliunyu
    jliunyu committed Apr 7, 2021
    Configuration menu
    Copy the full SHA
    ece6da0 View commit details
    Browse the repository at this point in the history

  2. add space line

    @jliunyu
    jliunyu committed Apr 7, 2021
    Configuration menu
    Copy the full SHA
    f153c26 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2021

  1. combine msg verification

    @jliunyu
    jliunyu committed Apr 12, 2021
    Configuration menu
    Copy the full SHA
    6759426 View commit details
    Browse the repository at this point in the history

  2. remove log msg

    @jliunyu
    jliunyu committed Apr 12, 2021
    Configuration menu
    Copy the full SHA
    b58cc40 View commit details
    Browse the repository at this point in the history