Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Simplify Python impl for KafkaSourceStage #300

Merged
33 commits merged into from
Nov 15, 2022
Merged

Simplify Python impl for KafkaSourceStage #300

33 commits merged into from
Nov 15, 2022

Commits on Jul 22, 2022

  1. Simplify Python impl of KafkaSourceStage

    @dagardner-nv
    dagardner-nv committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    8f18e47 View commit details
    Browse the repository at this point in the history

  2. Handle mal-formed payloads

    @dagardner-nv
    dagardner-nv committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    a230e78 View commit details
    Browse the repository at this point in the history

  3. Re-enable cpp impl

    @dagardner-nv
    dagardner-nv committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    faf0375 View commit details
    Browse the repository at this point in the history

  4. Remove unused imports

    @dagardner-nv
    dagardner-nv committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    3e5e87f View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2022

  1. Merge branch 'branch-22.11' into david-from-kafka-py

    @dagardner-nv
    dagardner-nv committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    c77fc4c View commit details
    Browse the repository at this point in the history

  2. Fix merge error

    @dagardner-nv
    dagardner-nv committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    b1939b6 View commit details
    Browse the repository at this point in the history

  3. Update kafka tests

    @dagardner-nv
    dagardner-nv committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    18cd021 View commit details
    Browse the repository at this point in the history

  4. Implement stop_after functionality

    @dagardner-nv
    dagardner-nv committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    044a941 View commit details
    Browse the repository at this point in the history

  5. Set client_ids and don't disable commits

    @dagardner-nv
    dagardner-nv committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    3904f0f View commit details
    Browse the repository at this point in the history

  6. Use auto-commit when disable_commit is true

    @dagardner-nv
    dagardner-nv committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    d560490 View commit details
    Browse the repository at this point in the history

  7. Remove call to seek

    @dagardner-nv
    dagardner-nv committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    5934838 View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2022

  1. Bump SRF version

    @dagardner-nv
    dagardner-nv committed Oct 12, 2022
    Configuration menu
    Copy the full SHA
    511fb6d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'david-srf-22.11' into david-from-kafka-py

    @dagardner-nv
    dagardner-nv committed Oct 12, 2022
    Configuration menu
    Copy the full SHA
    dca8d2c View commit details
    Browse the repository at this point in the history

  3. wip

    @dagardner-nv
    dagardner-nv committed Oct 12, 2022
    Configuration menu
    Copy the full SHA
    761c74f View commit details
    Browse the repository at this point in the history

  4. Merge branch 'branch-22.11' into david-from-kafka-py

    @dagardner-nv
    dagardner-nv authored Oct 12, 2022
    Configuration menu
    Copy the full SHA
    3acec6e View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2022

  1. Merge branch 'branch-22.11' into david-from-kafka-py

    @dagardner-nv
    dagardner-nv committed Oct 21, 2022
    Configuration menu
    Copy the full SHA
    7668eb1 View commit details
    Browse the repository at this point in the history

  2. wip

    @dagardner-nv
    dagardner-nv committed Oct 21, 2022
    Configuration menu
    Copy the full SHA
    3ce2bf4 View commit details
    Browse the repository at this point in the history

  3. Restructure so we are only calling self._process_batch from a single … 

    …location
    @dagardner-nv
    dagardner-nv committed Oct 21, 2022
    Configuration menu
    Copy the full SHA
    5d7d03c View commit details
    Browse the repository at this point in the history

  4. Merge branch 'branch-22.11' into david-from-kafka-py

    @dagardner-nv
    dagardner-nv committed Oct 21, 2022
    Configuration menu
    Copy the full SHA
    3892912 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2022

  1. Remove unused import

    @dagardner-nv
    dagardner-nv committed Oct 24, 2022
    Configuration menu
    Copy the full SHA
    59d2d2c View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-22.11' into david-from-kafka-py

    @dagardner-nv
    dagardner-nv committed Oct 24, 2022
    Configuration menu
    Copy the full SHA
    4f5c028 View commit details
    Browse the repository at this point in the history

  3. Optionally commit messages synchronously, makes testing easier

    @dagardner-nv
    dagardner-nv committed Oct 24, 2022
    Configuration menu
    Copy the full SHA
    9139fef View commit details
    Browse the repository at this point in the history

  4. Add unittest to verify kafka messages are being committed prior to be… 

    …ing emitted
    @dagardner-nv
    dagardner-nv committed Oct 24, 2022
    Configuration menu
    Copy the full SHA
    197adb7 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2022

  1. Merge branch 'branch-22.11' into david-from-kafka-py

    @dagardner-nv
    dagardner-nv authored Oct 27, 2022
    Configuration menu
    Copy the full SHA
    738082b View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2022

  1. Merge branch 'branch-22.11' into david-from-kafka-py

    @dagardner-nv
    dagardner-nv authored Oct 31, 2022
    Configuration menu
    Copy the full SHA
    289beba View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2022

  1. Merge branch 'branch-22.11' into david-from-kafka-py

    @dagardner-nv
    dagardner-nv authored Nov 1, 2022
    Configuration menu
    Copy the full SHA
    19cc38d View commit details
    Browse the repository at this point in the history

Commits on Nov 3, 2022

  1. Replace dep on cudf_kafka with librdkafka

    @dagardner-nv
    dagardner-nv committed Nov 3, 2022
    Configuration menu
    Copy the full SHA
    6b5296f View commit details
    Browse the repository at this point in the history

  2. Add explicit dep on python-confluent-kafka which previously was pulle… 

    …d in by cudf_kafka
    @dagardner-nv
    dagardner-nv committed Nov 3, 2022
    Configuration menu
    Copy the full SHA
    4bd3955 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2022

  1. Merge branch 'branch-22.11' into david-from-kafka-py

    @dagardner-nv
    dagardner-nv authored Nov 7, 2022
    Configuration menu
    Copy the full SHA
    6b66c4e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-22.11' into david-from-kafka-py

    @dagardner-nv
    dagardner-nv authored Nov 7, 2022
    Configuration menu
    Copy the full SHA
    a0b8161 View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2022

  1. Merge branch 'branch-22.11' into david-from-kafka-py

    @mdemoret-nv
    mdemoret-nv committed Nov 11, 2022
    Configuration menu
    Copy the full SHA
    e9f0267 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2022

  1. Merge branch 'branch-22.11' into david-from-kafka-py

    @dagardner-nv
    dagardner-nv authored Nov 14, 2022
    Configuration menu
    Copy the full SHA
    580b69c View commit details
    Browse the repository at this point in the history

  2. Remove out of date comments

    @dagardner-nv
    dagardner-nv committed Nov 14, 2022
    Configuration menu
    Copy the full SHA
    499e4f5 View commit details
    Browse the repository at this point in the history