Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use "replace" in all write modes #43

Merged
merged 2 commits into from
Dec 29, 2022
Merged

Use "replace" in all write modes #43

merged 2 commits into from
Dec 29, 2022

Commits on Dec 29, 2022

  1. Update driver to v0.10.0

    @akudiyar
    akudiyar committed Dec 29, 2022
    Configuration menu
    Copy the full SHA
    3240b35 View commit details
    Browse the repository at this point in the history

  2. Use replace for write operations instead of insert 

    Although the insert operations adds additional safety against unexpected
record duplicates, the Spark execution specifics require the write
operations to be idempotent, because in case of a sudden operation
failure it may be retried by Spark automatically, and we cannot delete
existing records prior to it due to the absence of cluster transactions
and extended partitioning support.
    @akudiyar
    akudiyar committed Dec 29, 2022
    Configuration menu
    Copy the full SHA
    3a59414 View commit details
    Browse the repository at this point in the history