Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ddl, lightning: integrate operator for global sort #46734

Merged
merged 35 commits into from
Sep 12, 2023
Merged

ddl, lightning: integrate operator for global sort #46734

merged 35 commits into from
Sep 12, 2023

Commits on Sep 4, 2023

  1. lightning: add ExternalEngineConfig to create an external engine 

    Signed-off-by: lance6716 <lance6716@gmail.com>
    @lance6716
    lance6716 committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    b82492e View commit details
    Browse the repository at this point in the history

  2. add two more config 

    Signed-off-by: lance6716 <lance6716@gmail.com>
    @lance6716
    lance6716 committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    ba62aee View commit details
    Browse the repository at this point in the history

  3. fix UT 

    Signed-off-by: lance6716 <lance6716@gmail.com>
    @lance6716
    lance6716 committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    fc7e903 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2023

  1. fix bazel 

    Signed-off-by: lance6716 <lance6716@gmail.com>
    @lance6716
    lance6716 committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    3a5da7a View commit details
    Browse the repository at this point in the history

  2. fix lint 

    Signed-off-by: lance6716 <lance6716@gmail.com>
    @lance6716
    lance6716 committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    1ede83e View commit details
    Browse the repository at this point in the history

  3. add UT 

    Signed-off-by: lance6716 <lance6716@gmail.com>
    @lance6716
    lance6716 committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    0c60d4c View commit details
    Browse the repository at this point in the history

  4. fix sec lint 

    Signed-off-by: lance6716 <lance6716@gmail.com>
    @lance6716
    lance6716 committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    faae105 View commit details
    Browse the repository at this point in the history

  5. fix bazel 

    Signed-off-by: lance6716 <lance6716@gmail.com>
    @lance6716
    lance6716 committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    549d0da View commit details
    Browse the repository at this point in the history

  6. address comment 

    Signed-off-by: lance6716 <lance6716@gmail.com>
    @lance6716
    lance6716 committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    2c6257b View commit details
    Browse the repository at this point in the history

  7. have to use failpoint 

    Signed-off-by: lance6716 <lance6716@gmail.com>
    @lance6716
    lance6716 committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    ea7494d View commit details
    Browse the repository at this point in the history

  8. fix CI 

    Signed-off-by: lance6716 <lance6716@gmail.com>
    @lance6716
    lance6716 committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    7f7bef5 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2023

  1. address comment 

    Signed-off-by: lance6716 <lance6716@gmail.com>
    @lance6716
    lance6716 committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    4a89257 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2023

  1. switch to failpoint 

    Signed-off-by: lance6716 <lance6716@gmail.com>
    @lance6716
    lance6716 committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    f6de222 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of github.com:pingcap/tidb into external-config

    @lance6716
    lance6716 committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    820326d View commit details
    Browse the repository at this point in the history

  3. ddl, lightning: integrate operator for global sort

    @tangenta
    tangenta committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    83ec65d View commit details
    Browse the repository at this point in the history

  4. update bazel

    @tangenta
    tangenta committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    6f098c4 View commit details
    Browse the repository at this point in the history

  5. use jobID as external storage prefix

    @tangenta
    tangenta committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    be3e412 View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'upstream/master' into global-sort-operator

    @tangenta
    tangenta committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    feb25b1 View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2023

  1. fix file prefix and linter

    @tangenta
    tangenta committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    8791caa View commit details
    Browse the repository at this point in the history

  2. fix linter

    @tangenta
    tangenta committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    e093425 View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2023

  1. use the same writer for each index

    @tangenta
    tangenta committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    7ecb83f View commit details
    Browse the repository at this point in the history

  2. fix GetRegionSplitSizeKeys

    @tangenta
    tangenta committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    c7fee41 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'upstream/master' into HEAD

    @tangenta
    tangenta committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    37d9fd4 View commit details
    Browse the repository at this point in the history

  4. use one write worker for global sort

    @tangenta
    tangenta committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    45d24c9 View commit details
    Browse the repository at this point in the history

  5. remove unnecessary changes

    @tangenta
    tangenta committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    c06da77 View commit details
    Browse the repository at this point in the history

  6. unregister backend ctx after merge sort

    @tangenta
    tangenta committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    395bd5f View commit details
    Browse the repository at this point in the history

  7. ddl: get all file names from subtask meta

    @tangenta
    tangenta committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    7849e2e View commit details
    Browse the repository at this point in the history

  8. address comments

    @tangenta
    tangenta committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    ba083ae View commit details
    Browse the repository at this point in the history

  9. Merge remote-tracking branch 'upstream/master' into HEAD

    @tangenta
    tangenta committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    5aa5e09 View commit details
    Browse the repository at this point in the history

  10. apply tidb_cloud_storage_uri

    @tangenta
    tangenta committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    5c209b5 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2023

  1. Merge remote-tracking branch 'upstream/master' into HEAD

    @tangenta
    tangenta committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    56a7378 View commit details
    Browse the repository at this point in the history

  2. fix (#127)

    @ywqzzy
    ywqzzy authored Sep 12, 2023
    Configuration menu
    Copy the full SHA
    271d1fd View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'upstream/master' into HEAD

    @tangenta
    tangenta committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    d9e6bce View commit details
    Browse the repository at this point in the history

  4. collect min max key correctly

    @tangenta
    tangenta committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    a19bd15 View commit details
    Browse the repository at this point in the history

  5. add comment

    @tangenta
    tangenta committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    5ab3433 View commit details
    Browse the repository at this point in the history