Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Initial version of craft binary mq message format (#1621) #2130

Closed
wants to merge 39 commits into from
Closed

Initial version of craft binary mq message format (#1621) #2130

wants to merge 39 commits into from

Commits on Jun 22, 2021

  1. Initial version of craft binary mq message format 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    47f4bee View commit details
    Browse the repository at this point in the history

  2. Add license 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    c69c353 View commit details
    Browse the repository at this point in the history

  3. Fix some lint 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    fab036b View commit details
    Browse the repository at this point in the history

  4. Add more test to supress not used function lint 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    af5f8c8 View commit details
    Browse the repository at this point in the history

  5. Remove not useful decodeRowChangedEvent function 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    b14a8e7 View commit details
    Browse the repository at this point in the history

  6. Use the correct size table to decode column groups 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    c4528d3 View commit details
    Browse the repository at this point in the history

  7. Fix more lints 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    0472d8d View commit details
    Browse the repository at this point in the history

  8. Fix lint 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    955cb7c View commit details
    Browse the repository at this point in the history

  9. Fix lint 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    201f90b View commit details
    Browse the repository at this point in the history

  10. Change to little endian like what protobuf does. 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    a318a49 View commit details
    Browse the repository at this point in the history

  11. Remove comments and fix column group values encoding 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    cba72ba View commit details
    Browse the repository at this point in the history

  12. Set schema and table to nil when they are empty 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    8b157fe View commit details
    Browse the repository at this point in the history

  13. Add more test cases and fix bugs about the fail tests 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    c8ee55e View commit details
    Browse the repository at this point in the history

  14. Add protobuf vs craft benchmark related code 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    e4095af View commit details
    Browse the repository at this point in the history

  15. Fix column group & year type seralization bug 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    6992aaf View commit details
    Browse the repository at this point in the history

  16. Force encoding year type to varint 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    8c37b36 View commit details
    Browse the repository at this point in the history

  17. Fix body size table 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    34f0ded View commit details
    Browse the repository at this point in the history

  18. Disable lint for not yet used utility functions 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    a9a27d4 View commit details
    Browse the repository at this point in the history

  19. Fix lint 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    7d1b4f2 View commit details
    Browse the repository at this point in the history

  20. Fix lint 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    b640062 View commit details
    Browse the repository at this point in the history

  21. Fix lint 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    e631aec View commit details
    Browse the repository at this point in the history

  22. Fix lint 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    a6a3cd0 View commit details
    Browse the repository at this point in the history

  23. Fix lint

    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    f1033d8 View commit details
    Browse the repository at this point in the history

  24. Remove unnecessary assignment 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    3d6e15e View commit details
    Browse the repository at this point in the history

  25. Fix errdoc 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    c4bda42 View commit details
    Browse the repository at this point in the history

  26. Change decoder to use body size table instead of offset table 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    5611ddf View commit details
    Browse the repository at this point in the history

  27. Fix json.Number.Int64() overflow 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    bf063bc View commit details
    Browse the repository at this point in the history

  28. Convert from float64 to int64 or uint64

    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    7fab547 View commit details
    Browse the repository at this point in the history

  29. Use c.Logf instead of fmt.Printf 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    e7359bf View commit details
    Browse the repository at this point in the history

  30. Seed random number generator in init function 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    205937d View commit details
    Browse the repository at this point in the history

  31. Add comments to varint encoding logic 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    9bfefe6 View commit details
    Browse the repository at this point in the history

  32. Fix couple of typos and add some comments 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    ad97b40 View commit details
    Browse the repository at this point in the history

  33. Remove deprecated RowID from header 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    3ad6753 View commit details
    Browse the repository at this point in the history

  34. Optimize codec size 

    1. Remove deprecated RowID field from header
2. Use term dictionary to compress terms

Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    f9d5004 View commit details
    Browse the repository at this point in the history

  35. Fix lints 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    ed66033 View commit details
    Browse the repository at this point in the history

  36. Change size table to encode with varint chunk 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    12c69ff View commit details
    Browse the repository at this point in the history

  37. Always encode terms in delta varint chunk 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    5abe993 View commit details
    Browse the repository at this point in the history

  38. Change header to encode type with delta varint chunk 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    d519db7 View commit details
    Browse the repository at this point in the history

  39. Use uvarint chunk to encode type of headers 

    Signed-off-by: Xiaoguang Sun <sunxiaoguang@zhihu.com>
    @sunxiaoguang @ti-chi-bot
    sunxiaoguang authored and ti-chi-bot committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    fa25abf View commit details
    Browse the repository at this point in the history