Skip to content
This repository has been archived by the owner on Jun 20, 2023. It is now read-only.

Bulk Provide/Reproviding System #34

Merged
merged 29 commits into from
May 14, 2021
Merged

Bulk Provide/Reproviding System #34

merged 29 commits into from
May 14, 2021

Commits on Apr 9, 2021

  1. fix: in queue sync datastore to disk

    @aschmahmann
    aschmahmann committed Apr 9, 2021
    Configuration menu
    Copy the full SHA
    c707e99 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2021

  1. feat: add a batching provider/reprovider system

    @aschmahmann
    aschmahmann committed Apr 12, 2021
    Configuration menu
    Copy the full SHA
    c193919 View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2021

  1. simplify batch provider to remove the managed provider list, remove t… 

    …racking of individual CID reprovide times, and have a very simple and fast stats function
    @aschmahmann
    aschmahmann committed Apr 22, 2021
    Configuration menu
    Copy the full SHA
    829bc09 View commit details
    Browse the repository at this point in the history

  2. batch provider waits for provider system to be ready before attemptin… 

    …g to provide
    @aschmahmann
    aschmahmann committed Apr 22, 2021
    Configuration menu
    Copy the full SHA
    0fdf1d6 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2021

  1. fix: handle periods with no providing, and handle the case of a missi… 

    …ng LastReprovide entry in the datastore
    @aschmahmann
    aschmahmann committed Apr 23, 2021
    Configuration menu
    Copy the full SHA
    93ff866 View commit details
    Browse the repository at this point in the history

Commits on May 12, 2021

  1. moved import

    @aschmahmann
    aschmahmann committed May 12, 2021
    Configuration menu
    Copy the full SHA
    fb01b26 View commit details
    Browse the repository at this point in the history

  2. batched: moved context creation to prevent leakage

    @aschmahmann
    aschmahmann committed May 12, 2021
    Configuration menu
    Copy the full SHA
    bf3cf56 View commit details
    Browse the repository at this point in the history

  3. cleanup code a bit and add more logging

    @aschmahmann
    aschmahmann committed May 12, 2021
    Configuration menu
    Copy the full SHA
    0023040 View commit details
    Browse the repository at this point in the history

  4. remove unnecessary goroutine

    @aschmahmann
    aschmahmann committed May 12, 2021
    Configuration menu
    Copy the full SHA
    8bbdb3b View commit details
    Browse the repository at this point in the history

  5. rename getTime to parseTime

    @aschmahmann
    aschmahmann committed May 12, 2021
    Configuration menu
    Copy the full SHA
    9e61fa1 View commit details
    Browse the repository at this point in the history

  6. removed newly added syncs from the provider queue and updated its doc… 

    …umentation
    @aschmahmann
    aschmahmann committed May 12, 2021
    Configuration menu
    Copy the full SHA
    c3fd90b View commit details
    Browse the repository at this point in the history

  7. batched: wait for goroutines to close before returning from Close

    @aschmahmann
    aschmahmann committed May 12, 2021
    Configuration menu
    Copy the full SHA
    c52c0b0 View commit details
    Browse the repository at this point in the history

  8. batched: reuse timers in the Run function

    @aschmahmann
    aschmahmann committed May 12, 2021
    Configuration menu
    Copy the full SHA
    34b4e40 View commit details
    Browse the repository at this point in the history

  9. renamed variable

    @aschmahmann
    aschmahmann committed May 12, 2021
    Configuration menu
    Copy the full SHA
    4407f46 View commit details
    Browse the repository at this point in the history

  10. some go timer fixes

    @aschmahmann
    aschmahmann committed May 12, 2021
    Configuration menu
    Copy the full SHA
    f498246 View commit details
    Browse the repository at this point in the history

  11. have a max collection threshold even when only processing regular pro… 

    …vides
    @aschmahmann
    aschmahmann committed May 12, 2021
    Configuration menu
    Copy the full SHA
    cffff34 View commit details
    Browse the repository at this point in the history

  12. max collection timer only starts once we have our first provide

    @aschmahmann
    aschmahmann committed May 12, 2021
    Configuration menu
    Copy the full SHA
    6d08b5d View commit details
    Browse the repository at this point in the history

  13. remove cid from provide queue if its invalid

    @aschmahmann
    aschmahmann committed May 12, 2021
    Configuration menu
    Copy the full SHA
    3a94d3a View commit details
    Browse the repository at this point in the history

  14. switch reproviding channel to be unbuffered

    @aschmahmann
    aschmahmann committed May 12, 2021
    Configuration menu
    Copy the full SHA
    866d979 View commit details
    Browse the repository at this point in the history

  15. batched: do not panic if no key provider is set, instead default to r… 

    …eturning a closed channel
    @aschmahmann
    aschmahmann committed May 12, 2021
    Configuration menu
    Copy the full SHA
    f84c7d9 View commit details
    Browse the repository at this point in the history

  16. batched: renamed dynamicCh and dynamicCidLoop to reprovideCh and repr… 

    …ovideCidLoop since there is no static + dynamic reprovide channels anymore
    @aschmahmann
    aschmahmann committed May 12, 2021
    Configuration menu
    Copy the full SHA
    8c07658 View commit details
    Browse the repository at this point in the history

  17. batched: add test

    @aschmahmann
    aschmahmann committed May 12, 2021
    Configuration menu
    Copy the full SHA
    71c6564 View commit details
    Browse the repository at this point in the history

  18. fix max collection check

    @aschmahmann
    aschmahmann committed May 12, 2021
    Configuration menu
    Copy the full SHA
    b017f26 View commit details
    Browse the repository at this point in the history

  19. fixed waitgroup usage bug

    @aschmahmann
    aschmahmann committed May 12, 2021
    Configuration menu
    Copy the full SHA
    d366b61 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2021

  1. batched: internally configurable initial reprovide

    @aschmahmann
    aschmahmann committed May 13, 2021
    Configuration menu
    Copy the full SHA
    843e75c View commit details
    Browse the repository at this point in the history

  2. batched: add basic test

    @aschmahmann
    aschmahmann committed May 13, 2021
    Configuration menu
    Copy the full SHA
    04452c4 View commit details
    Browse the repository at this point in the history

  3. batched: rework timer usage

    @aschmahmann
    aschmahmann committed May 13, 2021
    Configuration menu
    Copy the full SHA
    edb6021 View commit details
    Browse the repository at this point in the history

  4. use closure

    @aschmahmann
    aschmahmann committed May 13, 2021
    Configuration menu
    Copy the full SHA
    1c19caa View commit details
    Browse the repository at this point in the history

Commits on May 14, 2021

  1. fix debug log usage

    @aschmahmann
    aschmahmann committed May 14, 2021
    Configuration menu
    Copy the full SHA
    c86f3de View commit details
    Browse the repository at this point in the history