Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PRT-509-BREAKING-refactor-relay-structure-consumer-provider #357

Merged
merged 149 commits into from
Mar 28, 2023
Merged
Show file tree
Hide file tree
Changes from 144 commits
Commits
Show all changes
149 commits
Select commit Hold shift + click to select a range
a6c967f
provider state tracker work in progress
omerlavanet Feb 12, 2023
b8fe4cc
reliability manager added vote handler
omerlavanet Feb 13, 2023
e810eba
finished implementing vote updater and it's registration and transact…
omerlavanet Feb 14, 2023
527072f
added apiInterface to relay.pb and implemented provider listener
omerlavanet Feb 14, 2023
bb37a8a
continue work rpcprovider
omerlavanet Feb 14, 2023
a3e1ae0
added single provider preparation function
omerlavanet Feb 15, 2023
54bdd34
added verification for proof
omerlavanet Feb 15, 2023
4afa16f
added tryRelay
omerlavanet Feb 15, 2023
93bac0e
added onSessionFailure usage
omerlavanet Feb 15, 2023
372c69b
added onSessionDone
omerlavanet Feb 15, 2023
916ecc9
sync
omerlavanet Feb 15, 2023
8805627
changed onSessionDone interface
omerlavanet Feb 15, 2023
afe4a2b
handle proof sending
omerlavanet Feb 15, 2023
8054ea7
Merge branch 'main' into ARC-2-RPCProvider
omerlavanet Feb 15, 2023
efa881f
fix reference
omerlavanet Feb 15, 2023
57d66b6
WIP psm
ranlavanet Feb 15, 2023
7c6b637
Merge branch 'ARC-2-RPCProvider' of github.com:lavanet/lava into ARC-…
ranlavanet Feb 15, 2023
33bd93f
added subscribe support
omerlavanet Feb 16, 2023
27edfdd
WIP psm
ranlavanet Feb 16, 2023
b45e825
Merge branch 'ARC-2-RPCProvider' of github.com:lavanet/lava into ARC-…
omerlavanet Feb 16, 2023
4b2b7b1
WIP
ranlavanet Feb 16, 2023
a215cc9
WIP
ranlavanet Feb 16, 2023
0c2bdc9
continued subscription code
omerlavanet Feb 16, 2023
4271852
finished provide side subscribe
omerlavanet Feb 16, 2023
30d26d4
handle subscription failure in consumer
omerlavanet Feb 16, 2023
3b6f47e
handle subscribe success without an error on provider side
omerlavanet Feb 16, 2023
e924489
handle error status on relaySubscribe
omerlavanet Feb 16, 2023
15eed87
added cache to statequery
omerlavanet Feb 16, 2023
dd8587f
added deps
omerlavanet Feb 16, 2023
bcbb900
added retry on txSender sequence mismatch
omerlavanet Feb 16, 2023
a1988b1
move common code to a method
omerlavanet Feb 16, 2023
81c24a3
added option for reward server to reject a proof when it has an updat…
omerlavanet Feb 16, 2023
65e2095
wrap common code in a method
omerlavanet Feb 16, 2023
9bb8ede
reward server work
omerlavanet Feb 16, 2023
6a2ecbb
relaynumber fixed
ranlavanet Feb 16, 2023
14ffee6
Merge branch 'ARC-2-RPCProvider' of github.com:lavanet/lava into ARC-…
ranlavanet Feb 16, 2023
5f84f62
Merge branch 'ARC-2-RPCProvider' of github.com:lavanet/lava into ARC-…
omerlavanet Feb 16, 2023
f21bfe9
go mod tidy
omerlavanet Feb 16, 2023
0441834
finished normal flow of get session.
ranlavanet Feb 16, 2023
e276d35
finished normal flow of get session.
ranlavanet Feb 16, 2023
622c770
adding sync loss handling
ranlavanet Feb 16, 2023
3db63c0
adding consumer blocked handling
ranlavanet Feb 16, 2023
b87ea56
adding on session done functionality
ranlavanet Feb 16, 2023
65a666e
Merge branch 'ARC-2-RPCProvider' of github.com:lavanet/lava into ARC-…
omerlavanet Feb 16, 2023
5056179
added rewards claims and tracking
omerlavanet Feb 16, 2023
e7a8758
bug fix
omerlavanet Feb 16, 2023
1e12532
refactored chainproxy into parsableChainProxy so we can implement cha…
omerlavanet Feb 16, 2023
edb2d69
revert, parsableChainMessage isn't needed
omerlavanet Feb 16, 2023
283b139
continued work on chainFetcher WIP
omerlavanet Feb 17, 2023
aa2931c
WIP psm methods almost done
ranlavanet Feb 21, 2023
22e3c86
Merge branch 'ARC-2-RPCProvider' of github.com:lavanet/lava into ARC-…
ranlavanet Feb 21, 2023
8b99a0a
finished implementing chainFetcher
omerlavanet Feb 21, 2023
d3f0ae5
Merge branch 'ARC-2-RPCProvider' of github.com:lavanet/lava into ARC-…
omerlavanet Feb 21, 2023
43d1ff0
adding recommendedEpochNumToCollectPayment
ranlavanet Feb 21, 2023
53f8b0c
Merge branch 'ARC-2-RPCProvider' of github.com:lavanet/lava into ARC-…
ranlavanet Feb 21, 2023
6c2bd2d
adding recommendedEpochNumToCollectPayment
ranlavanet Feb 21, 2023
500f2ae
adjusting code in state_query
ranlavanet Feb 21, 2023
8e0d68a
indicative error in reward server
ranlavanet Feb 21, 2023
e424455
finished missing chain fetcher block parsing
omerlavanet Feb 21, 2023
b5391d9
Merge branch 'ARC-2-RPCProvider' of github.com:lavanet/lava into ARC-…
omerlavanet Feb 21, 2023
341680b
fixing reward server provider session manager reward sync
ranlavanet Feb 21, 2023
53535d8
Merge branch 'ARC-2-RPCProvider' of github.com:lavanet/lava into ARC-…
ranlavanet Feb 21, 2023
8c138f0
Merge branch 'main' into ARC-2-RPCProvider
omerlavanet Feb 21, 2023
4554aff
tendermintrpc chain_fetcher now works
omerlavanet Feb 22, 2023
25e406f
added support for rest chain fetcher
omerlavanet Feb 22, 2023
a71c0da
added support for all apiInterfaces, using chain fetcher
omerlavanet Feb 22, 2023
beca007
example configuration to run rpc provider
omerlavanet Feb 22, 2023
fd88756
added examples for configs
omerlavanet Feb 22, 2023
8b867ad
Fixed context shutdown issues, fixed bugs
omerlavanet Feb 21, 2023
509844c
new configurations for rpcprovider
omerlavanet Feb 22, 2023
cfa06a5
Merge branch 'main' into ARC-2-RPCProvider
omerlavanet Feb 22, 2023
58ffac4
change lava conf
omerlavanet Feb 22, 2023
8745a23
adding data reliability
ranlavanet Feb 23, 2023
632bea0
Merge branch 'ARC-2-RPCProvider' of github.com:lavanet/lava into ARC-…
ranlavanet Feb 23, 2023
139fc12
Merge branch 'ARC-2-RPCProvider' of github.com:lavanet/lava into ARC-…
omerlavanet Feb 22, 2023
ec87231
Finished provider session manager integration and implementation!!!
ranlavanet Feb 23, 2023
41b46fc
Merge branch 'ARC-2-RPCProvider' of github.com:lavanet/lava into ARC-…
ranlavanet Feb 23, 2023
bfe1814
fixing is valid epoch mistake.
ranlavanet Feb 23, 2023
1afeace
changed chain tracker range to be inclusive and fixed a bug
omerlavanet Feb 22, 2023
57953dd
Merge branch 'main' into ARC-2-RPCProvider
omerlavanet Mar 5, 2023
913d084
fix reference overwriting
omerlavanet Mar 5, 2023
9b5894c
handle initialization on ProviderSessionManager
omerlavanet Mar 5, 2023
82ca39f
fix providerSessionsManager bugs
omerlavanet Mar 5, 2023
ea56d6e
fixed wrong lock checks
omerlavanet Mar 5, 2023
98e614f
fixed tx sender parsing issue
omerlavanet Mar 5, 2023
7bf3098
changed IP:PORT to HOST:PORT
omerlavanet Mar 5, 2023
0375592
do not crash if cache isn't connected
omerlavanet Mar 5, 2023
07a4b05
still some bugs to fix
omerlavanet Mar 5, 2023
5bc16d4
git ignore generated conf file
omerlavanet Mar 5, 2023
dd5775f
changed init chain commands, added some prints, modified fatals into …
omerlavanet Mar 5, 2023
488c5d3
removed check for websocket on tendermint until we decide what to do
omerlavanet Mar 5, 2023
8799612
better handling of missing urls and endpoints definitions
omerlavanet Mar 6, 2023
4a7075c
better capture grpc endpoint misconfiguration
omerlavanet Mar 6, 2023
b96f55d
happy flow for provider session manager
ranlavanet Mar 6, 2023
a2f819e
Merge branch 'ARC-2-RPCProvider' of github.com:lavanet/lava into ARC-…
ranlavanet Mar 6, 2023
e74bb58
adding happy flow, session failure, epoch update tests
ranlavanet Mar 6, 2023
4f99676
adding more tests to psm
ranlavanet Mar 6, 2023
cb74985
changing test names
ranlavanet Mar 6, 2023
601e73d
Fixing data reliability in PSM
ranlavanet Mar 7, 2023
2446fb6
data reliability psm WIP
ranlavanet Mar 7, 2023
c547f8a
fixing subscription in PSM. adding unitests for the entire package.
ranlavanet Mar 7, 2023
72a1169
using generics to trigger delete event instead of using the code twice
ranlavanet Mar 7, 2023
59b3b32
remove print
ranlavanet Mar 8, 2023
ff510f7
fixing some issues related to connector crashing
ranlavanet Mar 8, 2023
c6e42b3
extract cobra commands from main
ranlavanet Mar 8, 2023
1369997
refactored proto bufs, now changes to the code
omerlavanet Mar 9, 2023
1060049
WIP changing fields in relay
omerlavanet Mar 9, 2023
52f515c
wip
omerlavanet Mar 9, 2023
3a7cdec
adding config files for e2e
ranlavanet Mar 9, 2023
1b9a4a4
fixing provider cu charge in case consumer pays more
ranlavanet Mar 9, 2023
28fb629
changed some tests to use new format
omerlavanet Mar 11, 2023
32565d5
fixed gov test
omerlavanet Mar 11, 2023
7bf6997
continue refactor
omerlavanet Mar 11, 2023
da185ec
provider error update
ranlavanet Mar 12, 2023
2989c23
Bug fixing session
ranlavanet Mar 12, 2023
d2a3421
successfully build relay after changes
omerlavanet Mar 13, 2023
6a37f3f
successfully compiled after refactoring relay.pb now to unitesting
omerlavanet Mar 13, 2023
61f0f5c
rename relay fields to better represent what they are
omerlavanet Mar 13, 2023
796f8ba
added some fields to badge
omerlavanet Mar 13, 2023
da23c0e
Merge branch 'main' into ARC-2-RPCProvider
omerlavanet Mar 13, 2023
2dd573d
added chain id verification to relays
omerlavanet Mar 14, 2023
48651c2
Fixing VRF issue with rpcprovider
ranlavanet Mar 14, 2023
bc0890e
Merge branch 'ARC-2-RPCProvider' of github.com:lavanet/lava into ARC-…
ranlavanet Mar 14, 2023
706edb3
panic protection
ranlavanet Mar 14, 2023
2b0ed73
Merge branch 'ARC-2-RPCProvider' into PRT-509-refactor-relay-structur…
omerlavanet Mar 15, 2023
1b219a8
finished merging
omerlavanet Mar 15, 2023
ae9a7f1
lint + fix
omerlavanet Mar 15, 2023
78c2875
fixed data reliability miss protection to surface problems and fix un…
omerlavanet Mar 15, 2023
ad10d22
fix unitests failing
omerlavanet Mar 15, 2023
6b959b1
Merge branch 'main' into PRT-509-refactor-relay-structure-consumer-pr…
omerlavanet Mar 15, 2023
9620e40
go mod tidy
omerlavanet Mar 15, 2023
0270032
merge fixes
omerlavanet Mar 16, 2023
f24ce64
Merge branch 'main' into PRT-509-refactor-relay-structure-consumer-pr…
omerlavanet Mar 16, 2023
b66e983
Merge branch 'main' into PRT-509-refactor-relay-structure-consumer-pr…
ranlavanet Mar 16, 2023
2045884
merge main
ranlavanet Mar 16, 2023
5e38216
fix unitest merge problem
omerlavanet Mar 16, 2023
b067b7b
make E2E great again
ranlavanet Mar 16, 2023
09fb315
fixed lint, added debug print
omerlavanet Mar 16, 2023
8ab8491
fix tests
ranlavanet Mar 16, 2023
67c658d
Merge branch 'main' into PRT-509-refactor-relay-structure-consumer-pr…
omerlavanet Mar 16, 2023
111d5c3
removed deprecated relayer code
omerlavanet Mar 16, 2023
cd3b82f
fix problem in dev script
omerlavanet Mar 16, 2023
26eadb8
removed relayer/ unit tests after migrating to protocol
omerlavanet Mar 16, 2023
3c9458c
fixed comment naming convention
omerlavanet Mar 16, 2023
b320d49
Renaming psm
ranlavanet Mar 22, 2023
923a4cf
fixing possible lock issue
ranlavanet Mar 22, 2023
26506a2
returning sync loss upon trying to lock a locked session.
ranlavanet Mar 22, 2023
dc214ef
fixing camelcases in relay proto
ranlavanet Mar 26, 2023
e4e4301
Merge branch 'main' into PRT-509-refactor-relay-structure-consumer-pr…
omerlavanet Mar 27, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
30 changes: 6 additions & 24 deletions .github/workflows/e2e.yml
Original file line number Diff line number Diff line change
Expand Up @@ -87,12 +87,12 @@ jobs:

- name: JSON Provider All Logs
if: always()
run: grep "" testutil/e2e/logs/03_jsonProvider* --exclude="*errors*"
run: grep "" testutil/e2e/logs/03_EthProvider* --exclude="*errors*"

- name: JSON Provider Error Only Logs
if: always()
continue-on-error: true
run: grep "" testutil/e2e/logs/03_jsonProvider* --include="*errors*"
run: grep "" testutil/e2e/logs/03_EthProvider* --include="*errors*"

- name: JSON Consumer All Logs
if: always()
Expand All @@ -103,14 +103,14 @@ jobs:
continue-on-error: true
run: cat testutil/e2e/logs/04_jsonConsumer_errors.log

- name: Tendermint Provider All Logs
- name: Lava Provider All Logs
if: always()
run: grep "" testutil/e2e/logs/05_tendermintProvider* --exclude="*errors*"
run: grep "" testutil/e2e/logs/05_LavaProvider* --exclude="*errors*"

- name: Tendermint Provider Error Only Logs
- name: Lava Provider Error Only Logs
if: always()
continue-on-error: true
run: grep "" testutil/e2e/logs/05_tendermintProvider* --include="*errors*"
run: grep "" testutil/e2e/logs/05_LavaProvider* --include="*errors*"

- name: Lava over Lava All Logs
if: always()
Expand All @@ -121,24 +121,6 @@ jobs:
continue-on-error: true
run: cat testutil/e2e/logs/07_lavaOverLava_errors.log

- name: Rest Provider All Logs
if: always()
run: grep "" testutil/e2e/logs/08_restProvider* --exclude="*errors*"

- name: Rest Provider Error Only Logs
if: always()
continue-on-error: true
run: grep "" testutil/e2e/logs/08_restProvider* --include="*errors*"

- name: GRPC Provider All Logs
if: always()
run: grep "" testutil/e2e/logs/10_grpcProvider* --exclude="*errors*"

- name: GRPC Provider Error Only Logs
if: always()
continue-on-error: true
run: grep "" testutil/e2e/logs/10_grpcProvider* --include="*errors*"

- name: RPCConsumer Consumer All Logs
if: always()
run: cat testutil/e2e/logs/06_RPCConsumer.log
Expand Down
6 changes: 1 addition & 5 deletions .github/workflows/protocol_tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -61,8 +61,4 @@ jobs:
### Run protocol unitests
######################################################
- name: Run Lava Protocol Tests
run: go test ./protocol/... -v
- name: Run Lava Chain Proxy Tests
run: go test ./relayer/chainproxy/ -v
- name: Run Relayer Metrics Unit Tests
run: go test ./relayer/metrics/ -v
run: go test ./protocol/... -v
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -26,4 +26,5 @@ testutil/debugging/

# Misc
scripts/vars/
rpcprovider.yml
rpcconsumer.yml
3 changes: 1 addition & 2 deletions .golangci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,7 @@ run:
# timeout for analysis, e.g. 30s, 5m, default is 1m
timeout: 5m
skip-files:
- "relayer/chainproxy/thirdparty/*"
- "relayer/chainproxy/grpc.go"
- "protocol/chainlib/chainproxy/rpcInterfaceMessages/grpcMessage.go"
- "protocol/chainlib/chainproxy/thirdparty/*"
- "protocol/chainlib/grpc.go"

Expand Down
2 changes: 1 addition & 1 deletion Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -168,7 +168,7 @@ ifeq (static,$(findstring static,$(LAVA_BUILD_OPTIONS)))
endif

ifeq (mask_consumer_logs,$(findstring mask_consumer_logs,$(LAVA_BUILD_OPTIONS)))
ldflags += -X github.com/lavanet/lava/relayer/chainproxy.ReturnMaskedErrors=true
ldflags += -X github.com/lavanet/lava/protocol/common.ReturnMaskedErrors=true
endif
ifeq (debug_mutex,$(findstring debug_mutex,$(LAVA_BUILD_OPTIONS)))
ldflags += -X github.com/lavanet/lava/utils.TimeoutMutex=true
Expand Down
Loading