Enhance state-indexer compatibility with NEAR Lake and NEAR Indexer Framework
#188
Assignees
Labels
Comments
|
I've realized that having the |
github-merge-queue bot
pushed a commit
to near/nearcore
that referenced
this issue
Mar 1, 2024
…ng Optimistic Blocks (#10692) Hello everyone! This pull request addresses two urgent tasks related to our project's [Read RPC](https://github.com/near/read-rpc) functionality. [Issue 1](near/read-rpc#188): Making our state-indexer compatible with the near-indexer to eliminate the 3-second delay caused by [Lake-framework](https://github.com/near/near-lake-framework-rs). This compatibility enhancement ensures smoother and more efficient operation of our system by removing unnecessary delays. [Issue 2](near/read-rpc#186): Enhancing our service to handle requests for optimistic blocks directly, without proxying to nodes. This optimization streamlines the process, improving response times and overall system performance. To achieve these tasks, modifications have been made to the near-indexer. Specifically, the `build_streamer_message` method has been made public to facilitate the creation of `StreamerMessage` for optimistic blocks. This pull request aims to enhance the reliability, efficiency, and performance of our Read RPC functionality, addressing critical needs within our project.
kobayurii
added a commit
to kobayurii/nearcore
that referenced
this issue
Mar 20, 2024
…ng Optimistic Blocks (near#10692) Hello everyone! This pull request addresses two urgent tasks related to our project's [Read RPC](https://github.com/near/read-rpc) functionality. [Issue 1](near/read-rpc#188): Making our state-indexer compatible with the near-indexer to eliminate the 3-second delay caused by [Lake-framework](https://github.com/near/near-lake-framework-rs). This compatibility enhancement ensures smoother and more efficient operation of our system by removing unnecessary delays. [Issue 2](near/read-rpc#186): Enhancing our service to handle requests for optimistic blocks directly, without proxying to nodes. This optimization streamlines the process, improving response times and overall system performance. To achieve these tasks, modifications have been made to the near-indexer. Specifically, the `build_streamer_message` method has been made public to facilitate the creation of `StreamerMessage` for optimistic blocks. This pull request aims to enhance the reliability, efficiency, and performance of our Read RPC functionality, addressing critical needs within our project.
khorolets
pushed a commit
to near/nearcore
that referenced
this issue
Apr 9, 2024
…ng Optimistic Blocks (#10692) Hello everyone! This pull request addresses two urgent tasks related to our project's [Read RPC](https://github.com/near/read-rpc) functionality. [Issue 1](near/read-rpc#188): Making our state-indexer compatible with the near-indexer to eliminate the 3-second delay caused by [Lake-framework](https://github.com/near/near-lake-framework-rs). This compatibility enhancement ensures smoother and more efficient operation of our system by removing unnecessary delays. [Issue 2](near/read-rpc#186): Enhancing our service to handle requests for optimistic blocks directly, without proxying to nodes. This optimization streamlines the process, improving response times and overall system performance. To achieve these tasks, modifications have been made to the near-indexer. Specifically, the `build_streamer_message` method has been made public to facilitate the creation of `StreamerMessage` for optimistic blocks. This pull request aims to enhance the reliability, efficiency, and performance of our Read RPC functionality, addressing critical needs within our project.
kobayurii
added a commit
to kobayurii/nearcore
that referenced
this issue
Apr 9, 2024
…ng Optimistic Blocks (near#10692) Hello everyone! This pull request addresses two urgent tasks related to our project's [Read RPC](https://github.com/near/read-rpc) functionality. [Issue 1](near/read-rpc#188): Making our state-indexer compatible with the near-indexer to eliminate the 3-second delay caused by [Lake-framework](https://github.com/near/near-lake-framework-rs). This compatibility enhancement ensures smoother and more efficient operation of our system by removing unnecessary delays. [Issue 2](near/read-rpc#186): Enhancing our service to handle requests for optimistic blocks directly, without proxying to nodes. This optimization streamlines the process, improving response times and overall system performance. To achieve these tasks, modifications have been made to the near-indexer. Specifically, the `build_streamer_message` method has been made public to facilitate the creation of `StreamerMessage` for optimistic blocks. This pull request aims to enhance the reliability, efficiency, and performance of our Read RPC functionality, addressing critical needs within our project.
kobayurii
added a commit
to kobayurii/nearcore
that referenced
this issue
Apr 23, 2024
…ng Optimistic Blocks (near#10692) Hello everyone! This pull request addresses two urgent tasks related to our project's [Read RPC](https://github.com/near/read-rpc) functionality. [Issue 1](near/read-rpc#188): Making our state-indexer compatible with the near-indexer to eliminate the 3-second delay caused by [Lake-framework](https://github.com/near/near-lake-framework-rs). This compatibility enhancement ensures smoother and more efficient operation of our system by removing unnecessary delays. [Issue 2](near/read-rpc#186): Enhancing our service to handle requests for optimistic blocks directly, without proxying to nodes. This optimization streamlines the process, improving response times and overall system performance. To achieve these tasks, modifications have been made to the near-indexer. Specifically, the `build_streamer_message` method has been made public to facilitate the creation of `StreamerMessage` for optimistic blocks. This pull request aims to enhance the reliability, efficiency, and performance of our Read RPC functionality, addressing critical needs within our project.
khorolets
pushed a commit
to near/nearcore
that referenced
this issue
Apr 23, 2024
…ng Optimistic Blocks (#10692) Hello everyone! This pull request addresses two urgent tasks related to our project's [Read RPC](https://github.com/near/read-rpc) functionality. [Issue 1](near/read-rpc#188): Making our state-indexer compatible with the near-indexer to eliminate the 3-second delay caused by [Lake-framework](https://github.com/near/near-lake-framework-rs). This compatibility enhancement ensures smoother and more efficient operation of our system by removing unnecessary delays. [Issue 2](near/read-rpc#186): Enhancing our service to handle requests for optimistic blocks directly, without proxying to nodes. This optimization streamlines the process, improving response times and overall system performance. To achieve these tasks, modifications have been made to the near-indexer. Specifically, the `build_streamer_message` method has been made public to facilitate the creation of `StreamerMessage` for optimistic blocks. This pull request aims to enhance the reliability, efficiency, and performance of our Read RPC functionality, addressing critical needs within our project.
kobayurii
added a commit
to kobayurii/nearcore
that referenced
this issue
May 13, 2024
…ng Optimistic Blocks (near#10692) Hello everyone! This pull request addresses two urgent tasks related to our project's [Read RPC](https://github.com/near/read-rpc) functionality. [Issue 1](near/read-rpc#188): Making our state-indexer compatible with the near-indexer to eliminate the 3-second delay caused by [Lake-framework](https://github.com/near/near-lake-framework-rs). This compatibility enhancement ensures smoother and more efficient operation of our system by removing unnecessary delays. [Issue 2](near/read-rpc#186): Enhancing our service to handle requests for optimistic blocks directly, without proxying to nodes. This optimization streamlines the process, improving response times and overall system performance. To achieve these tasks, modifications have been made to the near-indexer. Specifically, the `build_streamer_message` method has been made public to facilitate the creation of `StreamerMessage` for optimistic blocks. This pull request aims to enhance the reliability, efficiency, and performance of our Read RPC functionality, addressing critical needs within our project.
kobayurii
added a commit
to kobayurii/nearcore
that referenced
this issue
May 13, 2024
…ng Optimistic Blocks (near#10692) Hello everyone! This pull request addresses two urgent tasks related to our project's [Read RPC](https://github.com/near/read-rpc) functionality. [Issue 1](near/read-rpc#188): Making our state-indexer compatible with the near-indexer to eliminate the 3-second delay caused by [Lake-framework](https://github.com/near/near-lake-framework-rs). This compatibility enhancement ensures smoother and more efficient operation of our system by removing unnecessary delays. [Issue 2](near/read-rpc#186): Enhancing our service to handle requests for optimistic blocks directly, without proxying to nodes. This optimization streamlines the process, improving response times and overall system performance. To achieve these tasks, modifications have been made to the near-indexer. Specifically, the `build_streamer_message` method has been made public to facilitate the creation of `StreamerMessage` for optimistic blocks. This pull request aims to enhance the reliability, efficiency, and performance of our Read RPC functionality, addressing critical needs within our project.
kobayurii
added a commit
to kobayurii/nearcore
that referenced
this issue
May 13, 2024
…ng Optimistic Blocks (near#10692) Hello everyone! This pull request addresses two urgent tasks related to our project's [Read RPC](https://github.com/near/read-rpc) functionality. [Issue 1](near/read-rpc#188): Making our state-indexer compatible with the near-indexer to eliminate the 3-second delay caused by [Lake-framework](https://github.com/near/near-lake-framework-rs). This compatibility enhancement ensures smoother and more efficient operation of our system by removing unnecessary delays. [Issue 2](near/read-rpc#186): Enhancing our service to handle requests for optimistic blocks directly, without proxying to nodes. This optimization streamlines the process, improving response times and overall system performance. To achieve these tasks, modifications have been made to the near-indexer. Specifically, the `build_streamer_message` method has been made public to facilitate the creation of `StreamerMessage` for optimistic blocks. This pull request aims to enhance the reliability, efficiency, and performance of our Read RPC functionality, addressing critical needs within our project.
kobayurii
added a commit
to kobayurii/nearcore
that referenced
this issue
May 13, 2024
…ng Optimistic Blocks (near#10692) Hello everyone! This pull request addresses two urgent tasks related to our project's [Read RPC](https://github.com/near/read-rpc) functionality. [Issue 1](near/read-rpc#188): Making our state-indexer compatible with the near-indexer to eliminate the 3-second delay caused by [Lake-framework](https://github.com/near/near-lake-framework-rs). This compatibility enhancement ensures smoother and more efficient operation of our system by removing unnecessary delays. [Issue 2](near/read-rpc#186): Enhancing our service to handle requests for optimistic blocks directly, without proxying to nodes. This optimization streamlines the process, improving response times and overall system performance. To achieve these tasks, modifications have been made to the near-indexer. Specifically, the `build_streamer_message` method has been made public to facilitate the creation of `StreamerMessage` for optimistic blocks. This pull request aims to enhance the reliability, efficiency, and performance of our Read RPC functionality, addressing critical needs within our project.
kobayurii
added a commit
to kobayurii/nearcore
that referenced
this issue
May 14, 2024
…ng Optimistic Blocks (near#10692) Hello everyone! This pull request addresses two urgent tasks related to our project's [Read RPC](https://github.com/near/read-rpc) functionality. [Issue 1](near/read-rpc#188): Making our state-indexer compatible with the near-indexer to eliminate the 3-second delay caused by [Lake-framework](https://github.com/near/near-lake-framework-rs). This compatibility enhancement ensures smoother and more efficient operation of our system by removing unnecessary delays. [Issue 2](near/read-rpc#186): Enhancing our service to handle requests for optimistic blocks directly, without proxying to nodes. This optimization streamlines the process, improving response times and overall system performance. To achieve these tasks, modifications have been made to the near-indexer. Specifically, the `build_streamer_message` method has been made public to facilitate the creation of `StreamerMessage` for optimistic blocks. This pull request aims to enhance the reliability, efficiency, and performance of our Read RPC functionality, addressing critical needs within our project.
kobayurii
added a commit
to kobayurii/nearcore
that referenced
this issue
May 14, 2024
…ng Optimistic Blocks (near#10692) Hello everyone! This pull request addresses two urgent tasks related to our project's [Read RPC](https://github.com/near/read-rpc) functionality. [Issue 1](near/read-rpc#188): Making our state-indexer compatible with the near-indexer to eliminate the 3-second delay caused by [Lake-framework](https://github.com/near/near-lake-framework-rs). This compatibility enhancement ensures smoother and more efficient operation of our system by removing unnecessary delays. [Issue 2](near/read-rpc#186): Enhancing our service to handle requests for optimistic blocks directly, without proxying to nodes. This optimization streamlines the process, improving response times and overall system performance. To achieve these tasks, modifications have been made to the near-indexer. Specifically, the `build_streamer_message` method has been made public to facilitate the creation of `StreamerMessage` for optimistic blocks. This pull request aims to enhance the reliability, efficiency, and performance of our Read RPC functionality, addressing critical needs within our project.
kobayurii
added a commit
to kobayurii/nearcore
that referenced
this issue
May 14, 2024
…ng Optimistic Blocks (near#10692) Hello everyone! This pull request addresses two urgent tasks related to our project's [Read RPC](https://github.com/near/read-rpc) functionality. [Issue 1](near/read-rpc#188): Making our state-indexer compatible with the near-indexer to eliminate the 3-second delay caused by [Lake-framework](https://github.com/near/near-lake-framework-rs). This compatibility enhancement ensures smoother and more efficient operation of our system by removing unnecessary delays. [Issue 2](near/read-rpc#186): Enhancing our service to handle requests for optimistic blocks directly, without proxying to nodes. This optimization streamlines the process, improving response times and overall system performance. To achieve these tasks, modifications have been made to the near-indexer. Specifically, the `build_streamer_message` method has been made public to facilitate the creation of `StreamerMessage` for optimistic blocks. This pull request aims to enhance the reliability, efficiency, and performance of our Read RPC functionality, addressing critical needs within our project.
kobayurii
added a commit
to kobayurii/nearcore
that referenced
this issue
May 14, 2024
…ng Optimistic Blocks (near#10692) Hello everyone! This pull request addresses two urgent tasks related to our project's [Read RPC](https://github.com/near/read-rpc) functionality. [Issue 1](near/read-rpc#188): Making our state-indexer compatible with the near-indexer to eliminate the 3-second delay caused by [Lake-framework](https://github.com/near/near-lake-framework-rs). This compatibility enhancement ensures smoother and more efficient operation of our system by removing unnecessary delays. [Issue 2](near/read-rpc#186): Enhancing our service to handle requests for optimistic blocks directly, without proxying to nodes. This optimization streamlines the process, improving response times and overall system performance. To achieve these tasks, modifications have been made to the near-indexer. Specifically, the `build_streamer_message` method has been made public to facilitate the creation of `StreamerMessage` for optimistic blocks. This pull request aims to enhance the reliability, efficiency, and performance of our Read RPC functionality, addressing critical needs within our project.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
To improve the efficiency and responsiveness of ReadRPC, we aim to make the
state-indexercompatible with both NEAR Lake and NEAR Indexer Framework. NEAR Lake-based indexers are known for their lightweight design, cost-effectiveness, and ease of maintenance. However, they inherently introduce a ~3-second delay in data transfer to clients via S3. To address this, we propose developing different state-indexer binaries: one for NEAR Lake and another for the NEAR Indexer Framework. This approach will allow us to maintain the advantages of NEAR Lake while significantly reducing data transfer delays by leveraging anearcore-basedstate-indexer.The ultimate goal is to provide ReadRPC and regular RPC node users with the most recent data, mimicking the immediacy expected from NEAR's native RPC.
The text was updated successfully, but these errors were encountered: