Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[kbn/optimizer/node] properly separate lmdb databases, log better #83849

Merged
merged 7 commits into from
Nov 20, 2020

Conversation

spalger
Copy link
Contributor

@spalger spalger commented Nov 19, 2020

The current lmdb-store implementation expects that lmdb-store won't throw an error when writing, and provides very little visibility into the operations of the cache. This updates the cache to write to a log file and write errors to stderr when things go wrong. Additionally, this switches the way that we're defining the sub-databases so that the argument structure we pass to lmdb-store is understood correctly. I'll work on a PR to lmdb-store once I'm done working on this.

@spalger spalger added release_note:skip Skip the PR/issue when compiling release notes Team:Operations Team label for Operations Team v7.11.0 v8.0.0 labels Nov 20, 2020
@spalger spalger marked this pull request as ready for review November 20, 2020 01:40
@spalger spalger requested a review from a team as a code owner November 20, 2020 01:40
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-operations (Team:Operations)

@kibanamachine
Copy link
Contributor

💚 Build Succeeded

Metrics [docs]

✅ unchanged

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

Copy link
Member

@mistic mistic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, just a small note: if there is any change the source maps we store in the smaps db could have buffers I think we will need to use https://www.npmjs.com/package/buffer-json

@spalger
Copy link
Contributor Author

spalger commented Nov 20, 2020

if there is any change the source maps we store in the smaps db could have buffers I think we will need to use npmjs.com/package/buffer-json

The source map objects are really simple and designed to be sent over the network to the browsers so they just have string/string[] properties and are relatively compact. Nothing to worry about:
image

@spalger spalger merged commit 0db0d95 into elastic:master Nov 20, 2020
@spalger spalger deleted the fix/lmdb-store-db-separation branch November 20, 2020 16:51
spalger added a commit to spalger/kibana that referenced this pull request Nov 20, 2020
…astic#83849)

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
spalger added a commit that referenced this pull request Nov 20, 2020
…er (#83849) (#83941)

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>

Co-authored-by: spalger <spalger@users.noreply.github.com>
Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release_note:skip Skip the PR/issue when compiling release notes Team:Operations Team label for Operations Team v7.11.0 v8.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants