Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Ingest pipelines] add network direction processor #103436

Merged
merged 23 commits into from
Jul 13, 2021

Conversation

sabarasaba
Copy link
Member

@sabarasaba sabarasaba commented Jun 28, 2021

Fixes: #90709

Release Note

The Ingest Node Pipelines UI added support to configure a network direction processor. This processor calculates the network direction given a source IP address, destination IP address, and a list of internal networks.

Default description

Screenshot 2021-06-30 at 08 26 06

New processor fields

Screenshot 2021-06-30 at 08 25 45

Screenshot 2021-06-30 at 08 25 55

@sabarasaba sabarasaba self-assigned this Jun 28, 2021
@sabarasaba
Copy link
Member Author

@elasticmachine merge upstream

@sabarasaba sabarasaba added Feature:Ingest Node Pipelines Ingest node pipelines management release_note:feature Makes this part of the condensed release notes Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more v7.15.0 v8.0.0 labels Jun 30, 2021
@sabarasaba sabarasaba requested a review from sebelga June 30, 2021 06:00
@sabarasaba sabarasaba marked this pull request as ready for review June 30, 2021 06:02
@sabarasaba sabarasaba requested a review from a team as a code owner June 30, 2021 06:02
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-stack-management (Team:Stack Management)

@sabarasaba
Copy link
Member Author

@elasticmachine merge upstream

Copy link
Contributor

@sebelga sebelga left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great work @sabarasaba ! Tested locally and works as expected 👍

As I looked at how you had to work around getting the isCustom state initial value I decided that the best was that the form would expose the handler to read the defaultValue of a field. This way we don't need to rely on useEffect to modify the value of the state.

I also had another look at the problem of eagerly merging any prop coming "in" that are not returned by the form. I found it more complex what you had in place (having to manually set the field value then reset the field and use a <UseMultiField />) instead of manually listing the fields that we don't want to be merged back in.

I created a PR with my suggestion sabarasaba#1, feel free to comment there and merge it if you are happy. 👍

…ode_review

Add network direction processor  code review
@sabarasaba
Copy link
Member Author

@elasticmachine merge upstream

@sabarasaba sabarasaba requested review from a team as code owners July 5, 2021 09:23
Copy link
Member

@cnasikas cnasikas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Security solution changes LGTM!

@sebelga sebelga self-requested a review July 12, 2021 08:44
Copy link
Contributor

@sebelga sebelga left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changes LGTM! 🎉

@sabarasaba
Copy link
Member Author

@elasticmachine merge upstream

@kibanamachine
Copy link
Contributor

💚 Build Succeeded

Metrics [docs]

Module Count

Fewer modules leads to a faster build time

id before after diff
ingestPipelines 494 495 +1

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
ingestPipelines 687.9KB 695.1KB +7.2KB

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id before after diff
esUiShared 192.1KB 192.1KB -12.0B

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

cc @sabarasaba

@sabarasaba sabarasaba merged commit 8c9de0b into elastic:master Jul 13, 2021
sabarasaba added a commit to sabarasaba/kibana that referenced this pull request Jul 13, 2021
* initial form setup

* custom solution with usemultifields

* wip: sort of working now

* fix bootstraping of initial state

* fix field validation

* add tests

* fix linter errors

* Fix i18 namespace

* Fix linter problems and remove unused whitelisting

* Fix copy for description

* lil prettier fix

* add docs and tweak copy

* small tweaks

* [Form lib] expose handler to access field defaultValue

* Refactor <NetworkDirection />

* fix up import orders

* Fix test mocks

* Move up mocks a bit

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Sébastien Loix <sabee77@gmail.com>
sabarasaba added a commit that referenced this pull request Jul 13, 2021
* initial form setup

* custom solution with usemultifields

* wip: sort of working now

* fix bootstraping of initial state

* fix field validation

* add tests

* fix linter errors

* Fix i18 namespace

* Fix linter problems and remove unused whitelisting

* Fix copy for description

* lil prettier fix

* add docs and tweak copy

* small tweaks

* [Form lib] expose handler to access field defaultValue

* Refactor <NetworkDirection />

* fix up import orders

* Fix test mocks

* Move up mocks a bit

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Sébastien Loix <sabee77@gmail.com>

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Sébastien Loix <sabee77@gmail.com>
jloleysens added a commit to jloleysens/kibana that referenced this pull request Jul 13, 2021
…-png-pdf-report-type

* 'master' of github.com:elastic/kibana: (292 commits)
  bring back KQL autocomplete in timeline + fix last updated (elastic#105380)
  [Maps] Change TOC pop-up wording to reflect filter change, not search bar change (elastic#105163)
  Updating urls to upstream elastic repo (elastic#105250)
  [Maps] Move new vector layer wizard card down (elastic#104797)
  Exclude registering the cases feature if not enabled (elastic#105292)
  [Uptime] Alerts - Monitor status alert - check monitor status by monitor.timespan (elastic#104541)
  updated UI copy (elastic#105184)
  Log a warning when documents of unknown types are detected during migration (elastic#105213)
  [Logs UI] Register log threshold rule as lifecycle rule (elastic#104341)
  [Ingest pipelines] add network direction processor (elastic#103436)
  [Console] Autocomplete definitions (manual backport) (elastic#105086)
  [Security Solution] User can make Exceptions for Memory protection alerts (elastic#102196)
  [Lens] Formula: add validation for multiple field/metrics (elastic#104092)
  Removing async from file upload and data visualizer plugins start lifecycle (elastic#105197)
  Fix error when validating the form with non blocking validations (elastic#103629)
  [ML] Fix "View by" swim lane with applied filter and sorting by score  (elastic#105217)
  Update dependency @elastic/charts to v32 (elastic#104625)
  [CTI] shortens large numbers on Dashboard Link Panel (elastic#105269)
  [Security Solution][Endpoint][Host Isolation] Fixes bug to remove excess host metadata status toasts on non user initiated errors (elastic#105331)
  [Cases] Fix pushing alerts count on every push to external service (elastic#105030)
  ...

# Conflicts:
#	x-pack/plugins/reporting/common/types.ts
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature:Ingest Node Pipelines Ingest node pipelines management release_note:feature Makes this part of the condensed release notes Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more v7.15.0 v8.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add support for network direction processor
5 participants