Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML] Move Index Data Visualizer into separate plugin (Part 1) #100922

Merged
merged 59 commits into from
Jun 8, 2021
Merged
Show file tree
Hide file tree
Changes from 47 commits
Commits
Show all changes
59 commits
Select commit Hold shift + click to select a range
c0ad968
[ML] Add index visualizer
qn895 May 25, 2021
cb3408d
[ML] Readd support for global state
qn895 May 25, 2021
ed3e3dc
[ML] Add time buckets & fix dependencies
qn895 May 26, 2021
593d862
[ML] Working ver
qn895 May 26, 2021
751512b
[ML] Add back and boolean support
qn895 May 26, 2021
101f26b
[ML] Remove old files inside ml
qn895 May 26, 2021
aa35249
[ML] Rename files
qn895 May 27, 2021
f201863
[ML] Move field type icon
qn895 May 27, 2021
6630d2e
[ML] Create new folder structure
qn895 May 27, 2021
d0b713c
[ML] Organize index_data_visualizer
qn895 May 27, 2021
8b7d221
[ML] Move types into index_data_visualizer folder
qn895 May 27, 2021
c81c986
[ML] Move more files into file_data_visualizer
qn895 May 27, 2021
64a663e
[ML] Move more files into index_data_visualizer
qn895 May 27, 2021
8b7cb47
[ML] Add new data visualizer model
qn895 May 27, 2021
c3d1ad9
[ML] Remove getVisualizerFieldStats which is not used by dv
qn895 May 27, 2021
0d12c91
[ML] Delete redundant folder
qn895 May 27, 2021
f343a9e
[ML] Copy old data visualizer routes to new plugin
qn895 May 27, 2021
a8aaf36
[ML] Remove old routes
qn895 May 27, 2021
9e07266
[ML] Disable for ml job cards tests for now
qn895 May 27, 2021
89c916e
[ML] Remove todos
qn895 May 28, 2021
bd30435
[ML] Move the toast error to the UI component
qn895 May 28, 2021
df79e21
[ML] Fix map styling
qn895 May 28, 2021
adbcaac
[ML] Add runtime_mappings for internal/file_upload/time_field_range
qn895 May 28, 2021
ef65d20
[ML] Move routes into folder
qn895 May 28, 2021
25b0f57
[ML] Update permissions
qn895 May 28, 2021
21a460f
[ML] Update texts
qn895 May 28, 2021
7d4a71d
[ML] Update schemas import and api get_field_stats
qn895 May 28, 2021
6443020
[ML] Reorg folders into common
qn895 May 28, 2021
37b3854
Merge remote-tracking branch 'upstream/master' into ml-move-index-dat…
qn895 Jun 1, 2021
ebf33b4
[ML] Update types & tests
qn895 Jun 1, 2021
9512da4
[ML] Update internal/data_visualizer permissions and action panel tests
qn895 Jun 2, 2021
314dc01
Merge upstream/main into branch
qn895 Jun 2, 2021
5e81e92
[ML] Update imports after #100863
qn895 Jun 2, 2021
d501b6f
[ML] Fix CI
qn895 Jun 2, 2021
035b8b4
[ML] Rename folder from file_data_visualizer to data_visualizer
qn895 Jun 3, 2021
88e3ea9
[ML] Rename i18n ids
qn895 Jun 3, 2021
202a077
[ML] Update fileDataVisualizer -> dataVisualizer dependency name in m…
qn895 Jun 3, 2021
76b7dff
[ML] Remove ml prefix in data test subjs
qn895 Jun 3, 2021
9999339
[ML] Fix settings and docs
qn895 Jun 3, 2021
4345951
[ML] Update plugin description
qn895 Jun 4, 2021
30b0f77
[ML] Remove mlContext dependency completely
qn895 Jun 4, 2021
862dfde
[ML] Set query to optional
qn895 Jun 4, 2021
82b97e0
Revert "[ML] Update plugin description"
qn895 Jun 4, 2021
893c4ab
[ML] Update plugins list docs
qn895 Jun 4, 2021
e1ab287
[ML] Fix types and i18n
qn895 Jun 4, 2021
4eb627e
Merge remote-tracking branch 'upstream/master' into ml-move-index-dat…
qn895 Jun 4, 2021
200f874
Merge branch 'master' into ml-move-index-data-visualizer
kibanamachine Jun 6, 2021
aaf142c
[ML] Revert ml data test subj/class name changes
qn895 Jun 7, 2021
403a8e3
[ML] Split up data visualizer model, remove Logger
qn895 Jun 7, 2021
76a7b5b
[ML] Remove empty file and indexPatternFieldEditor
qn895 Jun 7, 2021
836b5eb
[ML] Move imports of file_upload
qn895 Jun 7, 2021
267d3b7
[ML] Update plugin dependencies
qn895 Jun 7, 2021
e976122
Merge upstream/main into branch
qn895 Jun 7, 2021
5149bf5
Re-add missing data_visualizer.json
qn895 Jun 7, 2021
b043d6e
Remove capabilities in data_visualizer
qn895 Jun 7, 2021
ee5f8ab
Fix test subjs
qn895 Jun 7, 2021
d978ee2
Update ownership for data_visualizer and file_upload code to be ml
qn895 Jun 8, 2021
a8e6fbd
Merge upstream/main into branch
qn895 Jun 8, 2021
71e4db8
Update estypes after 98266
qn895 Jun 8, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
File renamed without changes.
84 changes: 42 additions & 42 deletions api_docs/file_data_visualizer.json
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
{
"id": "fileDataVisualizer",
"id": "dataVisualizer",
"client": {
"classes": [],
"functions": [],
Expand All @@ -8,17 +8,17 @@
"misc": [],
"objects": [],
"start": {
"parentPluginId": "fileDataVisualizer",
"id": "def-public.FileDataVisualizerPluginStart",
"parentPluginId": "dataVisualizer",
"id": "def-public.DataVisualizerPluginStart",
"type": "Type",
"tags": [],
"label": "FileDataVisualizerPluginStart",
"label": "DataVisualizerPluginStart",
"description": [],
"signature": [
"{ getFileDataVisualizerComponent: () => Promise<React.FC<{}>>; getMaxBytesFormatted: () => string; }"
],
"source": {
"path": "x-pack/plugins/file_data_visualizer/public/plugin.ts",
"path": "x-pack/plugins/data_visualizer/public/plugin.ts",
"lineNumber": 33
},
"deprecated": false,
Expand All @@ -39,72 +39,72 @@
"functions": [],
"interfaces": [
{
"parentPluginId": "fileDataVisualizer",
"parentPluginId": "dataVisualizer",
"id": "def-common.DataVisualizerTableState",
"type": "Interface",
"tags": [],
"label": "DataVisualizerTableState",
"description": [],
"source": {
"path": "x-pack/plugins/file_data_visualizer/common/types.ts",
"path": "x-pack/plugins/data_visualizer/common/types.ts",
"lineNumber": 14
},
"deprecated": false,
"children": [
{
"parentPluginId": "fileDataVisualizer",
"parentPluginId": "dataVisualizer",
"id": "def-common.DataVisualizerTableState.pageSize",
"type": "number",
"tags": [],
"label": "pageSize",
"description": [],
"source": {
"path": "x-pack/plugins/file_data_visualizer/common/types.ts",
"path": "x-pack/plugins/data_visualizer/common/types.ts",
"lineNumber": 15
},
"deprecated": false
},
{
"parentPluginId": "fileDataVisualizer",
"parentPluginId": "dataVisualizer",
"id": "def-common.DataVisualizerTableState.pageIndex",
"type": "number",
"tags": [],
"label": "pageIndex",
"description": [],
"source": {
"path": "x-pack/plugins/file_data_visualizer/common/types.ts",
"path": "x-pack/plugins/data_visualizer/common/types.ts",
"lineNumber": 16
},
"deprecated": false
},
{
"parentPluginId": "fileDataVisualizer",
"parentPluginId": "dataVisualizer",
"id": "def-common.DataVisualizerTableState.sortField",
"type": "string",
"tags": [],
"label": "sortField",
"description": [],
"source": {
"path": "x-pack/plugins/file_data_visualizer/common/types.ts",
"path": "x-pack/plugins/data_visualizer/common/types.ts",
"lineNumber": 17
},
"deprecated": false
},
{
"parentPluginId": "fileDataVisualizer",
"parentPluginId": "dataVisualizer",
"id": "def-common.DataVisualizerTableState.sortDirection",
"type": "string",
"tags": [],
"label": "sortDirection",
"description": [],
"source": {
"path": "x-pack/plugins/file_data_visualizer/common/types.ts",
"path": "x-pack/plugins/data_visualizer/common/types.ts",
"lineNumber": 18
},
"deprecated": false
},
{
"parentPluginId": "fileDataVisualizer",
"parentPluginId": "dataVisualizer",
"id": "def-common.DataVisualizerTableState.visibleFieldTypes",
"type": "Array",
"tags": [],
Expand All @@ -114,13 +114,13 @@
"string[]"
],
"source": {
"path": "x-pack/plugins/file_data_visualizer/common/types.ts",
"path": "x-pack/plugins/data_visualizer/common/types.ts",
"lineNumber": 19
},
"deprecated": false
},
{
"parentPluginId": "fileDataVisualizer",
"parentPluginId": "dataVisualizer",
"id": "def-common.DataVisualizerTableState.visibleFieldNames",
"type": "Array",
"tags": [],
Expand All @@ -130,20 +130,20 @@
"string[]"
],
"source": {
"path": "x-pack/plugins/file_data_visualizer/common/types.ts",
"path": "x-pack/plugins/data_visualizer/common/types.ts",
"lineNumber": 20
},
"deprecated": false
},
{
"parentPluginId": "fileDataVisualizer",
"parentPluginId": "dataVisualizer",
"id": "def-common.DataVisualizerTableState.showDistributions",
"type": "boolean",
"tags": [],
"label": "showDistributions",
"description": [],
"source": {
"path": "x-pack/plugins/file_data_visualizer/common/types.ts",
"path": "x-pack/plugins/data_visualizer/common/types.ts",
"lineNumber": 21
},
"deprecated": false
Expand All @@ -155,7 +155,7 @@
"enums": [],
"misc": [
{
"parentPluginId": "fileDataVisualizer",
"parentPluginId": "dataVisualizer",
"id": "def-common.ABSOLUTE_MAX_FILE_SIZE_BYTES",
"type": "number",
"tags": [],
Expand All @@ -165,14 +165,14 @@
"1073741274"
],
"source": {
"path": "x-pack/plugins/file_data_visualizer/common/constants.ts",
"path": "x-pack/plugins/data_visualizer/common/constants.ts",
"lineNumber": 14
},
"deprecated": false,
"initialIsOpen": false
},
{
"parentPluginId": "fileDataVisualizer",
"parentPluginId": "dataVisualizer",
"id": "def-common.FILE_SIZE_DISPLAY_FORMAT",
"type": "string",
"tags": [],
Expand All @@ -182,14 +182,14 @@
"\"0,0.[0] b\""
],
"source": {
"path": "x-pack/plugins/file_data_visualizer/common/constants.ts",
"path": "x-pack/plugins/data_visualizer/common/constants.ts",
"lineNumber": 15
},
"deprecated": false,
"initialIsOpen": false
},
{
"parentPluginId": "fileDataVisualizer",
"parentPluginId": "dataVisualizer",
"id": "def-common.INDEX_META_DATA_CREATED_BY",
"type": "string",
"tags": [],
Expand All @@ -199,14 +199,14 @@
"\"file-data-visualizer\""
],
"source": {
"path": "x-pack/plugins/file_data_visualizer/common/constants.ts",
"path": "x-pack/plugins/data_visualizer/common/constants.ts",
"lineNumber": 19
},
"deprecated": false,
"initialIsOpen": false
},
{
"parentPluginId": "fileDataVisualizer",
"parentPluginId": "dataVisualizer",
"id": "def-common.InputData",
"type": "Type",
"tags": [],
Expand All @@ -216,14 +216,14 @@
"any[]"
],
"source": {
"path": "x-pack/plugins/file_data_visualizer/common/types.ts",
"path": "x-pack/plugins/data_visualizer/common/types.ts",
"lineNumber": 10
},
"deprecated": false,
"initialIsOpen": false
},
{
"parentPluginId": "fileDataVisualizer",
"parentPluginId": "dataVisualizer",
"id": "def-common.JobFieldType",
"type": "Type",
"tags": [],
Expand All @@ -233,14 +233,14 @@
"\"number\" | \"boolean\" | \"date\" | \"text\" | \"keyword\" | \"ip\" | \"geo_point\" | \"geo_shape\" | \"unknown\""
],
"source": {
"path": "x-pack/plugins/file_data_visualizer/common/types.ts",
"path": "x-pack/plugins/data_visualizer/common/types.ts",
"lineNumber": 12
},
"deprecated": false,
"initialIsOpen": false
},
{
"parentPluginId": "fileDataVisualizer",
"parentPluginId": "dataVisualizer",
"id": "def-common.MAX_FILE_SIZE",
"type": "string",
"tags": [],
Expand All @@ -250,14 +250,14 @@
"\"100MB\""
],
"source": {
"path": "x-pack/plugins/file_data_visualizer/common/constants.ts",
"path": "x-pack/plugins/data_visualizer/common/constants.ts",
"lineNumber": 11
},
"deprecated": false,
"initialIsOpen": false
},
{
"parentPluginId": "fileDataVisualizer",
"parentPluginId": "dataVisualizer",
"id": "def-common.MAX_FILE_SIZE_BYTES",
"type": "number",
"tags": [],
Expand All @@ -267,28 +267,28 @@
"104857600"
],
"source": {
"path": "x-pack/plugins/file_data_visualizer/common/constants.ts",
"path": "x-pack/plugins/data_visualizer/common/constants.ts",
"lineNumber": 12
},
"deprecated": false,
"initialIsOpen": false
},
{
"parentPluginId": "fileDataVisualizer",
"parentPluginId": "dataVisualizer",
"id": "def-common.MB",
"type": "number",
"tags": [],
"label": "MB",
"description": [],
"source": {
"path": "x-pack/plugins/file_data_visualizer/common/constants.ts",
"path": "x-pack/plugins/data_visualizer/common/constants.ts",
"lineNumber": 10
},
"deprecated": false,
"initialIsOpen": false
},
{
"parentPluginId": "fileDataVisualizer",
"parentPluginId": "dataVisualizer",
"id": "def-common.UI_SETTING_MAX_FILE_SIZE",
"type": "string",
"tags": [],
Expand All @@ -298,7 +298,7 @@
"\"fileUpload:maxFileSize\""
],
"source": {
"path": "x-pack/plugins/file_data_visualizer/common/constants.ts",
"path": "x-pack/plugins/data_visualizer/common/constants.ts",
"lineNumber": 8
},
"deprecated": false,
Expand All @@ -307,7 +307,7 @@
],
"objects": [
{
"parentPluginId": "fileDataVisualizer",
"parentPluginId": "dataVisualizer",
"id": "def-common.JOB_FIELD_TYPES",
"type": "Object",
"tags": [],
Expand All @@ -317,12 +317,12 @@
"{ readonly BOOLEAN: \"boolean\"; readonly DATE: \"date\"; readonly GEO_POINT: \"geo_point\"; readonly GEO_SHAPE: \"geo_shape\"; readonly IP: \"ip\"; readonly KEYWORD: \"keyword\"; readonly NUMBER: \"number\"; readonly TEXT: \"text\"; readonly UNKNOWN: \"unknown\"; }"
],
"source": {
"path": "x-pack/plugins/file_data_visualizer/common/constants.ts",
"path": "x-pack/plugins/data_visualizer/common/constants.ts",
"lineNumber": 21
},
"deprecated": false,
"initialIsOpen": false
}
]
}
}
}
8 changes: 4 additions & 4 deletions docs/developer/plugin-list.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -369,6 +369,10 @@ The client-side plugin configures following values:
|The data_enhanced plugin is the x-pack counterpart to the src/plguins/data plugin.


|{kib-repo}blob/{branch}/x-pack/plugins/data_visualizer/README.md[dataVisualizer]
peteharverson marked this conversation as resolved.
Show resolved Hide resolved
|The data_visualizer plugin enables you to explore the fields in your data.


|{kib-repo}blob/{branch}/x-pack/plugins/discover_enhanced/README.md[discoverEnhanced]
|Contains the enhancements to the OSS discover app.

Expand Down Expand Up @@ -396,10 +400,6 @@ actitivies.
|The features plugin enhance Kibana with a per-feature privilege system.


|{kib-repo}blob/{branch}/x-pack/plugins/file_data_visualizer[fileDataVisualizer]
|WARNING: Missing README.


|{kib-repo}blob/{branch}/x-pack/plugins/file_upload[fileUpload]
|WARNING: Missing README.

Expand Down
2 changes: 1 addition & 1 deletion packages/kbn-optimizer/limits.yml
Original file line number Diff line number Diff line change
Expand Up @@ -105,7 +105,7 @@ pageLoadAssetSize:
indexPatternFieldEditor: 90489
osquery: 107090
fileUpload: 25664
fileDataVisualizer: 27530
dataVisualizer: 27530
banners: 17946
mapsEms: 26072
timelines: 28613
Expand Down
2 changes: 1 addition & 1 deletion x-pack/.i18nrc.json
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@
"xpack.endpoint": "plugins/endpoint",
"xpack.enterpriseSearch": "plugins/enterprise_search",
"xpack.features": "plugins/features",
"xpack.fileDataVisualizer": "plugins/file_data_visualizer",
"xpack.dataVisualizer": "plugins/data_visualizer",
"xpack.fileUpload": "plugins/file_upload",
"xpack.globalSearch": ["plugins/global_search"],
"xpack.globalSearchBar": ["plugins/global_search_bar"],
Expand Down
1 change: 1 addition & 0 deletions x-pack/plugins/data_visualizer/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
The data_visualizer plugin enables you to explore the fields in your data.
Original file line number Diff line number Diff line change
Expand Up @@ -29,3 +29,5 @@ export const JOB_FIELD_TYPES = {
TEXT: 'text',
UNKNOWN: 'unknown',
} as const;

export const OMIT_FIELDS: string[] = ['_source', '_type', '_index', '_id', '_version', '_score'];
Loading