Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML] Machine Learning - Import Data -> Allow for multiple file upload #58190

Open
cmk1523 opened this issue Feb 20, 2020 · 2 comments
Open

[ML] Machine Learning - Import Data -> Allow for multiple file upload #58190

cmk1523 opened this issue Feb 20, 2020 · 2 comments
Assignees
Labels
Feature:File and Index Data Viz ML file and index data visualizer :ml

Comments

@cmk1523
Copy link

cmk1523 commented Feb 20, 2020

In the machine learning section of Kibana, I'd like to see support for importing of multiple files not just one.

The use case:
Any given kibana user wants to upload multiple similarly structured json files in order to not have to import each one individually. Kibana should treat multiple files as one if possible (e.g. files that have multiple lines of json documents). That should be possible for CSV data too. If columns or fields don't match, they can be detected as "new" fields within the machine learning system.

@tsullivan tsullivan added the :ml label Feb 24, 2020
@elasticmachine
Copy link
Contributor

Pinging @elastic/ml-ui (:ml)

@peteharverson peteharverson changed the title Machine Learning - Import Data -> Allow for multiple file upload [ML] Machine Learning - Import Data -> Allow for multiple file upload Feb 25, 2020
@peteharverson peteharverson added the Feature:File and Index Data Viz ML file and index data visualizer label Feb 25, 2020
@jgowdyelastic
Copy link
Member

jgowdyelastic commented Feb 25, 2020

#58152 has just been added to allow follow up files to be uploaded to the same index using Filebeat.
This would supply some of the functionality asked for here, albeit in a way that isn't quite as convenient.
It's worth noting that the file data visualizer feature is not intended as a replacement for the normal bulk ingest processes, but as convenient way to get some data quickly into es.
With this new PR, the index and ingest pipeline can be easily reused for ingesting the rest of the users data.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature:File and Index Data Viz ML file and index data visualizer :ml
Projects
None yet
Development

No branches or pull requests

5 participants