Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data import API #5125

Closed
wants to merge 4 commits into from
Closed

Data import API #5125

wants to merge 4 commits into from

Conversation

SchrodingersGat
Copy link
Member

@SchrodingersGat SchrodingersGat commented Jun 30, 2023

Closes #3101

Provides an API-based data import tool using django-data-wizard

Tasks

  • Run data import using background worker
  • Preview imported data and allow user to confirm
  • Auto-assign columns based on previous import runs
  • API endpoints
  • Significant unit testing
  • Remove old clunky import code
  • Remove django-import-export integration entirely

@SchrodingersGat SchrodingersGat added enhancement This is an suggested enhancement or new feature api Relates to the API import / export Data importing, exporting and processing breaking Indicates a major update or change which breaks compatibility feature labels Jun 30, 2023
@SchrodingersGat SchrodingersGat added this to the 0.13.0 milestone Jun 30, 2023
@matmair
Copy link
Member

matmair commented Jun 30, 2023

@SchrodingersGat does django-data-wizard also replace the export options of django-import-export?

@SchrodingersGat
Copy link
Member Author

@SchrodingersGat does django-data-wizard also replace the export options of django-import-export?

Not directly, but if possible, I'd like to make use of our DRF serializers to format data for export. This way we remove a lot of duplication and custom code required to overcome the shortcomings of django-import-export

@matmair
Copy link
Member

matmair commented Jul 3, 2023

@SchrodingersGat seems like a lot of work to replace all the supported formats - especially excel - but interested to see how you go at it.

@SchrodingersGat
Copy link
Member Author

@SchrodingersGat seems like a lot of work to replace all the supported formats - especially excel - but interested to see how you go at it.

It requires some investigation :)

@matmair
Copy link
Member

matmair commented Sep 20, 2023

@SchrodingersGat is this approach not working? Should I make a try?

@SchrodingersGat SchrodingersGat restored the data-import-api branch September 20, 2023 23:57
@SchrodingersGat
Copy link
Member Author

I accidentally deleted the wrong branch :) Still active, just waiting until PUI is a bit further along

@SchrodingersGat SchrodingersGat modified the milestones: 0.13.0, 1.0.0 Oct 17, 2023
@SchrodingersGat SchrodingersGat mentioned this pull request Mar 21, 2024
9 tasks
@SchrodingersGat SchrodingersGat deleted the data-import-api branch May 13, 2024 03:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api Relates to the API breaking Indicates a major update or change which breaks compatibility enhancement This is an suggested enhancement or new feature feature import / export Data importing, exporting and processing
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[FR] Import tool refactor
2 participants