Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Mikado serialise] Switch from simple pickling to uJSON/SQLite for BLAST loading #97

Closed
lucventurini opened this issue Jan 31, 2017 · 0 comments
Closed

[Mikado serialise] Switch from simple pickling to uJSON/SQLite for BLAST loading #97

lucventurini opened this issue Jan 31, 2017 · 0 comments
Assignees
@lucventurini
Labels
enhancement
Milestone
2.0

Comments

@lucventurini
Copy link
Collaborator

In the preparation step, switching from the default pickling to a slightly more involved model using SQLite and uJSON yielded better performance and much lower memory footprint. While not essential, it might be worthwhile to switch to this model for serialising as well.
@lucventurini lucventurini self-assigned this Mar 27, 2018
@lucventurini lucventurini added this to the 1.3 milestone Jan 28, 2019
lucventurini added a commit to lucventurini/mikado that referenced this issue Feb 11, 2021
@lucventurini
Fixed EI-CoreBioinformatics#97: now we will be using json dumps insid…
37adca7 
…e SQLite databases instead of pickling. Moving to master.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@lucventurini lucventurini

Labels
enhancement
Projects
None yet
Milestone
2.0
Development

No branches or pull requests
1 participant
@lucventurini