Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add benchmark + improve performance #257

Open
wants to merge 11 commits into
base: main
Choose a base branch
from
Open

Add benchmark + improve performance #257

wants to merge 11 commits into from

Conversation

evoxmusic
Copy link
Contributor

@evoxmusic evoxmusic commented Jan 18, 2023

WIP to add benchmark and improve tokeniser and subset performances

@evoxmusic evoxmusic changed the title Add benchmark Add benchmark + improve performance Jan 23, 2023
@pranas
Copy link

pranas commented Jul 21, 2023

How far along is this upgrade? We just tried using Replibyte and found it to be very slow at the moment.

@ikegentz
Copy link

ikegentz commented Aug 23, 2023

I built off of this branch hoping the performance would be improved. Unfortunately it was the same, if not worse. When creating a dump, it'll progress at 22Mib/min.

#266

It DOES however, seem to fix the "getting killed after 300Mb bug", so might still be worth merging for that alone

@olivierboudet
Copy link

hi, is there any news on performance improvements ? It"s actually difficult to create a dump in a reasonable time and without memory issues.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants