-
Notifications
You must be signed in to change notification settings - Fork 43
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
perf: Faster cde rejection (prerequires #87) #85
Conversation
Buffer the part we need to search over (last 64K of the file) so that we don't do a 4 byte read 65536 times.
Read large chunks of data at a time to dramatically cut down on syscalls. Add tests for various edge cases to validate.
…pr412a # Conflicts: # src/spec.rs
Signed-off-by: Chris Hennick <4961925+Pr0methean@users.noreply.github.com>
Rebased this PR because https://github.com/zip-rs/zip2/actions/runs/8945282269/job/24574475474?pr=85 wasn't going to finish before it timed out. |
Signed-off-by: Chris Hennick <4961925+Pr0methean@users.noreply.github.com>
Closing because this causes a severe performance regression in fuzz_read. |
Pull request was closed
Sorry I lost track of this, the pr moved several times. It's a significant improvement over the original code (in the 400x faster range)… Why didn't this get merged? Is there something I can do to help? |
Try redeveloping and retesting it against the current mainline. |
Signed-off-by: Chris Hennick <4961925+Pr0methean@users.noreply.github.com>
Signed-off-by: Chris Hennick <4961925+Pr0methean@users.noreply.github.com>
This replaces #47.