Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Impl threading because of I/O bound nature of the script #5

Open
storenth opened this issue Sep 1, 2024 · 1 comment
Open

Impl threading because of I/O bound nature of the script #5

storenth opened this issue Sep 1, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@storenth
Copy link
Owner

storenth commented Sep 1, 2024

CPU is fast, but disk 100500x times slower, so we don't want to wait until it respond. The edge case:

cat subs1.txt subs2.txt ... subsN.txt | ./src/pnk/__main__.py
@storenth storenth added the enhancement New feature or request label Sep 1, 2024
@storenth
Copy link
Owner Author

storenth commented Sep 1, 2024

Create large list, perform cPofile, split txt, perform cPofile, file the src/tests/PERF_PROBES.md for v3.0.0 before impl.

storenth added a commit that referenced this issue Sep 2, 2024
@storenth
test: lists for profiling before/after threading (#5)
419650a
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@storenth