Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

added thread pool to tabix operations #1755

Merged
merged 1 commit into from
Mar 7, 2024
Merged

Conversation

vasudeva8
Copy link
Contributor

Fixes #1735.
Added option to provide number threads to use, disabled by default.
Uses the thread pool in operations except listing of sequence names (-l).

@vasudeva8
Copy link
Contributor Author

it showed ~40% improvement in indexing and data retrieval on bed/sam files and ~15% on vcf files.

tabix.1 Outdated
@@ -78,6 +78,8 @@ and BAI index formats can handle individual chromosomes up to 512 Mbp
If your input file might contain data lines with begin or end positions
greater than that, you will need to use a CSI index.

A thread pool can be used for operations except listing sequence names.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggestion, change "thread pool" to "threads". "thread pool" is more of an internal name.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also, do the same in the other places in the man file where "thread pool" is used.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated and rephrased.

@vasudeva8 vasudeva8 force-pushed the tabix_mt branch 2 times, most recently from 0eaacc9 to b913bfd Compare March 6, 2024 10:45
@vasudeva8
Copy link
Contributor Author

Updated tests as well.

@whitwham whitwham merged commit 255dfcb into samtools:develop Mar 7, 2024
9 checks passed
@vasudeva8 vasudeva8 deleted the tabix_mt branch March 14, 2024 11:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

feature request: parallelize tabix
2 participants