Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Output to file immediately? #18

Closed
homocomputeris opened this issue Sep 29, 2024 · 4 comments
Closed

Output to file immediately? #18

homocomputeris opened this issue Sep 29, 2024 · 4 comments
Labels
question Further information is requested

Comments

@homocomputeris
Copy link

Can btac stream results to the output file immediately? Sometimes it hangs on, say, 92% for hours, and there is no output file.

Alternatively, where are the intermediate results are stored?

@dlesbre
Copy link
Owner

dlesbre commented Sep 29, 2024

Intermediate results are only stored in RAM at the moment. However, if you interrupt the program by Ctrl+C, it should dump everything to a new temporary file, whose path is printed on the terminal.

Some data is still lost in this process, as only entries for which all queries have been completed have been processed. If an entry only has query result from 7/8 sources, these are lost when interrupting.

@homocomputeris
Copy link
Author

homocomputeris commented Sep 29, 2024

it should dump everything to a new temporary file, whose path is printed on the terminal.

Does it contain all entries (like, completely everything) or only the processed ones?

@dlesbre
Copy link
Owner

dlesbre commented Sep 30, 2024

It contains all entries, so its safe to replace your input file with the dump. It should tell you how many were completed (which isn't very convenient I know, I'm working on changing it to show the id of the last completed entry).

Note that if you run btac on multiple files, it also concatenates all files into a single one when dumping to a temporary file.

@dlesbre dlesbre added the question Further information is requested label Sep 30, 2024
@homocomputeris
Copy link
Author

Great, thanks a lot!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants