Skip to content
This repository was archived by the owner on Jun 11, 2024. It is now read-only.

Implement a local counting based on the total queries count and the new log entries #16

Open
hjk789 opened this issue Aug 19, 2020 · 1 comment
Labels
New feature Requires study This feature is intended to be implemented, but still requires some more planning or research

Comments

@hjk789
Copy link
Owner

hjk789 commented Aug 19, 2020

This would allow many possibilities of statistical info, as the data is all stored in the script manager's database and accessible from the script. But it does need some study and planning first, as the database can get pretty heavy in configs with lots of devices that make lots of queries per minute.

@hjk789 hjk789 added Future feature This feature is intended to be implemented, but not soon Requires study This feature is intended to be implemented, but still requires some more planning or research labels Aug 19, 2020
@hjk789 hjk789 added New feature and removed Future feature This feature is intended to be implemented, but not soon labels Jan 31, 2021
@hjk789
Copy link
Owner Author

hjk789 commented Jan 31, 2021

Maybe the log export feature could help? Maybe, instead of doing the countings every time the analytics page is opened, it could be an on-demand feature, which would get the entire log and start counting until the most recent counted log entry, and when finished, only part of the data would be stored, such as only the 50 or 100 most queried domains, instead of everything. This way, whatever the number of queries per day, the amount of data stored would be of the same size, it just would take quite some time to finish processing though, but that's part.

So what would be stored would be: the top 50/100 most queried domains, and the timestamp of the most recent counted log entry.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
New feature Requires study This feature is intended to be implemented, but still requires some more planning or research
Projects
None yet
Development

No branches or pull requests

1 participant