v.0.1.0

[swar]

v.0.1.0

The first feature packed improvement of the plot manager.

New Features

• Adding exclude_final_directory as an option in the config.yaml. (#35)
• Skipping manager.log as a file and renaming to debug.log. (#38)
• Added destination directory skipping when a drive is full using skip_full_destinations at the job level. It will calculate size of total running plots and the predicted size of the new plot prior to making that judgement. (#36, #193)
• Added global setting for max_for_phase_1.
• Added global setting for minimum_minutes_between_jobs. (#380, #468)
• Added list support for temporary directories. This will cycle through all temporary directories in the order that they are listed for a job. (#150, #153, #182)
• Added CPU affinity support on the job level. This allows you to select and dedicate specific threads to your jobs. (#134, #281)
• Added process priority levels on the job level. This allows you to set the priority levels to whatever you choose. Some people want low priority, while others want higher priorities. (#282)
• Added an option to delay a job by a set number of minutes. If you started manager and there is a stagger for the job, it will use the initial delay only if it is longer than the stagger. (#283)
• Added an option in manager.py to spit out a single instance of the view using the status argument as well as json format of the jobs. (#300, #374)
• Added support for Telegram notifications. (#316, #364)
• Added support for IFTTT webhooks. (#425, #471)
• Added support for instrumentation using Prometheus (#87, #196)

Changes

• Switching notification imports to a separate requirements file and turning them into lazy imports. (#159, 196)
• Reworked the Drives Table in the view to include associated jobs. This includes minor tweaks to the display to remove ambiguity such as renaming plots to "#". (#191, #368, #406)
• Adding basic checks that will break and have more detailed error messaging to assist in end-user interaction. Also, I was tired of getting the same repeat questions over and over again.
• Adding more psutil error handling.
• Jobs are now unique based on temporary directories.

Bug Fixes

• Fixed a bug where max_plots was not working properly. It was counting running plots when you restarted manager. Now it will only count new plots kicked off.
• Fixed a bug in elapsed_time column where elapsed days greater than 24 hours were resulting in calculations being off by a day. (#190)
• Skipping processes that result in an AccessDenied error when finding manager processes. (#147)
• Fixed a bug where psutil going stale on Linux users was not allowing the script to restart on its own. (#197)
• Fixed a bug where NFS drives weren't being identified. (#284)
• Removed the hardcoded next log check date in the view.
• Fixed a bug where NoSuchProcess error pops up when viewing opened files.