- Features
- General
- Modified the Summary tab to reload automatically after its charts are modified in Metric Explorer.
- Modified REST stack to support multiple configuration files, allowing modules to supply their own REST resources.
- Increased maximum size of node lists in database, allowing jobs running across more nodes to be more accurately tracked.
- Improved efficiency of job host list parser and ingestor.
- Added ability to disable Basic Auth in REST API.
- Improved email validation.
- ETLv2
- Added new PHP-based ETL system to Open XDMoD.
- Vastly improved logging and debugging.
- Supports individual ETL actions as well as ordered sets of actions called pipelines.
- Optimized for performance when importing large numbers of records.
- Predefined actions support flexible ingestion of data from multiple sources.
- ETL is configured via JSON files and requires far less code modification when customizing to more easily support flexibility at customer installations.
- General
- Bug Fixes
- General
- Fixed stacked area charts not handling empty data points correctly.
- Stopped inaccurate warning about Adobe Flash content in browsers that block Flash. (XDMoD does not make use of Flash.)
- Fixed various typos and grammatical errors.
- Fixed incorrectly-oriented subpanel titles in Internet Explorer 10.
- Downgraded PHP packages that required PHP 5.3.9 instead of Open XDMoD's current minimum PHP version, 5.3.3.
- Fixed inconsistency between labels used for users and PIs on a job.
- Fixed automatic aggregation unit selection for charts not working correctly on servers running PHP 5.3.3.
- Stopped package builds from being logged to an Open XDMoD database.
- Fixed documentation files from modules overwriting core files when installing using tarballs.
- General
- Refactors and Miscellaneous
- Added documentation for using LDAP for federated authentication.
- Spun the App Kernels, SUPReMM, and XSEDE modules out into separate code repositories.
- Began transition to a more flexible, more efficient data warehouse that will support innovative HPC resources including cloud computing resources.
- Consolidated third-party JavaScript libraries into one library directory.
- Improved development setup process for external contributors.
- Migrated website from a single SourceForge site to multiple GitHub sites.
- Cleaned up and reorganized numerous other assets.
- Added
reqgres
andreqtres
to the list of Slurm fields that are shredded and stored in the Slurm job table.
- Important Notes
- Updated Highcharts from v3.0.9 to v4.2.5.
- Commercial users (as defined by the Highcharts license terms) will need to acquire a new Highcharts license if their current license does not cover the new version.
- Updated Highcharts from v3.0.9 to v4.2.5.
- Features
- Added demo user type.
- Added roadmap link to feature request dialog.
- Shredders
- Fixed calculation of missing end times from the start time and wall time.
- LSF
- Now storing the node list, exit code and exit status for SUPReMM support.
- Slurm
- Now allowing null eligible times.
- Failed parsing of datetimes are no longer a fatal error.
- SGE
- Now supporting older versions of SGE that contain only 43 fields in their accounting logs.
- Bug Fixes
- General
- Fixed some charts not rendering if more than 1000 points were plotted.
- Improved consistency of chart aesthetics across tabs.
- Fixed report generator not cleaning up old report files.
- Metric Explorer
- Fixed Add Filter list only including filter types applicable to the realm of the first data series on a chart.
- Shredders
- PBS
- Fixed parsing of newer
exec_host
formats (e.g. host/0-3, host/0*8).
- Fixed parsing of newer
- PBS
xdmod-import
- Fixed importing of hierarchy and group-to-hierarchy files.
- General
- Refactors and Miscellaneous
- Refactored Open XDMoD to be the code base upon which XDMoD is built instead of the other way around.
- Updated jQuery from v1.9.1 to v1.12.4.
- Updated Node.js Mongo driver from v1.4 to v2.1.
- Improved tab loader to allow tabs to be defined in configuration files instead of being hard-coded into the loader.
- Merged public and private versions of the main page into a single page.
- Added options to more quickly build Open XDMoD for development purposes.
- Reduced duplicate code in asset setup script.
- New Features
- Federated Authentication
- Open XDMoD can now use any authentication system supported by SimpleSAMLphp (https://simplesamlphp.org/).
- For more information, please view the Federated Authentication guide.
- Roadmap
- Added interactive roadmap for XDMoD development to About tab.
- Contact Us
- Added option to contact developers for technical support.
- Data Warehouse
- Improved speed of filter (dimension value) lists by precomputing available values.
- Metric Explorer
- Added redo button.
- Shredders
- Added support for PBS Pro.
- Added additional input validation to the Slurm helper script.
- Upgrade Process
- Added warning to upgrade addon modules before migrating.
- Database
- Changed column types and added indexes to the logging table.
- Documentation
- User manual now available.
- Improved installation and configuration documentation.
- Federated Authentication
- Bug Fixes
- General
- Enabled toolbar scrolling when window is too small.
- Fixed trend line R^2 values sometimes not being calculated.
- Removed redundant warnings about role-based restrictions.
- Fixed the About tab not being able to be the default tab.
- Improved chart loading speed by removing most animations.
- Fixed incorrect trend line calculation and display for discontinuous data series.
- Fixed security vulnerability in Report Generator's image generator.
- Fixed extra slashes in URLs in password reset emails (including account creation emails).
- Fixed email template paths.
- The About tab can now be set as the default module.
- Data Warehouse
- Fixed cases where current time period would not be aggregated.
- Now that this is resolved, code that can work by scanning any aggregate table now uses the year tables, as those are smallest.
- Improved consistency of time period tables and removed unused ones.
- Fixed cases where current time period would not be aggregated.
- Metric Explorer
- Fixed handling of HTML characters in chart titles.
- Fixed issues with axis renames not persisting.
- Fixed Load Chart search not working.
- Modified chart options menu label to be a fixed length.
- This prevents the button from being placed in the toolbar's overflow area when it shouldn't be.
- Fixed changes to y-axes not being undoable.
- Modified "Show Trend Line" button in chart options to be disabled when trend lines aren't available.
- Fixed case where duration selectors in main toolbar and on x-axis popup could desynchronize.
- Shredders
- Fixed handling of "NONE" in SGE's
pe_taskid
field. - Now allowing all values that were previously resulting in fatal errors in Slurm fields that represent lengths of time.
- Fixed handling of "NONE" in SGE's
- Upgrade Process
- Fixed broken error for when portal_settings.ini is not writable.
- Usage
- Fixed bad default settings for dimensions that default to pie charts.
- Fixed long initial load time by starting on a single-chart page.
- General
- New Features
- SUPReMM support
- Metric Explorer Changes
- Improved management of charts
- Charts are no longer automatically saved after each operation. A manual Save button has been added that will indicate whether or not a chart needs to be saved.
- When displaying pie charts, only a single dataset is allowed.
- Added ability to rename saved charts.
- Added undo capability.
- Improved UI for data filtering
- Added Quick Filters for quickly restricting data. This replaces the Role selector.
- Improved data access controls
- Non-public metrics and dimensions are now restricted according to users' roles.
- Improved filter lists to only include values for which the user can view the underlying data.
- Added the ability to include a remainder data series.
- Improved management of charts
- Migrated more server calls to the new REST stack
- Simplified the chart/data retrieval infrastructure used by the Metric Explorer and Usage tabs
- Improved performance of certain queries
- Updated PBS parsing to support time fields that are formatted in seconds and not HH:MM:SS
- Bug Fixes
- Fixed report generator document formatting
- Fixed inconsistent data series ordering between timeseries charts when sorted by value in Usage and Metric Explorer tabs
- Fixed Metric Explorer sometimes loading the same chart twice
- Fixed the "Hide Tooltip" option not always working as expected in Usage tab
- Fixed filter lists occasionally getting stuck under a loading mask
- Fixed predefined date durations not being saved correctly in the Metric Explorer
- Removed auto-loading of the last open chart in Metric Explorer, a new chart is now opened when visiting the Metric Explorer
- Improved stability, consistency, and performance of numerous other components
- Prevent warning messages produced by LSF jobs that don't have a host list
- New Features
- Utilization metric may now be normalized to a specified percent allocated
- Removed javac dependency
- Add host filter shredder feature
- Improved stability of Usage tab
- Improved error handling for internal dashboard errors
- Added meaningful HTTP status codes to failed login responses
- Resolved frequent warnings in Apache logs about implicitly converting arrays to strings
- PBS memory value parsing errors are no longer fatal
- Removed Apache requirement for listening on 127.0.0.1
- Added support for Univa Grid Engine 8.2+
- Shredders now skip duplicate data
- Added support for MySQL 5.6+
- Added support for PhantomJS 2.0+
- Added helper script for updating resource specs
- Improved documentation
- Bug Fixes
- Adjust LSF unique key constraint
- Added PBS unique key constraint to prevent duplicate job data
- New Features
- Remove excessive "wall time" error messages
- Add more debug logging
- SGE memory value parsing errors are no longer fatal
- Bug Fixes
- Fix SGE parsing regression
- New Features
- Support for Torque's new "exec_host" syntax
- Updated SGE parsing to support Univa's new "job_class" field and requests for "INFINITY" memory
- Bug Fixes
- Backslash characters in LSF log files now parsed correctly
- Report generator now handles double quotes in portal_settings.ini properly
- Fixed optional Node Utilization statistic
- New Features
- Major re-write of the Metric Explorer user interface including a metric catalog and context-sensitive menus
- Report generator performance enhancements
- General user interface updates
- Improved image export dialog
- Added metric description pane in Metric Explorer
- Improved session management
- Added additional error checking and reporting to shredders
- Added LSF support
- Improved utilization metric to support resources that don't have a constant cpu count over their lifetime
- Added suport for alternate PI data sources
- Improved logging
- Added weighted job size statistic
- Improved IE compatibility
- Added xdmod-admin script
- Added automatic update checker
- Added support for slurm job arrays
- Improved documentation
- Bug Fixes
- PBS and SGE job arrays were not ingested correctly
- sacct configuration option was not recognized
- Arrow keys did not work in axis range boxes
- Parentheses not available in Metric Explorer chart titles
- Proper handling of apostrophes in search dialogs
- On some charts, data points on the last day of the specified date range were not displayed correctly
- Initial public release