This document represents a high-level overview of changes made to this project. It will not list every miniscule change, but will allow you to view - at a glance - what to expect from upgrading to a new version.
- Update Ruby base image to 2.7
- Update to 2.7-compatible version of
steam-condenserandsteam-id - Update dependencies
- Update application to Bundler 2
- Migrate to new Sentry SDK
- Round adagrad sum to 13 digits for comparison purposes. Postgres spec claims 15 digits accuracy, but that seems a pipe dream.
- Fix detection whether data points are irrelevant failing, due to Hive returning the adagrad sum field with an accuracy the DB could not handle, leading to truncation.
- Historical compensation for score-multiplying bug. Based on the changes in playtime and score between data points, suspicious score increases which are likely the result of the known score-multiplying bug are detected, and compensated for.
- Use redis-backed leaderboard for rank determination on profile pages. This removes redundant functionality, and ensures the leaderboard and profile page will match at all times.
- Update dependencies.
- Leaderboard now uses Redis as cache for significantly faster sorting.
- Ensure new cleanup job is ran rather than old one.
- Player queries graph, as it refers to queries from before persistence was a thing, and is only relevant for newly added players now.
- Possibility to filter leaderboard by player activity. Rarely used, and would have complicated using Redis as a cache.
- Background job to fix players in state where no future updates might happen.
- Use player's "last active at" timestamp as secondary order parameter in search results. Aliases which are equally similar to the search parameter will hence be sorted by the player's last activity.
- Change to new skill tier badges. Thanks Rantology. :)
- Remove incorrect reference that searching for players' previous aliases is possible.
- Fix issue in NSL account importer.
- Fix typo in background job schedule preventing leaderboard updates.
- Links to players' ensl.org profiles if known.
- Show no-onos accuracy above yes-onos accuracy. Change wording.
- Update dependencies.
- Duplicate player updates due to race condition between player updates and update frequency classification (Github issue #36)
- Double updates when adding new players via web-interface.
- Advertisement for ENSL.org-hosted tournaments / gathers.
- Link to wiki from FAQ.
- Opengraph tags to profile pages.
- Update ruby to
2.6.3, update dependencies. - Link to tutorial landing page on wiki rather than ensl.org.
- Strip query parameters which are specified without a value.
- Update skill tier badges to newest versions from game files. Thanks @Adambean.
- Exception if search for a player's Steam ID and last activity matches a player for whom no data is no record yet.
- Exception if searching for a player, and the
last_active_afterquery parameter is given as a toggle (ie without any value). - Exception in classification of player update frequency, caused by race condition.
- PAX2012 badge, which seems to be exported by Hive now.
- Exception if unknown badge encountered in Hive response.
- Show 'no onos' accuracy on player profile page.
- Hint about ingame stats being refreshed weekly.
- Update ruby to
2.6.1. - Update dependencies.
- Support for cached player statistics and new output format of Gorge.
-
Caching of player ranks. Player ranks (for skill, score, experience etc) are now cached in Redis. A background job periodically recalculates them, and the profile page fetches them from Redis.
This will cut load time of the profile by an order of magnitude, as rank calculation has been the most time-consuming aspect.
- Do not add new data points if API result is full of zeroes, in order not to pollute database with faulty data.
- Ability to show a configurable MOTD at the top of each page.
- Pagination links on player search and leaderboards don't reset 'last active after' filter anymore.
- Pagination page count on leaderboard now respects 'last active after' filter.
- Exception on startup caused by partially loaded
ActiveSupport, and gems not supporting this properly.
- Ability to filter player search, and leaderboard, by players' last activity.
- Update dependencies.
sentry.iointegration for tracking of exceptions.
- Assignment of players to skill tiers now uses adagrad sum for better accuracy.
- Skill tier badges on profile page, leaderboard, and search result page.
- Update base image to ruby
2.5.1. - Update dependencies.
- Made link to Piwik opt-out window on FAQ page absolute.
- Exception on player profile page if a player has no rounds of a given team on record.
- Basic per-player statistics (accuracy and KDR) on profile page.
- Hard-coded FAQ.
- Prevent trying to load
dotenvin production.
- Show link to ENSL.org tutorials on profile pages of players matching certain criteria.
- Update dependencies and base image.
- Steam HTTP proxies not being used in round-robin fashion due to forking worker processes.
- HTTP proxy support to Steam inventory API calls.
- Optional Piwik integration.
- Exception when searching for a direct identifier (eg Steam ID) and badge at the same time. #2
- Rate limiting of Steam queries.
- Exception when searching for non-ASCII alias.
- Link to player's Steam community profile on profile page.
- Support for badges managed via Steam inventory:
- NCT Early & Late 2017
- WC 2014 Participant
- ENSL S11
- Mod Madness 2017
- Ordering of badge groups to be more sensible thematically.
- PAX 2012 badge, which can't be tracked due to being a game DLC.
- Endpoint (
/player?steam_id=) to query player profile by Steam ID.
- Delegate various pretty-printing tasks to
silverballinstead of doing it ourselves.
- Schedule player updates based on when the last update was performed - not based on when it should have been performed. This ensures that updates spread out on their own.
- Properly set
last_used_atwhen API key is used.
- Deactivated API keys can no longer be used for authentication.
- API to retrieve player information as JSON.
- (Static) token-based authentication
- Returns basic player data (skill, playtime, ...)
- Returns some internal data (profile URL, last update)
- Fix
docker-entrypoint.shusing wrong CLI argument to load puma configuration.
- Healthcheck URL at
/health
- Replace Unicorn in favour of Puma
- Minify Chartkick JS.
- Use pie chart for 'player update frequency' graph.
- Update
sequel-pg-trgmto latest git version. Removes deprecated Sequel behaviour.
- 'Player data point relevance' graph, as we only store relevant data points.
- Configure databasee port via DB_PORT.
- Update dependencies.
- Use steam_id2 gem to resolve Steam IDs. Unifies resolving behaviour with Lerk Discord bot.
- Configurable colours for aliens and marines in graphs.
- Configurable formatting directives for date and datetime.
- Update Ruby base image, Tini, gems
- Update dependencies.
- 'Last active' on leaderboard showed time of last update instead of last time the player's data changed.
- Views to manage update frequencies.
- User accounts with authentication, and management viewes.
- Caching of fully-static pages. Performance gains are minor, and implementing cache-invalidation - as would be needed now that we have authentication - not worth it.
- Redis-based page cache for static pages.
- Big performance improvements for player rank queries.
- Minor performance improvements for player profile, search and leaderboard.
- Re-enabled dynamic rank on player profile.
- Non-relevant player points no longer get stored in the database.
- Existing non-relevant player points from database.
- Disable dynamic player rank on profile page due to performance reasons.
-
Adding a new player is now mostly asynchronous - only initial resolving of the Steam ID happens synchronously.
-
Exports which allow to export all stored data of a player as a CSV.
- Improved placeholder page for players with no data.
-
Bug in the logic which disables a player after too many updates failed made it disable the player one failed update later than configured.
-
Bug in logic which re-enables a player after a succesful update which might have prevented it being re-enabled.
- Link from per-stats rank on profile page to corresponding page in leaderboard.
- Update Ruby to 2.4.0.
- Fix searching for player by Steam ID.
- Fix search breaking in anything but the default configuration.
- Fix ordering in player search, at the cost of only searching current alias.
- Resque::Plugin::JobStats to monitor job performance.
- Improve player search
- Allow searching for Steam IDs and custom URLs
- Show direct matches (e.g. Steam ID) first
- Improve alias search by using Postgres Trigrams.
- Fix pagination of player search resetting badge parameter.
- MySQL support. Player search implemention requires Postgres-specific features.
- Enable CSRF protection. Configuration issue fixed.
-
Disable CSRF protection.
There is an obscure issue where Google Chrome consistently fails CSRF protection, when nginx is put in front of the application server.
Other browsers work fine, and so does Google Chrome if accessing the application server (be that Unicorn or Webrick) directly.
While the bug is under investigation, CSRF protection has been disabled; there is no sensitive information stored within the application, and no destructive actions can be taken, so while not ideal, it is acceptable.
-
Add session secret configuration via env variable.
Must be same on all hosts in case of loadbalanced setups. Will be generated randomly if not defined. See the README for further details.
- SQLite support. As we extensively use window functions to dyamically calculate player ranks, SQLite is not an option, as it does not support those.
- Adds search functionality to search through players in database using account ID, ingame alias (both past and current), and badges. The 'add new player' query form on the main page was moved to a separate screen.
- Links entries on badge overview page to search result page.
- Player - Badge join table will now cascade on update / delete. This allows to reasonably delete a player with badges.
- Updates dependencies.
- Fixed ranking on profile page being incorrect while new players are being added.
- Badge support:
- Per-player badges
- Global stats
- 'Last active' field in leaderboard, showing when last tracked activity of player was.
- Stats page, with some graphs of statisics for the Observatory.
- Made Steam Web API optional. If no key configured, the application will work as long as no name resolution is attempted.
- Debug mode for hunting down the CSRF failures in Chrome.
- Improved profile pages:
- For score, skill, score / minute and experience, the player's rank is shown too.
- Graphs to visualize development of playtime and skill over time.
- Pagination for 'skill progression' table.
- Made update scheduling more resistant to unexpected failures.
- Internal refactoring of logging output.
- Automatic test suite.
- Updates dependencies.
- Calculation of 'Score per Minute' if both score and total time are 0.
- 'Score per minute' value to player profiles and leaderboard.
- Stay on current pagee if sort column of leaderboard changed.
- Fixed creation of stale user objects if the Hive query failed.
- Placeholder player profile for players with no data.
- Removed players without player data from leaderboard.
- PLAYER_DATA_UPDATE_INTERVAL: With custom update frequencies this setting has no value anymore.
-
Per-player update frequency which determines at which rate background updates get scheduled. Frequency is determined by player activity.
-
Delay automatically scheduled player updates to prevent them from trying to execute all at once.
-
Refactored Player and PlayerDataPoint models. All Hive data is now stored in the later, while the former only contains the player's resolved account ID.
Also adds a
relevantfield to data points, which states whether the data changed since its predecessor.
- Prevent user from scheduling multiple updates for the same player.
- Prevent background updates from scheduling multiple updates for the same player.
- Fixed
PLAYER_DATA_BACKOFF_DELAYsetting.
- Backoff time for player updates in case of rate limiting is now configurable.
- Updated dependencies to fix handling of account IDs starting with 765.
- New pagination to leaderboard which scales better with number of pages.
- Randomize delay duration in case of rate limiting of background updates.
- Docker entrypoints for Resque worker and scheduler.
- Ratelimit gem now respects redis connection settings.
- Automated and on-demand background updates for player data.
- Rate-limiting for on-demand and background updates.
- Adagrad sum is now properly saved as a float rather than an integer.
- Adds .dockerignore, preventing dev credentials from leaking into public containers.
- Fixed docker container: Log to stdout, add missing DB adapters.
- Persistent storage of Hive 2 user profiles and data.
- Basic paginated leaderboard.
- Properly format 0s-timespans.
- Updates HiveStalker gem to fix bug with resolving of Steam IDs.
- Multi-person queries due to rate-limiting concerns.
- Updates HiveStalker gem to fix bug with low account IDs.
- Allows 'vanity'-URLs as input, in addition to various formats of Steam ID.
- Basic interface to query data of one or multiple players from the Hive 2 HTTP API.