Mephisto 1.2.0
Overview
This release is focused on adding a new provider (Prolific) and better data review experience.
It has a larger diff than usual, and we will return to a more frequent release cadence afterwards.
See the list of changes when upgrading from v1.1.0 below. Note that only essential dependency updates are listed.
Big Changes
- Added integration with Prolific provider, as an alternative to Mturk for data collection. Expect some minor additions in the subsequent releases, but the core functionality is already there. #1008
- Added UI-driven review of collected task results, a major upgrade over the previously used command-line script. Support for bonuses and feedback for workers to be added in the subsequent releases. When jobs have had no activity for a set duration, they'll be shut down automatically (suspecting an issue). #1058
- Added dockerization support for running Mephisto. #1008
Included PRs
Feature + UX Improvements
- Getting complete MTurk pay for individual units by @JackUrb in #446
- Adding gold units and functionality by @JackUrb in #923
- including hydra_configs in package (for 1.1.1) by @JackUrb in #942
- Adding missing hook registration for MTurk Sandbox
wrap_crowd_source
by @JackUrb in #987 - Reorganizing
pyproject.toml
to use Extras over Groups by @JackUrb in #1002 - Added AWS credentials pre-commit hook by @meta-paul in #1018
- Update heroku_architect.py by @JackUrb in #1025
- ec2 architect uninterruptable shutdown by @JackUrb in #1023
- Permissive socket upload by @JackUrb in #1026
- Adding auth implementation of prolific client by @JackUrb in #1028
- Add Prolific provider (#1008) by @meta-paul in #1012
- Improve logger in Python code by @meta-paul in #1045
- Laying down basic strokes of standard get_data response by @JackUrb in #1065
- Prolific workspace management by @JackUrb in #1067
- Update heroku_architect.py by @JackUrb in #1062
1076 - Create a reusable app for task review by @meta-paul in #1058
- Prevent oversampling of study submissions by any single worker by @meta-paul in #1080
Bugfixes
- Fixed Static task to not explicitly check for
objData.file1
by @gzhihongwei in #966 - Refactoring QA from unit assign to use in onboarding by @JackUrb in #960
- dropped the self from cant_cancel_expirations by @arjunan-k in #971
- Fixing missing events in wrap_crowd_source.js by @JackUrb in #988
- InaccessiblePrometheusServer Exception by @mojtaba-komeili in #1016
- Updated error message to manually delete EC2 server by @gzhihongwei in #1007
- quick fix: change order of checks in operator by @PReithofer in #1039
- Small fixes from local branch by @JackUrb in #1054
- fix race condition in generate_units by @PReithofer in #1056
Docs + Examples
- Corrected documentation inconsistencies and typos by @gzhihongwei in #965
- Adding citation note to readme by @JackUrb in #989
- Fix typo in operations/README.md by @eltociear in #992
- Add additional python versions to test by @pringshia in #925
- fix rendering of assignment url for mock tasks by @edwardguo61 in #1005
- New testing option for ec2 (reuse existing server) by @JackUrb in #1036
- Small typo fix for running the static_test_script by @benmatselby in #1019
- Add unittests for Prolific integration by @meta-paul in #1046
- running black across codebase by @JackUrb in #1043
- Add unittests for Prolific integration (2) by @meta-paul in #1047
- Updated Prolific integrations docs by @meta-paul in #1049
- Clean up TODO comments by @meta-paul in #1050
- Update copyright headers across the codebase by @meta-paul in #1075
Dependencies
- Update to React 18 by @pringshia in #905
- Upgrading codecov version by @JackUrb in #1027
New Contributors
- @gzhihongwei made their first contribution in #965
- @arjunan-k made their first contribution in #971
- @eltociear made their first contribution in #992
- @edwardguo61 made their first contribution in #1005
- @benmatselby made their first contribution in #1019
- @meta-paul made their first contribution in #1018
- @PReithofer made their first contribution in #1039
Full Changelog: v1.1.0...v1.2.0