-
CHANGE:
- exit error code has changed:
- we don't count error after 128
- error code semantic is more precise and documented
- error text when calling replica is sent to
stderr
- exit error code has changed:
-
INTERNAL:
- pre-commit hooks
- INTERNAL:
- Explicit version management
- INTERNAL:
- Port the code base to Idris2 0.6.0
- Upgrade nix flake (
nix check
andnix develop
works)
- CHANGE:
- The dhall language for replica has changed and is now hosted in its own project.
If you have existing
dhall
tests that you don't want to change, you can use this url as an entry point for replica: https://raw.githubusercontent.com/ReplicaTest/REPLica/v0.4.0/dhall/replica.dhall. - Migration to Idris2 0.5.1
- The dhall language for replica has changed and is now hosted in its own project.
If you have existing
- NEW:
replica new
to create tests file templatessuite
to organise your test by suites- test name with spaces are officially supported
- execution time of each test is tracked
- FIX:
replica help
mentionsversion
- skipped tests are displayed
- CHANGE:
- Expectation format: Note if you use "partial expectations" in your tests, you need to upgrade your tests suites.
- NEW:
- New expectations functions:
contains
,consecutive
,start
,end
- Differentiate
stdOut
andstdErr
- command exit code can be checked
- we can submit several json files
- add a
version
subcommand
- New expectations functions:
- FIX documentation error in replica set
- CHANGE docker entry point is now a shell
- Can mark tests as pending
- Can set
expected
in json and dhall to specify expected output directly - Can check the content of a generated file using
outputFile
- Partial expectations
- Space sensitivity is configurable
- Directory for golden values is configurable
- external configuration (via
replica set
) - nix flake (thanks to Matthieu Coudron)
- dockerfile
- Tests suites are in json format, with dhall support
- Tests have:
- tags
- dependencies
- description
- pre/post acitions
- definition of a working directories
- input that will replace stdin
- Multi-threading is supported (tests are sent by bathches of n threads)
- Expcetations, last outputs, and tests results are stored in
.replica
- Filters to run a subset of tests
- direct port of idris2 testing libraries, with a configuration file à la idris package.