-
Notifications
You must be signed in to change notification settings - Fork 3
/
Copy pathChangelog.txt
62 lines (51 loc) · 5.44 KB
/
Changelog.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
* v0.5-alpha
- [New feature] Added a new command to the CLI: 'new-app'. This command allows users to create a new application from scratch. It will create a new folder inside the 'SPBench/sys/apps/' folder with the name provided by the user. Inside this folder, it will create a toy application with a basic structure which users can use as template.
- [New feature] Added a new command to the CLI: 'delete-app'. This command allows users to delete an application from the 'SPBench/sys/apps/' folder and from the registry, as well as all benchmarks associated with it and registered inputs.
* v0.4.4-alpha
- [New benchmarks] Added Lane Detection implementations using a pipeline of farms and a farm of pipelines with FastFlow and Intel TBB
- [New benchmarks] Added Ferret using a farm of pipelines with FastFlow
- [CLI update] CLI now shows a "Did you mean <similar_bench_name>?" when no benchmark is found hwne searching by the id provided.
- [CLI update] Exec command now have a -debug parameter that allows users to show debug messages or any output (usually prints added by users) on-the-fly.
- [Benchmark update] Missing commands have been added to correctly free up memory in FastFlow benchmarks.
- [Benchmark update] Ferret pipe-farm was improved and now it uses one less thread.
* v0.4.3-alpha
- [CLI update] Exec command now allows users to set a range for nthreads. It will execute the benchmark in a loop, iterating throughout the range.
- [New benchmarks] SPBench now includes benchmarks using GrPPI.
- [CLI update] Exec command now have a "quiet" option. It will run the benchmarks showing less information on the screen.
- [New feature] If repetitions and nthreads range are used together in the exec command, a specific resulting log will be automatically generated inside the log folder. This log file will store average latency, throughput, and exec. time, with their respective std. deviation side by side.
* v0.4.2-alpha
- [New feature] Now, all the benchmark set can be moved to another place just by moving the "benchmarks" folder and replacing it in the new place.
- [New feature] SPBench now keeps a persistent execution log in a log.csv file inside the 'logs' folder. This general log contains some results and parameters of each execution.
- [Library update] UPL now has support for x86 (/spbench/libs/upl/lib/x86) and ARM (/spbench/libs/upl/lib/arm) architectures
- [Feature update] All inputs now can be downloaded by the specific workload class (except the Person Recognition ones because they are quite small).
- [Metric update] Monitoring metrics now can also run on an individual thread (-monitor-thread <ms_interval>).
- [Metric update] SPbench now prints the date and time on which each benchmark execution ended on.
- [CLI update] Exec command now allows for running selected benchmark n times. If the user is measuring average latency and throughput, it will show a summary of the results containing the average results from the execution and the respective standard deviations.
- [CLI update] Command 'clean' now can be used with '-logs' or '-outputs' to delete all logs and outputs.
- [CLI update] Exec command now allows users to change the benchmark executor (e.g., run a benchmark with perf or mpirun).
- [CLI update] Added '-print' option to the exec command, which only prints the execution line the SPBench would run on the screen, but without running it. Users may want to use this execution line to manually change some aspects of the execution.
- [New CLI feature] Added the 'global-config' option.
* v0.4.1-alpha
- [New feature] Operators edition for individual benchmarks is enabled.
- [Feature update] UPL can now be disabled to avoid architectural incompatibility issues.
- [Metric update] Min and max latency now show the moment in time where they were registered.
- [Bug fix] Fixed bug with lane detection output correctness check.
* v0.4-alpha
- [New feature] batching size can now be set as a time interval.
- [New feature] frequency patterns (for n-sources benchmarks, it is only globally available).
- [Library update] yasm(v1.3.0) library is now provided within SPBench.
- [new metric] instantaneous throughput.
- [new metric] instantaneous latency.
- [metric update] benchmark monitoring now registers also the current frequency and batch size (not available for n-sources).
- [metric update] benchmark monitoring now uses the same instantaneous metrics system.
- [metric update] average latency now displays min and max latency.
- [New CLI feature] users now can use the exec argument '-repeat <n_repetitions>' to run a benchmark n times.
- [New CLI feature] users now can use -app and -ppi filters to select multiple benchmarks to execute.
- [Workload update] new workload classes: Test and Huge.
- [Workload update] new input video for lane detection with low-quality (360p) and mid-quality (720p) options.
- [Update] frequency parameter is now defined as items per second instead of item interval.
- [Update] frequency control: now, the waiting time is added before the item reading at the source.
- [Update] frequency control: now, it counts the processing time of the previous item in the source as part of the waiting time.
- [PPI update] FastFlow release 3 was replaced by its last version available in the GitHub repository (august 2022).
- [New benchmark] pipe-farm ferret-fastflow using all-to-all inter-farm communication.
- [Benchmark update] improved implementation for ferret-fastflow pipe-farm.