Caliper release V4.0

1. Integrated new tools - nginx, redis, openblas and qperf.
2. Add new test cases for existing tools (For example lmbench and iperf)
   Total 387 new test cases has been added.
   Total test cases supported by existing caliper are 613.
3. Added multi-client support in caliper framework for nginx tool.
4. Following new features have been added in caliper framework
   i) Update naming convention for platforms and nodes used in caliper framwork.
   ii) Update dependency scripts to capture the tool installation summary log. This makes it easy for the user to debug the failure.
   iii) Protect network server to communicate with multiple clients. This features is mandatory to disallow bandwidth sharing of network server with other platforms while running network tests..
   iv) Update the default text content of html pages in frontend directory regarding report generation.
   v) Frontend directory creation logic has been added while installing caliper for the first time.
5. Fix following issues in caliper framework:
   i) For Fio tool test cases, MB/sec bandwidth values was not able to parse properly.
   ii) Resolve the static link issue in html files.
   iii) Update covariance value representation for Functional_cov.xlsx and Performance_cov.xlsx files.
   iv) Update host dependency script to automate NFS mount point. Earlier choice was expected from user causing a manual intervention in the package installation process on host system.
   v) Update sensei-grid css to support table creation for nginx and redis tool in HTML report.
   vi) Cleanup caliper code. More to be done in future.
   vii) formatting the X axis label for summary graph of tools category and test cases => label orientation has been changed from inclined position to vertical position.
   viii) Redundant code removal for server.py after the latest design change to handle multiple clients.
   ix) Fixing the bug in parsing logic of netperf.
6. Documentation added in the "doc" directory:
   i) Caliper Hadbook
   ii) Caliper User Manual
   iii) Caliper Developer Manual
   iv) Nginx Tool User Guide
   v) Redis Tool User Guide

Caliper release for Estuary V3.0

All changes from integration branch is now merged to master branch.

Network:
Iperf tool updated to Iperf3
Framework changes for client server communication for network test cases

Application:
Hibench4.0 is upgraded to Hibench5.0
Fixes and enhancement of Hadoop test cases.
Sysbench minor issues fixed.

Report Format:
Report generation can be done for functional and/or performance test
Fixes in frontend folders

Support of CentOs
Host and target dependancy scripts improvements. Tested on multiple boards

Email Feature has been added.
Bug fixes on the framework.
Minor bug fixes and improvements on the parser, execution options etc.

Caliper pre-release rc1

1. Bug fixes for various modules.
2. Email feature added.
3. autossh requirement is optimised.

Caliper pre-release rc0

1. Centos support for Caliper (X86 and ARM)
2. Support to restrict only one network target among the other eligible targets during multi target testing. This ensures that the network bandwidth is not shared with other targets at a given point in time which may impact the network performance.
3. Hibench 5.0 integration and supported 7 more test cases
4. Minor fixes for the framework stability and jenkin support
   5.Fixes in automation scripts

Caliper Jenkin integration and Multi target automation updates

This merge add the following functionalities to caliper

1. Automatic test report generation in excel and linking of the same in the report.
2. Caliper automation script updates.
3. Caliper Multi target support from single host.
4. Caliper incremental build.
5. Caliper integration to Jenkins.
6. Report re-organization and formatting.
7. Minor Bug fixes

Caliper Single host multi target support

This is pre release to test the architectural changes for single host and multi target.

Release for Estuary 2.3-rc0

1. Caliper has been modularised which helps to start different steps with out executing all steps in one go.
   This makes the caliper execution easy and efficient.
2. More CPU/System related test cases added (unixbench, sysbench-CPU, stress-ng)
3. Merged disk and IO to Storage subsection.
4. CPU subsection has been spitted to single core CPU and multi core CPU.
5. Updated caliper report templates.
6. Fixes of bugs, improvements in graphs, the data representation tables etc

Caliper release for estuary 2.2

1.Fixes in the Report html and graph:
a.The Graph Fixes for Image crop , multiple platform support (8), uniform colours for platforms, legend, spell correction etc.
b.Html page fix for new sections, titles, dynamic links of platform informations, spell corrections etc.
Note: Some of the information are to be added manually after creating report. Some links are also hard coded, to be improved in upcoming releases
2. New features, test case additions
a. Individual test names are modified as per the caliper naming convention, ltp execution log is consolidated against kernel features.
b. New fature has been added (option -c) to point to the configuration files other than the default configurations files under /etc/caliper/XXX
c. Caliper supports NFS interface now to allow targets to write the test logs directly to host, improving target log recovery at the time of target crash.
d. Caliper test cases are analyzed and reclassified between multi core and single core categories.
e. A new memory analysis tool tynimembench has been integrated caliper.
f. Iozone test classification and the execution has been updated. Caliper ReadMe and userguide updated.
3. Bug Fixes
Bug ID : 151, 150, 108, 159, 109