Skip to content

Commit

Permalink
[DOCS] conformance tables update (openvinotoolkit#22496)
Browse files Browse the repository at this point in the history
  • Loading branch information
@kblaszczak-intel
kblaszczak-intel authored Jan 29, 2024
1 parent fd7065d commit bf28fed
Show file tree
Hide file tree
Showing 9 changed files with 19,692 additions and 19,111 deletions.
16 changes: 12 additions & 4 deletions ...t_openvino/compatibility_and_support/supported_operations_inference_devices.rst
View file
Original file line number Diff line number Diff line change
Expand Up @@ -4,14 +4,22 @@ Supported Operations - by Inference Devices
===========================================


This page lists operations supported by OpenVINO inference devices. The table presents general information,
This page presents operations supported by OpenVINO inference devices. The table presents general information,
for a more detailed and most recent listing of operations that are implemented and tested:

.. button-link:: _static/download/operation_conformance_table_files/opset_report_omz_static.html

.. button-link:: _static/download/conformance_reports/opset_report_omz_static.html
:color: primary
:outline:

See the full conformance report table (static)

.. button-link:: _static/download/conformance_reports/opset_report_omz_dynamic.html
:color: primary
:outline:

See the full conformance report table
See the full conformance report table (dynamic)



================================= =============== ============== ==================
Expand Down Expand Up @@ -163,7 +171,7 @@ for a more detailed and most recent listing of operations that are implemented a
Upsampling Not Supported Supported Not Supported
================================= =============== ============== ==================

| `*` - support is limited to the specific parameters. Refer to "Known Layer Limitations" section for the device :doc:`from the list of supported <openvino_docs_OV_UG_supported_plugins_Supported_Devices>`.
| `*` - support is limited to the specific parameters.
| `**` - support is implemented via :doc:`Extensibility mechanism <openvino_docs_Extensibility_UG_Intro>`.
| `***` - supports NCDHW layout.
| `****` - support is implemented via runtime reference.
Expand Down
5 changes: 3 additions & 2 deletions docs/articles_en/about_openvino/releasenotes_for_openvino.rst
View file
Original file line number Diff line number Diff line change
Expand Up @@ -241,13 +241,14 @@ OpenVINO™ Runtime

* Introducing string tensor support for Python API.
* Added support for the following:

* Create ov.Tensor from Python lists
* Create ov.Tensor from empty numpy arrays.
* Constants from empty numpy arrays.
* Autogenerated get/set methods for Node attributes.
* Inference functions (``InferRequest.infer/start_async``, ``CompiledModel.__call__`` etc.) support OVDict as the input.
* PILLOW interpolation modes bindings.
(`PR #21188 <https://github.com/openvinotoolkit/openvino/pull/21188>`__ external contribution: @meetpatel0963)
* PILLOW interpolation modes bindings. (`PR #21188 <https://github.com/openvinotoolkit/openvino/pull/21188>`__ external contribution: @meetpatel0963)

* Torchvision to :doc:`OpenVINO preprocessing <openvino_docs_OV_UG_string_tensors>`
converter documentation has been added to OpenVINO docs.

Expand Down
14,351 changes: 14,351 additions & 0 deletions docs/sphinx_setup/_static/download/conformance_reports/opset_report_omz_dynamic.html
View file

Large diffs are not rendered by default.

24,358 changes: 5,295 additions & 19,063 deletions ..._table_files/opset_report_omz_static.html → ...ance_reports/opset_report_omz_static.html
View file

Large diffs are not rendered by default.

0 ...table_files/template/chosen.jquery.min.js → ...nce_reports/template/chosen.jquery.min.js
View file
File renamed without changes.
0 ...nformance_table_files/template/filters.js → ...d/conformance_reports/template/filters.js
View file
File renamed without changes.
62 changes: 29 additions & 33 deletions ...s/template/highlight_tables_template.html → ...s/template/highlight_tables_template.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -105,46 +105,42 @@ <h3 class="ml-3" style="margin-top: 30px;"><span class="mr-3">&#9679</span> API
<thead>
<tr>
<th class="table-dark" style="text-align: left; vertical-align: middle !important;">Entity</th>
<th class="diagonal"><span class="th-devices">Devices</span><span class="th-sw-plugin">Plugins</span></th>
{% for device in devices %}
<th class="table-dark" colspan="2" style="text-align: center; vertical-align: middle !important;">{{ device }}</th>
{% endfor %}
</tr>
</thead>
<tbody style="text-align: center;">
{% for test_type in api_info %}
<td class="table-primary" style="text-align: left;" rowspan="{{ api_info[test_type].keys()|length + 1 }}" style="vertical-align: middle !important;">{{ test_type }}</td>
{% for sw_plugin in sw_plugins %}
<tr>
<td style="text-align: left;">{{sw_plugin}}</td>
{% for device in devices %}
{% if device in api_info[test_type][sw_plugin] %}
<td title="{{api_info[test_type][sw_plugin][device]['title']}}">
<span>Total:</span>
<span>{{ api_info[test_type][sw_plugin][device]['passrate'] }}</span>
{% if api_info[test_type][sw_plugin][device]['diff'] > 0 %}
(<span class="text-success font-weight-bold">+{{ api_info[test_type][sw_plugin][device]['diff'] }}</span>)
{% elif api_info[test_type][sw_plugin][device]['diff'] < 0 %}
(<span class="text-danger font-weight-bold">{{ api_info[test_type][sw_plugin][device]['diff'] }}</span>)
{% endif %}
%
</td>
<td title="{{api_info[test_type][sw_plugin][device]['rel_title']}}">
<span>Rel:</span>
<span>{{ api_info[test_type][sw_plugin][device]['rel_passrate'] }}</span>
{% if api_info[test_type][sw_plugin][device]['rel_diff'] > 0 %}
(<span class="text-success font-weight-bold">+{{ api_info[test_type][sw_plugin][device]['rel_diff'] }}</span>)
{% elif api_info[test_type][sw_plugin][device]['rel_diff'] < 0 %}
(<span class="text-danger font-weight-bold">{{ api_info[test_type][sw_plugin][device]['rel_diff'] }}</span>)
{% endif %}
%
</td>
{% else %}
<td colspan="2" style="text-align: center;" title="API conformanace wasn't run on {{device}} {{sw_plugin}}">NOT RUN</td>
{% endif %}
{% endfor %}
</tr>
{% endfor %}
<tr>
<td class="table-primary" style="text-align: left;" style="vertical-align: middle !important;">{{ test_type }}</td>
{% for device in devices %}
{% if device in api_info[test_type] %}
<td title="{{api_info[test_type][device]['title']}}">
<span>Total:</span>
<span>{{ api_info[test_type][device]['passrate'] }}</span>
{% if api_info[test_type][device]['diff'] > 0 %}
(<span class="text-success font-weight-bold">+{{ api_info[test_type][device]['diff'] }}</span>)
{% elif api_info[test_type][device]['diff'] < 0 %}
(<span class="text-danger font-weight-bold">{{ api_info[test_type][device]['diff'] }}</span>)
{% endif %}
%
</td>
<td title="{{api_info[test_type][device]['rel_title']}}">
<span>Rel:</span>
<span>{{ api_info[test_type][device]['rel_passrate'] }}</span>
{% if api_info[test_type][device]['rel_diff'] > 0 %}
(<span class="text-success font-weight-bold">+{{ api_info[test_type][device]['rel_diff'] }}</span>)
{% elif api_info[test_type][device]['rel_diff'] < 0 %}
(<span class="text-danger font-weight-bold">{{ api_info[test_type][device]['rel_diff'] }}</span>)
{% endif %}
%
</td>
{% else %}
<td colspan="2" style="text-align: center;" title="API conformanace wasn't run on {{device}} {{sw_plugin}}">NOT RUN</td>
{% endif %}
{% endfor %}
</tr>
{% endfor %}
</tbody>
</table>
Expand Down
4 changes: 2 additions & 2 deletions ...table_files/template/report_template.html → ...nce_reports/template/report_template.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ <h2>Operations coverage summary: Tag: {{report_tag}} | Version: {{report_version
<span><b>Passrates are based on relative weights each subgraphs! You can check absolute value in `General passrate` row!</b></span>
</div>
<div>
<span><b>Relative Passrate could be from 0 to 200% now! Relative weight of operation is calculated once for current set of models, but there are more then one tests per model. </b></span>
<span><b>Relative Passrate could be from 0 to 100% (Inference only)! Relative weight of operation is calculated once for current set of models, but there are more then one tests per model. </b></span>
</div>
<div>
<span><b>Status:</b></span>
Expand Down Expand Up @@ -97,7 +97,7 @@ <h2>Operations coverage summary: Tag: {{report_tag}} | Version: {{report_version
<table class="table table-hover" id="report">
<thead>
<tr>
<th class="table-dark" scope="col" style="position: sticky; top: 97px">Operation</th>
<th class="table-dark" scope="col" style="position: sticky; top: 97px">Operation ({OpName}-{FirstOpsetNumberContainsOp})</th>
{% for d in devices -%}
<th class="table-dark device {{ d }}" style="position: sticky; top: 97px">{{ d }}</th>
{% endfor %}
Expand Down
7 changes: 0 additions & 7 deletions ...onformance_table_files/template/style.css → ...ad/conformance_reports/template/style.css
View file
Original file line number Diff line number Diff line change
Expand Up @@ -698,13 +698,6 @@ h2 {
opacity: 0.5;
}

.diagonal {
position: relative;
background: linear-gradient(to right top, #000000 0%,#000000 46.9%,#ffffff 47%,#ffffff 51%,#000000 51.1%,#000000 100%) !important;
background-color: transparent;
background-color: none !important;
}

.th-sw-plugin {
color: white;
}
Expand Down

0 comments on commit bf28fed

Please sign in to comment.