[Good First Issue] [Snippets] [ARM]: Support Transpose execution

[a-sidorova]

Context

Snippets is a highly specialized JIT (just-in-time) compiler for computational graphs. It provides a scalable approach to operations' fusions and enablement. As a typical compiler, Snippets have frontend (tokenizer), optimizer and backend (generator).

The first of the Snippets pipeline, Tokenization, identifies parts of the initial ov::Model that can be lowered by Snippets efficiently, and tokenizes them into one whole node - Subgraph.
The second step of the pipeline (Optimizer) is applying common and device-specific optimizations to Subgraph and getting lowered representation of tokenized Subgraph.
Finally, the last stage is code emission. The target generator maps every operation in the IR to a binary code emitter JIT Emitter, which is then used to produce a piece of executable code. As a result, we produce an executable that performs calculations described by the initial input ov::Model.

The purpose of this issue is support of Transpose operation execution using Snippets for ARM devices.
Note that Snippets decomposes Transpose into memory operations LoadReorder (this is Load op with transposed input strides) and Store using TransposeDecomposition pass. This pass is called on the second step of the Snippets pipeline - Optimizer.

Prerequisites

Recommended to use ARM CPU based platform for development (e.g. Mac, Raspberry Pi etc). The cross-compilation with an emulator (e.g. QEMU) using is still option: cmake -DCMAKE_TOOLCHAIN_FILE=../cmake/arm64.toolchain.cmake ...

What needs to be done?

• Enable tests which are currently disabled on aarch64 platforms. Need to update this line to enable smoke*Snippets*_Transpose_* tests. Launch tests (how to launch them - please see the section Tests below). There should be failed tests.
• The tests are failed because the target AArch64 machine doesn't know about LoadReshape op and the generator cannot emit the binary code. Add mapping LoadReorder op to the corresponding binary code emitter in cpu target machine.
• Launch tests again - the tests should be green.

Tests

Tests are disabled in default build, so ensure to add -DENABLE_TESTS=ON into cmake command.

GoogleTest is used for testing. CPU functional test target is ov_cpu_func_tests. You can use GoogleTest filter:

./bin/[platform]/[build_type]/ov_cpu_func_tests --gtest_filter="*smoke*Snippets*Transpose*"

Examples

• Enabled Ceiling and FloorMod tokenization: [Snippets][AArch64] Enabled Ceiling and FloorMod tokenization #28092
• CPU Target machine for x64 platforms: link.

Resources

• Contribution guide - start here!
• What is OpenVINO?
• Snippets - JIT compiler for computational graphs
• CPU plugin JIT emitters
• Blog post on contributing to OpenVINO
• User documentation
• Intel DevHub Discord channel - engage in discussions, ask questions and talk to OpenVINO developers
• How to link your Pull Request to an issue

Contact points

@a-sidorova, @dmitry-gorokhov

[0xfedcafe]

.take

[github-actions]

Thank you for looking into this issue! Please let us know if you have any questions or require any help.