Add Tiling Support to All CCT Kernels and Fix CCT Operators on Siracusa Platform for L2

[runwangdl]

Description

This update improves CCT's kernel tiling support and resolves multiple operator issues on the Siracusa platform. The new kernel templates for convolution and max-pooling enhance padding integration while adopting an HWC layout. Additionally, key constraints for tiling have been introduced, fixing several execution issues in GEMM, MatMul, and float-based computations. The layers has also been refined to handle bias broadcasting correctly, ensuring accurate output shape inference.

Added

1. Float Bindings, Tilers for Pulp Target

   • Introduced tiling support for all float operators on Pulp Target（including float add, gemm, Matmul, Conv, Maxpool, Layernorm, Gelu, Gather).

2. Float Convolution, MaxPool Parser, Template, Kernel

   • Implemented kernel and template different from the generic version.
   • Designed to integrate with padding.
   • C kernel with HWC layout.

3. Tiling Constraints

   • Added tiling constraints for conv gather and layernorm and exisitng constraints for other kernels.

Fixed

1. CycleMeasure Pass for Siracusa Untiling Profilling

2. GEMM Tiling Constraints Issue

   • Fixed transA and `transB' not supported.

3. MatMul Multi-Dimensional Input Issue

   • Improved Matmul handling of multi-dimensional input.

4. Add Layer for Broadcasted Bias

• Fixed add layer computeshape being compatible with broadcasted bias

4. Code Generation Float32 Issue
   • Resolved an issue where concatenation of float32 with f caused inf errors.

Changed

1. Regenerated ONNX for CCT
   • Adjusted bias handling to prevent incorrect output shape inference when broadcasting is required.
   • Modified bias dimensions for add and gemm to avoid unnecessary broadcasting.

PR Merge Checklist

1. The PR is rebased on the latest devel commit and pointing to devel.
2. Your PR reviewed and approved.
3. All checks are passing.
4. The CHANGELOG.md file has been updated.

[Victor-Jung]

Hi Run, great PR addressing lots of issues and building strong ground for every fp execution on PULPOpen! A few comments to address but no critical ones.

[Victor-Jung]

I agree with the interface that you used (CodeGenVerbosity) but I don't like that the pass is in the PULPTiling pass. A small change and this will roll.

[Victor-Jung]

LGTM, thanks for addressing my comments!