[AutoTVM][Testing] Add tune_relay scripts

[junrushao]

Example:

python -m tvm.autotvm.testing.tune_relay  \
       --workload bert_base               \
       --input-shape '[1,64]'             \
       --target "llvm"                    \
       --num-trials 800                   \
       --rpc-host 192.168.6.66            \
       --rpc-port 4445                    \
       --rpc-key 3090ti                   \
       --work-dir /logs/autotvm-bert_base \
       --cache-dir /cache-workloads       \
       --graph-tuner True                 \
       --cpu-flush True                   \
       --backend graph

[junrushao]

CC: @comaniac @Hzfengsy

[lhutton1]

Out of curiosity is there any reason this couldn't be integrated into TVMC under tvmc tune? - cc @leandron

[leandron]

Good point @lhutton1 - I think there is a big feature overlap here with tvmc tune, and from the community point of view, tvmc has tests, documentation, tutorials and support material available.

Any reason to have such a similar CLI in a separate place?

[junrushao]

Thanks for asking! As indicated, it’s only used for testing purpose. We have no interest or intent to have any overlap with tvmc, but instead are using this for inspecting performance parity as a testing tool.

[junrushao]

Some other examples:

• tune_te for testing MetaSchedule: https://github.com/apache/tvm/blob/main/python/tvm/meta_schedule/testing/tune_te.py
• tune_relay for testing MetaSchedule: https://github.com/apache/tvm/blob/main/python/tvm/meta_schedule/testing/tune_relay.py
• tune_onnx for testing MetaSchedule: https://github.com/apache/tvm/blob/main/python/tvm/meta_schedule/testing/tune_onnx.py

[comaniac]

Otherwise LGTM. IMHO, it's no hurt to have testing scripts under certain module in general, as it is serving different users than TVMC. Specifically, testing scripts could be more flexible for future changes as they don't impact user experience.

[leandron]

Otherwise LGTM. IMHO, it's no hurt to have testing scripts under certain module in general, as it is serving different users than TVMC. Specifically, testing scripts could be more flexible for future changes as they don't impact user experience.

Actually thinking this way it makes sense. Thanks @comaniac

[junrushao]

Thanks! Yeah we mainly wanted some flexibility testing things out - and I fully support it if some day you guys want to migrate similar testing logic to TVMC :-)