feat(script): generate tpch data set

[xudong963]

I hereby agree to the terms of the CLA available at: https://databend.rs/dev/policies/cla/

Summary

Generate tpch date set for databend

Changelog

• New Feature

Related Issues

Fixes #5912

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment

Name	Status	Preview	Updated
databend	⬜️ Ignored (Inspect)		Jun 17, 2022 at 2:47AM (UTC)

[mergify]

Thanks for the contribution!
I have applied any labels matching special text in your PR Changelog.

Please review the labels and make any necessary changes.

[PsiACE]

Do we need a workflow to publish the docker image for tpch? Alternatively, is there a readily available image, which would reduce maintenance work?

[xudong963]

Do we need a workflow to publish the docker image for tpch? Alternatively, is there a readily available image, which would reduce maintenance work?

We don't need a workflow to publish. The image is used to generate the date set in local, the run tpch related benchmark(The related code is developing).

[everpcpc]

We could install this tool to our build-tool image if it is need in CI.

[xudong963]

Where would this tool be used?

Used by generating tpch data set. Then run tpch benchmark with the data set.

[xudong963]

We could install this tool to our build-tool image if it is need in CI.

I think it doesn't need in CI. cc @leiysky Do we have a plan to run tpch in CI to detect performance regression?

[Xuanwo]

How about putting them under scripts?

[Xuanwo]

Do we have a plan to run tpch in CI to detect performance regression?

Please consider do bench via databend-perf. Our CI resources are very limited and not suitable for those workloads.

[xudong963]

How about putting them under scripts?

I thought about putting it under scripts before, but in the future, I want to put tpch benchmark related code under tpch

[Xuanwo]

I want to put tpch benchmark related code under tpch

I prefer adding a new folder called benchmarks or benches. So that we can add other bench-related tools.

[xudong963]

I want to put tpch benchmark related code under tpch

I prefer adding a new folder called benchmarks or benches. So that we can add other bench-related tools.

LGTM

[xudong963]

Updated, please take another look @Xuanwo @leiysky @everpcpc

[leiysky]

LGTM, maybe we can add this to https://github.com/leiysky/tpch-databend as well.