Add --complete auto completion mode to sqllogictests

[alamb]

Which issue does this PR close?

Closes #4570
re #4460

Rationale for this change

TLDR I want to be able to write a script and capture expected output easily

See #4570

What changes are included in this PR?

1. Update sqllogictest = "0.10.0"
2. add a --complete command line flag to sqllogictest
3. add documentation on how to update the files

Are these changes tested?

not directly -- they are a tool for testing

As an example:

As an example, I ported two tests from aggregates.rs to aggregate.slt like:

# array_agg_zero
query U
SELECT ARRAY_AGG([]);

# array_agg_one
query U
SELECT ARRAY_AGG([1]);

Note I didn't put in the expected results

Then I ran in complete mode:

cargo test --test sqllogictests -- aggregate --complete

 # array_agg_zero
 query U
 SELECT ARRAY_AGG([]);
----
[]

 # array_agg_one
 query U
 SELECT ARRAY_AGG([1]);
----
[[1]]

🎉

Are there any user-facing changes?

No

[alamb]

This calls the excellent function update_test_file from @xxchan added in risinglightdb/sqllogictest-rs#130 👨‍🍳 👌

[alamb]

Writing these tests was amazing -- I just added the queries and the --complete mode added the expected results ❤️

[alamb]

cc @xudong963 @mvanschellebeeck

[alamb]

I am quite pleased that this worked so well

[xudong963]

I'll review it today, love the feature!!!

[xudong963]

Except for a few minor flaws, others lgtm, thanks @alamb

Currently, we only have one dir test_files which contains all test files. As more and more tests become available, we can categorize them by adding some new subdirs under test_files.

Btw, maybe we can use clap and WalkDir in the future to replace Options struct.

[alamb]

Except for a few minor flaws, others lgtm, thanks @alamb

Currently, we only have one dir test_files which contains all test files. As more and more tests become available, we can categorize them by adding some new subdirs under test_files.

Good idea -- filed #4709

Btw, maybe we can use clap and WalkDir in the future to replace Options struct.

I agree using clap in the future would be a good idea!

[ursabot]

Benchmark runs are scheduled for baseline = c9d6118 and contender = 04d095d. 04d095d is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Skipped ⚠️ Benchmarking of arrow-datafusion-commits is not supported on ec2-t3-xlarge-us-east-2] ec2-t3-xlarge-us-east-2
[Skipped ⚠️ Benchmarking of arrow-datafusion-commits is not supported on test-mac-arm] test-mac-arm
[Skipped ⚠️ Benchmarking of arrow-datafusion-commits is not supported on ursa-i9-9960x] ursa-i9-9960x
[Skipped ⚠️ Benchmarking of arrow-datafusion-commits is not supported on ursa-thinkcentre-m75q] ursa-thinkcentre-m75q
Buildkite builds:
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java