feat: Add a spark.comet.exec.memoryPool
configuration for experimenting with various datafusion memory pool setups.
#3110
Job | Run time |
---|---|
6m 25s | |
6m 15s | |
59m 21s | |
1h 0m 25s | |
52m 40s | |
59m 4s | |
57m 42s | |
6m 33s | |
52m 20s | |
6m 30s | |
1h 0m 49s | |
57m 19s | |
52m 1s | |
53m 25s | |
1h 1m 7s | |
54m 20s | |
53m 25s | |
6m 11s | |
56m 56s | |
0s | |
50m 45s | |
5m 34s | |
55m 11s | |
5m 24s | |
50m 52s | |
5m 22s | |
1h 9m 55s | |
44m 40s | |
58m 18s | |
53m 52s | |
1h 1m 31s | |
56m 4s | |
53m 10s | |
5m 14s | |
42m 40s | |
5m 47s | |
59m 10s | |
6m 21s | |
5m 17s | |
37m 21s | |
47m 14s | |
50m 40s | |
1h 4m 40s | |
1h 6m 59s | |
0s | |
55m 13s | |
1d 6h 40m 2s |