|
| 1 | +# v1.0.0 vs v1.0.1 |
| 2 | +## Microservice tests |
| 3 | +``` |
| 4 | +benchstat testdata/BenchmarkMicroserviceStackv1.0.0.txt testdata/BenchmarkMicroserviceStackv1.0.1.txt |
| 5 | +name old time/op new time/op delta |
| 6 | +/0-4 34.1ns ± 2% 28.1ns ± 1% -17.56% (p=0.000 n=10+10) |
| 7 | +/1-4 344ns ± 1% 322ns ± 0% -6.35% (p=0.000 n=10+9) |
| 8 | +/10-4 2.39µs ± 1% 2.23µs ± 1% -6.75% (p=0.000 n=10+10) |
| 9 | +/100-4 22.2µs ± 0% 20.6µs ± 0% -7.56% (p=0.000 n=9+9) |
| 10 | +/1000-4 212µs ± 1% 203µs ± 0% -4.27% (p=0.000 n=10+8) |
| 11 | +/10000-4 2.16ms ± 1% 2.12ms ± 1% -1.87% (p=0.000 n=10+10) |
| 12 | +/100000-4 23.7ms ± 2% 24.0ms ± 3% +1.22% (p=0.002 n=10+9) |
| 13 | +/1000000-4 243ms ± 1% 258ms ± 2% +6.13% (p=0.000 n=9+10) |
| 14 | +
|
| 15 | +name old alloc/op new alloc/op delta |
| 16 | +/0-4 32.0B ± 0% 16.0B ± 0% -50.00% (p=0.000 n=10+10) |
| 17 | +/1-4 256B ± 0% 288B ± 0% +12.50% (p=0.000 n=10+10) |
| 18 | +/10-4 1.52kB ± 0% 1.55kB ± 0% +2.11% (p=0.000 n=10+10) |
| 19 | +/100-4 16.7kB ± 0% 15.2kB ± 0% -9.00% (p=0.000 n=10+10) |
| 20 | +/1000-4 134kB ± 0% 161kB ± 0% +20.38% (p=0.000 n=10+10) |
| 21 | +/10000-4 1.29MB ± 0% 1.76MB ± 0% +36.56% (p=0.000 n=10+10) |
| 22 | +/100000-4 12.8MB ± 0% 17.6MB ± 0% +37.57% (p=0.000 n=9+10) |
| 23 | +/1000000-4 128MB ± 0% 176MB ± 0% +37.64% (p=0.000 n=8+10) |
| 24 | +
|
| 25 | +name old allocs/op new allocs/op delta |
| 26 | +/0-4 1.00 ± 0% 1.00 ± 0% ~ (all equal) |
| 27 | +/1-4 10.0 ± 0% 10.0 ± 0% ~ (all equal) |
| 28 | +/10-4 74.0 ± 0% 74.0 ± 0% ~ (all equal) |
| 29 | +/100-4 706 ± 0% 707 ± 0% +0.14% (p=0.000 n=10+10) |
| 30 | +/1000-4 7.01k ± 0% 7.02k ± 0% +0.14% (p=0.000 n=10+10) |
| 31 | +/10000-4 70.0k ± 0% 70.2k ± 0% +0.19% (p=0.000 n=10+10) |
| 32 | +/100000-4 700k ± 0% 702k ± 0% +0.20% (p=0.000 n=10+10) |
| 33 | +/1000000-4 7.00M ± 0% 7.02M ± 0% +0.20% (p=0.000 n=10+10) |
| 34 | +``` |
| 35 | + |
| 36 | +## Other tests |
| 37 | +``` |
| 38 | +benchstat testdata/BenchmarkFillStackv1.0.0.txt testdata/BenchmarkFillStackv1.0.1.txt |
| 39 | +name old time/op new time/op delta |
| 40 | +/0-4 33.5ns ± 1% 27.6ns ± 1% -17.73% (p=0.000 n=9+10) |
| 41 | +/1-4 172ns ± 2% 156ns ± 1% -9.31% (p=0.000 n=10+10) |
| 42 | +/10-4 574ns ± 3% 539ns ± 0% -6.22% (p=0.000 n=10+9) |
| 43 | +/100-4 4.71µs ± 0% 4.13µs ± 0% -12.31% (p=0.000 n=8+8) |
| 44 | +/1000-4 36.3µs ± 2% 34.2µs ± 0% -5.78% (p=0.000 n=10+9) |
| 45 | +/10000-4 352µs ± 2% 321µs ± 0% -8.81% (p=0.000 n=9+9) |
| 46 | +/100000-4 3.84ms ± 1% 3.50ms ± 1% -8.86% (p=0.000 n=9+10) |
| 47 | +/1000000-4 43.4ms ± 3% 40.6ms ± 3% -6.43% (p=0.000 n=10+10) |
| 48 | +
|
| 49 | +name old alloc/op new alloc/op delta |
| 50 | +/0-4 32.0B ± 0% 16.0B ± 0% -50.00% (p=0.000 n=10+10) |
| 51 | +/1-4 160B ± 0% 192B ± 0% +20.00% (p=0.000 n=10+10) |
| 52 | +/10-4 560B ± 0% 592B ± 0% +5.71% (p=0.000 n=10+10) |
| 53 | +/100-4 7.12kB ± 0% 5.62kB ± 0% -21.12% (p=0.000 n=10+10) |
| 54 | +/1000-4 37.9kB ± 0% 40.5kB ± 0% +6.92% (p=0.000 n=10+10) |
| 55 | +/10000-4 330kB ± 0% 333kB ± 0% +0.84% (p=0.000 n=10+10) |
| 56 | +/100000-4 3.22MB ± 0% 3.22MB ± 0% +0.13% (p=0.000 n=10+10) |
| 57 | +/1000000-4 32.1MB ± 0% 32.1MB ± 0% +0.06% (p=0.000 n=10+10) |
| 58 | +
|
| 59 | +name old allocs/op new allocs/op delta |
| 60 | +/0-4 1.00 ± 0% 1.00 ± 0% ~ (all equal) |
| 61 | +/1-4 4.00 ± 0% 4.00 ± 0% ~ (all equal) |
| 62 | +/10-4 14.0 ± 0% 14.0 ± 0% ~ (all equal) |
| 63 | +/100-4 106 ± 0% 107 ± 0% +0.94% (p=0.000 n=10+10) |
| 64 | +/1000-4 1.01k ± 0% 1.01k ± 0% +0.40% (p=0.000 n=10+10) |
| 65 | +/10000-4 10.0k ± 0% 10.0k ± 0% +0.22% (p=0.000 n=10+10) |
| 66 | +/100000-4 100k ± 0% 100k ± 0% +0.20% (p=0.000 n=10+10) |
| 67 | +/1000000-4 1.00M ± 0% 1.00M ± 0% +0.20% (p=0.000 n=10+10) |
| 68 | +``` |
| 69 | +``` |
| 70 | +benchstat testdata/BenchmarkRefillStackv1.0.0.txt testdata/BenchmarkRefillStackv1.0.1.txt |
| 71 | +name old time/op new time/op delta |
| 72 | +/1-4 3.50µs ± 1% 3.21µs ± 1% -8.23% (p=0.000 n=10+10) |
| 73 | +/10-4 33.6µs ± 1% 30.8µs ± 2% -8.34% (p=0.000 n=9+10) |
| 74 | +/100-4 324µs ± 1% 296µs ± 2% -8.63% (p=0.000 n=10+10) |
| 75 | +/1000-4 3.22ms ± 1% 3.09ms ± 1% -4.14% (p=0.000 n=10+10) |
| 76 | +/10000-4 32.6ms ± 2% 33.0ms ± 0% +1.50% (p=0.002 n=10+9) |
| 77 | +/100000-4 378ms ± 2% 350ms ± 1% -7.21% (p=0.000 n=10+10) |
| 78 | +
|
| 79 | +name old alloc/op new alloc/op delta |
| 80 | +/1-4 1.60kB ± 0% 1.60kB ± 0% ~ (all equal) |
| 81 | +/10-4 16.0kB ± 0% 16.0kB ± 0% ~ (all equal) |
| 82 | +/100-4 160kB ± 0% 160kB ± 0% -0.00% (p=0.000 n=10+10) |
| 83 | +/1000-4 1.60MB ± 0% 2.42MB ± 0% +51.40% (p=0.000 n=10+9) |
| 84 | +/10000-4 16.0MB ± 0% 31.6MB ± 0% +97.62% (p=0.000 n=9+10) |
| 85 | +/100000-4 161MB ± 0% 320MB ± 0% +99.56% (p=0.000 n=10+10) |
| 86 | +
|
| 87 | +name old allocs/op new allocs/op delta |
| 88 | +/1-4 100 ± 0% 100 ± 0% ~ (all equal) |
| 89 | +/10-4 1.00k ± 0% 1.00k ± 0% ~ (all equal) |
| 90 | +/100-4 10.0k ± 0% 10.0k ± 0% ~ (all equal) |
| 91 | +/1000-4 100k ± 0% 100k ± 0% +0.20% (p=0.000 n=10+10) |
| 92 | +/10000-4 1.00M ± 0% 1.00M ± 0% +0.38% (p=0.000 n=10+10) |
| 93 | +/100000-4 10.0M ± 0% 10.0M ± 0% +0.39% (p=0.000 n=10+10) |
| 94 | +``` |
| 95 | +``` |
| 96 | +benchstat testdata/BenchmarkRefillFullStackv1.0.0.txt testdata/BenchmarkRefillFullStackv1.0.1.txt |
| 97 | +name old time/op new time/op delta |
| 98 | +/1-4 3.38µs ± 2% 3.06µs ± 2% -9.70% (p=0.000 n=10+10) |
| 99 | +/10-4 34.4µs ± 3% 30.8µs ± 2% -10.52% (p=0.000 n=10+10) |
| 100 | +/100-4 336µs ± 2% 298µs ± 1% -11.32% (p=0.000 n=10+10) |
| 101 | +/1000-4 3.33ms ± 3% 3.34ms ± 1% ~ (p=1.000 n=10+10) |
| 102 | +/10000-4 32.6ms ± 2% 33.5ms ± 0% +2.90% (p=0.000 n=10+9) |
| 103 | +/100000-4 359ms ± 2% 346ms ± 0% -3.66% (p=0.000 n=10+9) |
| 104 | +
|
| 105 | +name old alloc/op new alloc/op delta |
| 106 | +/1-4 1.60kB ± 0% 1.60kB ± 0% ~ (all equal) |
| 107 | +/10-4 16.0kB ± 0% 16.0kB ± 0% ~ (all equal) |
| 108 | +/100-4 160kB ± 0% 160kB ± 0% ~ (all equal) |
| 109 | +/1000-4 1.60MB ± 0% 3.24MB ± 0% +102.80% (p=0.000 n=10+10) |
| 110 | +/10000-4 16.0MB ± 0% 32.4MB ± 0% +102.80% (p=0.000 n=10+10) |
| 111 | +/100000-4 160MB ± 0% 320MB ± 0% +100.23% (p=0.000 n=10+10) |
| 112 | +
|
| 113 | +name old allocs/op new allocs/op delta |
| 114 | +/1-4 100 ± 0% 100 ± 0% ~ (all equal) |
| 115 | +/10-4 1.00k ± 0% 1.00k ± 0% ~ (all equal) |
| 116 | +/100-4 10.0k ± 0% 10.0k ± 0% ~ (all equal) |
| 117 | +/1000-4 100k ± 0% 100k ± 0% +0.40% (p=0.000 n=10+10) |
| 118 | +/10000-4 1.00M ± 0% 1.00M ± 0% +0.40% (p=0.000 n=10+10) |
| 119 | +/100000-4 10.0M ± 0% 10.0M ± 0% +0.39% (p=0.000 n=10+10) |
| 120 | +``` |
| 121 | +``` |
| 122 | +benchstat testdata/BenchmarkSlowIncreaseStackv1.0.0.txt testdata/BenchmarkSlowIncreaseStackv1.0.1.txt |
| 123 | +name old time/op new time/op delta |
| 124 | +/1-4 198ns ± 2% 187ns ± 1% -5.41% (p=0.000 n=10+10) |
| 125 | +/10-4 867ns ± 1% 824ns ± 1% -4.97% (p=0.000 n=10+9) |
| 126 | +/100-4 7.48µs ± 0% 6.92µs ± 0% -7.57% (p=0.000 n=9+8) |
| 127 | +/1000-4 64.9µs ± 1% 63.2µs ± 1% -2.54% (p=0.000 n=10+10) |
| 128 | +/10000-4 636µs ± 0% 633µs ± 1% -0.48% (p=0.035 n=10+9) |
| 129 | +/100000-4 7.46ms ± 1% 7.30ms ± 0% -2.15% (p=0.000 n=9+8) |
| 130 | +/1000000-4 78.6ms ± 2% 83.1ms ± 2% +5.62% (p=0.000 n=10+10) |
| 131 | +
|
| 132 | +name old alloc/op new alloc/op delta |
| 133 | +/1-4 176B ± 0% 208B ± 0% +18.18% (p=0.000 n=10+10) |
| 134 | +/10-4 720B ± 0% 752B ± 0% +4.44% (p=0.000 n=10+10) |
| 135 | +/100-4 8.72kB ± 0% 7.22kB ± 0% -17.25% (p=0.000 n=10+10) |
| 136 | +/1000-4 53.9kB ± 0% 64.8kB ± 0% +20.12% (p=0.000 n=10+10) |
| 137 | +/10000-4 490kB ± 0% 649kB ± 0% +32.47% (p=0.000 n=10+10) |
| 138 | +/100000-4 4.82MB ± 0% 6.42MB ± 0% +33.39% (p=0.000 n=10+10) |
| 139 | +/1000000-4 48.1MB ± 0% 64.1MB ± 0% +33.46% (p=0.000 n=10+10) |
| 140 | +
|
| 141 | +name old allocs/op new allocs/op delta |
| 142 | +/1-4 5.00 ± 0% 5.00 ± 0% ~ (all equal) |
| 143 | +/10-4 24.0 ± 0% 24.0 ± 0% ~ (all equal) |
| 144 | +/100-4 206 ± 0% 207 ± 0% +0.49% (p=0.000 n=10+10) |
| 145 | +/1000-4 2.01k ± 0% 2.01k ± 0% +0.30% (p=0.000 n=10+10) |
| 146 | +/10000-4 20.0k ± 0% 20.1k ± 0% +0.30% (p=0.000 n=10+10) |
| 147 | +/100000-4 200k ± 0% 201k ± 0% +0.29% (p=0.000 n=10+10) |
| 148 | +/1000000-4 2.00M ± 0% 2.01M ± 0% +0.29% (p=0.000 n=10+10) |
| 149 | +``` |
| 150 | +``` |
| 151 | +benchstat testdata/BenchmarkSlowDecreaseStackv1.0.0.txt testdata/BenchmarkSlowDecreaseStackv1.0.1.txt |
| 152 | +name old time/op new time/op delta |
| 153 | +/1-4 34.8ns ± 1% 30.9ns ± 2% -11.17% (p=0.000 n=10+10) |
| 154 | +/10-4 349ns ± 1% 314ns ± 1% -10.23% (p=0.000 n=10+9) |
| 155 | +/100-4 3.41µs ± 1% 3.05µs ± 1% -10.38% (p=0.000 n=9+10) |
| 156 | +/1000-4 33.8µs ± 1% 30.4µs ± 2% -10.01% (p=0.000 n=9+10) |
| 157 | +/10000-4 337µs ± 1% 303µs ± 1% -10.07% (p=0.000 n=8+9) |
| 158 | +/100000-4 3.37ms ± 1% 3.03ms ± 1% -10.00% (p=0.000 n=10+9) |
| 159 | +/1000000-4 33.6ms ± 0% 30.4ms ± 1% -9.57% (p=0.000 n=9+10) |
| 160 | +
|
| 161 | +name old alloc/op new alloc/op delta |
| 162 | +/1-4 16.0B ± 0% 16.0B ± 0% ~ (all equal) |
| 163 | +/10-4 160B ± 0% 160B ± 0% ~ (all equal) |
| 164 | +/100-4 1.60kB ± 0% 1.60kB ± 0% ~ (all equal) |
| 165 | +/1000-4 16.0kB ± 0% 16.0kB ± 0% ~ (all equal) |
| 166 | +/10000-4 160kB ± 0% 160kB ± 0% ~ (all equal) |
| 167 | +/100000-4 1.60MB ± 0% 1.60MB ± 0% ~ (all equal) |
| 168 | +/1000000-4 16.0MB ± 0% 16.0MB ± 0% ~ (all equal) |
| 169 | +
|
| 170 | +name old allocs/op new allocs/op delta |
| 171 | +/1-4 1.00 ± 0% 1.00 ± 0% ~ (all equal) |
| 172 | +/10-4 10.0 ± 0% 10.0 ± 0% ~ (all equal) |
| 173 | +/100-4 100 ± 0% 100 ± 0% ~ (all equal) |
| 174 | +/1000-4 1.00k ± 0% 1.00k ± 0% ~ (all equal) |
| 175 | +/10000-4 10.0k ± 0% 10.0k ± 0% ~ (all equal) |
| 176 | +/100000-4 100k ± 0% 100k ± 0% ~ (all equal) |
| 177 | +/1000000-4 1.00M ± 0% 1.00M ± 0% ~ (all equal) |
| 178 | +``` |
| 179 | +``` |
| 180 | +benchstat testdata/BenchmarkStableStackv1.0.0.txt testdata/BenchmarkStableStackv1.0.1.txt |
| 181 | +name old time/op new time/op delta |
| 182 | +/1-4 31.1ns ± 1% 28.9ns ± 2% -6.86% (p=0.000 n=10+10) |
| 183 | +/10-4 312ns ± 1% 294ns ± 3% -5.92% (p=0.000 n=10+9) |
| 184 | +/100-4 3.07µs ± 2% 2.88µs ± 2% -6.24% (p=0.000 n=10+10) |
| 185 | +/1000-4 30.4µs ± 1% 28.5µs ± 3% -6.35% (p=0.000 n=10+10) |
| 186 | +/10000-4 305µs ± 1% 285µs ± 1% -6.57% (p=0.000 n=9+10) |
| 187 | +/100000-4 3.08ms ± 5% 2.85ms ± 2% -7.52% (p=0.000 n=9+9) |
| 188 | +/1000000-4 31.6ms ± 2% 28.4ms ± 1% -9.95% (p=0.000 n=10+9) |
| 189 | +
|
| 190 | +name old alloc/op new alloc/op delta |
| 191 | +/1-4 16.0B ± 0% 16.0B ± 0% ~ (all equal) |
| 192 | +/10-4 160B ± 0% 160B ± 0% ~ (all equal) |
| 193 | +/100-4 1.60kB ± 0% 1.60kB ± 0% ~ (all equal) |
| 194 | +/1000-4 16.0kB ± 0% 16.0kB ± 0% ~ (all equal) |
| 195 | +/10000-4 160kB ± 0% 160kB ± 0% ~ (all equal) |
| 196 | +/100000-4 1.60MB ± 0% 1.60MB ± 0% ~ (all equal) |
| 197 | +/1000000-4 16.0MB ± 0% 16.0MB ± 0% ~ (all equal) |
| 198 | +
|
| 199 | +name old allocs/op new allocs/op delta |
| 200 | +/1-4 1.00 ± 0% 1.00 ± 0% ~ (all equal) |
| 201 | +/10-4 10.0 ± 0% 10.0 ± 0% ~ (all equal) |
| 202 | +/100-4 100 ± 0% 100 ± 0% ~ (all equal) |
| 203 | +/1000-4 1.00k ± 0% 1.00k ± 0% ~ (all equal) |
| 204 | +/10000-4 10.0k ± 0% 10.0k ± 0% ~ (all equal) |
| 205 | +/100000-4 100k ± 0% 100k ± 0% ~ (all equal) |
| 206 | +/1000000-4 1.00M ± 0% 1.00M ± 0% ~ (all equal) |
| 207 | +``` |
0 commit comments