Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

nep29: drop py39 and support py312 #5894

Merged
merged 7 commits into from
Apr 3, 2024

Conversation

bjlittle
Copy link
Member

@bjlittle bjlittle commented Apr 2, 2024

🚀 Pull Request

Description


Consult Iris pull request check list


Add any of the below labels to trigger actions on this PR:

  • benchmark_this Request that this pull request be benchmarked to check if it introduces performance shifts

@github-actions github-actions bot added the benchmark_this Request that this pull request be benchmarked to check if it introduces performance shifts label Apr 2, 2024
@bjlittle bjlittle marked this pull request as draft April 2, 2024 11:04
@bjlittle bjlittle changed the title Drop py39 add py312 nep29: drop py39 and support py312 Apr 2, 2024
Copy link
Contributor

github-actions bot commented Apr 2, 2024

⏱️ Performance Benchmark Report: faa692c

Performance shifts

Full benchmark results

Benchmarks that have stayed the same:

| Change   | Before [84c3c847]    | After [faa692c0]    | Ratio   | Benchmark (Parameter)                                                                                |
|----------|----------------------|---------------------|---------|------------------------------------------------------------------------------------------------------|
|          | n/a                  | n/a                 | n/a     | aux_factory.FactoryCommon.time_create                                                                |
|          | 4.34±0.09μs          | 4.31±0.02μs         | 0.99    | aux_factory.HybridHeightFactory.time_create                                                          |
|          | 4.86±0.04μs          | 4.80±0.04μs         | 0.99    | coords.AncillaryVariable.time_create                                                                 |
|          | 423±7ns              | 433±10ns            | 1.02    | coords.AuxCoord.time_bounds                                                                          |
|          | 8.90±0.1μs           | 8.98±0.05μs         | 1.01    | coords.AuxCoord.time_create                                                                          |
|          | 405±3ns              | 409±6ns             | 1.01    | coords.AuxCoord.time_points                                                                          |
|          | 244±20μs             | 245±20μs            | 1.00    | coords.AuxCoordLazy.time_bounds                                                                      |
|          | 13.2±0.7μs           | 13.3±0.6μs          | 1.01    | coords.AuxCoordLazy.time_create                                                                      |
|          | 242±10μs             | 241±20μs            | 1.00    | coords.AuxCoordLazy.time_points                                                                      |
|          | 5.28±0.06μs          | 5.33±0.03μs         | 1.01    | coords.CellMeasure.time_create                                                                       |
|          | 1.12±0.01μs          | 1.12±0.01μs         | 1.00    | coords.CellMethod.time_create                                                                        |
|          | n/a                  | n/a                 | n/a     | coords.CoordCommon.time_create                                                                       |
|          | 115±2μs              | 111±2μs             | 0.96    | coords.DimCoord.time_create                                                                          |
|          | 31.8±0.3μs           | 33.3±1μs            | 1.05    | coords.DimCoord.time_regular                                                                         |
|          | 387±4ms              | 386±4ms             | 1.00    | cube.Aggregation.time_aggregated_by                                                                  |
|          | 58.5±0.5μs           | 59.1±0.4μs          | 1.01    | cube.AncillaryVariable.time_add                                                                      |
|          | 11.2±0.4μs           | 11.1±0.3μs          | 0.99    | cube.AncillaryVariable.time_create                                                                   |
|          | 66.5±0.6μs           | 66.7±1μs            | 1.00    | cube.AuxCoord.time_add                                                                               |
|          | 9.35±0.09μs          | 9.42±0.2μs          | 1.01    | cube.AuxCoord.time_create                                                                            |
|          | 5.94±0.04μs          | 5.97±0.03μs         | 1.00    | cube.AuxCoord.time_return_coord_dims                                                                 |
|          | 4.42±0.07μs          | 4.44±0.02μs         | 1.00    | cube.AuxCoord.time_return_coords                                                                     |
|          | 40.7±0.5μs           | 40.8±0.3μs          | 1.00    | cube.AuxFactory.time_add                                                                             |
|          | 12.1±0.2μs           | 12.2±0.3μs          | 1.01    | cube.AuxFactory.time_create                                                                          |
|          | 58.2±0.6μs           | 58.5±0.6μs          | 1.01    | cube.CellMeasure.time_add                                                                            |
|          | 11.4±0.2μs           | 11.5±0.1μs          | 1.01    | cube.CellMeasure.time_create                                                                         |
|          | 51.7±0.4μs           | 53.2±1μs            | 1.03    | cube.CellMethod.time_add                                                                             |
|          | 7.11±0.1μs           | 7.11±0.05μs         | 1.00    | cube.CellMethod.time_create                                                                          |
|          | n/a                  | n/a                 | n/a     | cube.ComponentCommon.time_add                                                                        |
|          | n/a                  | n/a                 | n/a     | cube.ComponentCommon.time_create                                                                     |
|          | 130±0.2ms            | 131±0.4ms           | 1.00    | cube.Concatenate.time_concatenate                                                                    |
|          | 6.59±0.07μs          | 6.68±0.05μs         | 1.01    | cube.Cube.time_basic                                                                                 |
|          | 58.8±1ns             | 60.3±3ns            | 1.03    | cube.Cube.time_rename                                                                                |
|          | 61.3±0.6μs           | 61.7±0.5μs          | 1.01    | cube.Equality.time_equality                                                                          |
|          | 339±2ms              | 341±3ms             | 1.01    | cube.Merge.time_merge                                                                                |
|          | 28.6±1μs             | 29.5±2μs            | 1.03    | cube.MeshCoord.time_add(10000)                                                                       |
|          | 30.4±1μs             | 31.5±1μs            | 1.04    | cube.MeshCoord.time_add(1000000)                                                                     |
|          | 25.5±1μs             | 25.8±1μs            | 1.01    | cube.MeshCoord.time_add(6)                                                                           |
|          | 19.5±0.2μs           | 20.3±0.5μs          | 1.04    | cube.MeshCoord.time_create(10000)                                                                    |
|          | 19.3±0.4μs           | 19.6±0.4μs          | 1.02    | cube.MeshCoord.time_create(1000000)                                                                  |
|          | 18.8±0.3μs           | 19.1±0.3μs          | 1.01    | cube.MeshCoord.time_create(6)                                                                        |
|          | 52.9±5μs             | 55.9±3μs            | 1.06    | cube.MeshCoord.time_remove(10000)                                                                    |
|          | 60.0±4μs             | 60.9±3μs            | 1.01    | cube.MeshCoord.time_remove(1000000)                                                                  |
|          | 45.6±6μs             | 46.0±6μs            | 1.01    | cube.MeshCoord.time_remove(6)                                                                        |
|          | 2.63±0.2ms           | 2.76±0.2ms          | 1.05    | experimental.ugrid.Connectivity.time_create(1000000)                                                 |
|          | 1.88±0.02ms          | 1.88±0.03ms         | 1.00    | experimental.ugrid.Connectivity.time_create(6)                                                       |
|          | 603±5ns              | 613±10ns            | 1.02    | experimental.ugrid.Connectivity.time_indices(1000000)                                                |
|          | 597±5ns              | 612±3ns             | 1.03    | experimental.ugrid.Connectivity.time_indices(6)                                                      |
|          | 23.5±2ms             | 23.6±2ms            | 1.00    | experimental.ugrid.Connectivity.time_location_lengths(1000000)                                       |
|          | 2.66±0.04ms          | 2.65±0.02ms         | 1.00    | experimental.ugrid.Connectivity.time_location_lengths(6)                                             |
|          | 27.7±3ms             | 26.0±3ms            | 0.94    | experimental.ugrid.Connectivity.time_validate_indices(1000000)                                       |
|          | 3.99±0.05ms          | 3.98±0.05ms         | 1.00    | experimental.ugrid.Connectivity.time_validate_indices(6)                                             |
|          | 4.23±0.1ms           | 4.17±0.2ms          | 0.99    | experimental.ugrid.ConnectivityLazy.time_create(1000000)                                             |
|          | 3.20±0.03ms          | 3.25±0.04ms         | 1.01    | experimental.ugrid.ConnectivityLazy.time_create(6)                                                   |
|          | 256±6μs              | 260±9μs             | 1.01    | experimental.ugrid.ConnectivityLazy.time_indices(1000000)                                            |
|          | 251±6μs              | 251±5μs             | 1.00    | experimental.ugrid.ConnectivityLazy.time_indices(6)                                                  |
|          | 20.5±0.3ms           | 20.6±0.5ms          | 1.00    | experimental.ugrid.ConnectivityLazy.time_location_lengths(1000000)                                   |
|          | 2.92±0.04ms          | 2.94±0.05ms         | 1.01    | experimental.ugrid.ConnectivityLazy.time_location_lengths(6)                                         |
|          | 23.3±0.3ms           | 23.2±0.6ms          | 1.00    | experimental.ugrid.ConnectivityLazy.time_validate_indices(1000000)                                   |
|          | 4.26±0.04ms          | 4.30±0.04ms         | 1.01    | experimental.ugrid.ConnectivityLazy.time_validate_indices(6)                                         |
|          | 12.8±0.2μs           | 12.7±0.1μs          | 0.99    | experimental.ugrid.Mesh.time_add_connectivities(1000000)                                             |
|          | 351±4μs              | 361±4μs             | 1.03    | experimental.ugrid.Mesh.time_add_connectivities(6)                                                   |
|          | 4.84±0.05μs          | 4.95±0.07μs         | 1.02    | experimental.ugrid.Mesh.time_add_coords(1000000)                                                     |
|          | 4.83±0.03μs          | 4.87±0.04μs         | 1.01    | experimental.ugrid.Mesh.time_add_coords(6)                                                           |
|          | 5.03±0.07μs          | 5.04±0.03μs         | 1.00    | experimental.ugrid.Mesh.time_connectivities(1000000)                                                 |
|          | 5.04±0.06μs          | 5.03±0.05μs         | 1.00    | experimental.ugrid.Mesh.time_connectivities(6)                                                       |
|          | 5.90±0.1μs           | 5.86±0.06μs         | 0.99    | experimental.ugrid.Mesh.time_coords(1000000)                                                         |
|          | 5.87±0.1μs           | 5.84±0.04μs         | 1.00    | experimental.ugrid.Mesh.time_coords(6)                                                               |
|          | 46.2±0.8μs           | 46.2±0.6μs          | 1.00    | experimental.ugrid.Mesh.time_create(1000000)                                                         |
|          | 399±7μs              | 404±10μs            | 1.01    | experimental.ugrid.Mesh.time_create(6)                                                               |
|          | 75.9±1ms             | 77.5±2ms            | 1.02    | experimental.ugrid.Mesh.time_eq(1000000)                                                             |
|          | 275±3μs              | 277±5μs             | 1.01    | experimental.ugrid.Mesh.time_eq(6)                                                                   |
|          | 4.88±0.06μs          | 4.88±0.03μs         | 1.00    | experimental.ugrid.Mesh.time_remove_connectivities(1000000)                                          |
|          | 4.87±0.03μs          | 4.95±0.04μs         | 1.02    | experimental.ugrid.Mesh.time_remove_connectivities(6)                                                |
|          | 7.37±0.08μs          | 7.33±0.09μs         | 0.99    | experimental.ugrid.Mesh.time_remove_coords(1000000)                                                  |
|          | 7.39±0.05μs          | 7.36±0.07μs         | 1.00    | experimental.ugrid.Mesh.time_remove_coords(6)                                                        |
|          | 10.9±0.07μs          | 10.9±0.1μs          | 1.01    | experimental.ugrid.MeshCoord.time_bounds(10000)                                                      |
|          | 125±2ms              | 124±1ms             | 1.00    | experimental.ugrid.MeshCoord.time_bounds(1000000)                                                    |
|          | 5.35±0.05μs          | 5.31±0.06μs         | 0.99    | experimental.ugrid.MeshCoord.time_bounds(6)                                                          |
|          | 3.69±0.07ms          | 3.65±0.04ms         | 0.99    | experimental.ugrid.MeshCoord.time_create(10000)                                                      |
|          | 3.64±0.03ms          | 3.66±0.03ms         | 1.00    | experimental.ugrid.MeshCoord.time_create(1000000)                                                    |
|          | 199±4μs              | 203±3μs             | 1.02    | experimental.ugrid.MeshCoord.time_create(6)                                                          |
|          | 3.66±0.03μs          | 3.61±0.01μs         | 0.99    | experimental.ugrid.MeshCoord.time_points(10000)                                                      |
|          | 4.15±0.09μs          | 4.16±0.04μs         | 1.00    | experimental.ugrid.MeshCoord.time_points(1000000)                                                    |
|          | 2.84±0.01μs          | 2.91±0.01μs         | 1.03    | experimental.ugrid.MeshCoord.time_points(6)                                                          |
|          | 7.56±0.1ms           | 7.48±0.08ms         | 0.99    | experimental.ugrid.MeshCoordLazy.time_bounds(10000)                                                  |
|          | 124±2ms              | 124±2ms             | 1.01    | experimental.ugrid.MeshCoordLazy.time_bounds(1000000)                                                |
|          | 12.2±0.7μs           | 12.0±0.6μs          | 0.99    | experimental.ugrid.MeshCoordLazy.time_bounds(6)                                                      |
|          | 3.67±0.04ms          | 3.75±0.06ms         | 1.02    | experimental.ugrid.MeshCoordLazy.time_create(10000)                                                  |
|          | 3.69±0.06ms          | 3.75±0.08ms         | 1.02    | experimental.ugrid.MeshCoordLazy.time_create(1000000)                                                |
|          | 242±10μs             | 242±6μs             | 1.00    | experimental.ugrid.MeshCoordLazy.time_create(6)                                                      |
|          | 2.53±0.07ms          | 2.54±0.08ms         | 1.01    | experimental.ugrid.MeshCoordLazy.time_points(10000)                                                  |
|          | 4.75±0.1ms           | 4.64±0.08ms         | 0.98    | experimental.ugrid.MeshCoordLazy.time_points(1000000)                                                |
|          | 8.36±0.8μs           | 8.16±0.5μs          | 0.98    | experimental.ugrid.MeshCoordLazy.time_points(6)                                                      |
|          | 32.8±0.9μs           | 31.7±1μs            | 0.97    | experimental.ugrid.MeshLazy.time_add_connectivities(1000000)                                         |
|          | 406±10μs             | 406±8μs             | 1.00    | experimental.ugrid.MeshLazy.time_add_connectivities(6)                                               |
|          | 19.4±1μs             | 19.7±1μs            | 1.01    | experimental.ugrid.MeshLazy.time_add_coords(1000000)                                                 |
|          | 17.1±1μs             | 16.3±1μs            | 0.96    | experimental.ugrid.MeshLazy.time_add_coords(6)                                                       |
|          | 16.7±0.7μs           | 16.7±0.5μs          | 1.00    | experimental.ugrid.MeshLazy.time_connectivities(1000000)                                             |
|          | 16.5±0.8μs           | 16.3±0.4μs          | 0.99    | experimental.ugrid.MeshLazy.time_connectivities(6)                                                   |
|          | 19.0±0.5μs           | 19.1±0.8μs          | 1.00    | experimental.ugrid.MeshLazy.time_coords(1000000)                                                     |
|          | 19.0±0.7μs           | 18.6±0.6μs          | 0.98    | experimental.ugrid.MeshLazy.time_coords(6)                                                           |
|          | 76.5±2μs             | 77.5±2μs            | 1.01    | experimental.ugrid.MeshLazy.time_create(1000000)                                                     |
|          | 448±10μs             | 450±20μs            | 1.00    | experimental.ugrid.MeshLazy.time_create(6)                                                           |
|          | 77.1±2ms             | 77.8±1ms            | 1.01    | experimental.ugrid.MeshLazy.time_eq(1000000)                                                         |
|          | 348±20μs             | 344±10μs            | 0.99    | experimental.ugrid.MeshLazy.time_eq(6)                                                               |
|          | 18.1±0.7μs           | 18.3±0.9μs          | 1.01    | experimental.ugrid.MeshLazy.time_remove_connectivities(1000000)                                      |
|          | 17.0±0.6μs           | 17.1±0.7μs          | 1.01    | experimental.ugrid.MeshLazy.time_remove_connectivities(6)                                            |
|          | 31.5±1μs             | 31.7±1μs            | 1.00    | experimental.ugrid.MeshLazy.time_remove_coords(1000000)                                              |
|          | 29.4±1μs             | 30.1±1μs            | 1.02    | experimental.ugrid.MeshLazy.time_remove_coords(6)                                                    |
|          | n/a                  | n/a                 | n/a     | experimental.ugrid.UGridCommon.time_create(1000000)                                                  |
|          | n/a                  | n/a                 | n/a     | experimental.ugrid.UGridCommon.time_create(6)                                                        |
|          | 500±4ns              | 497±7ns             | 0.99    | experimental.ugrid.regions_combine.CombineRegionsComputeRealData.time_compute_data(50)               |
|          | 248±3ms              | 250±2ms             | 1.01    | experimental.ugrid.regions_combine.CombineRegionsComputeRealData.time_compute_data(500)              |
|          | 13.6±0.1ms           | 13.8±0.2ms          | 1.02    | experimental.ugrid.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(50)            |
|          | 15.5±0.9ms           | 15.5±0.2ms          | 1.00    | experimental.ugrid.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(500)           |
|          | 5.0                  | 5.0                 | 1.00    | experimental.ugrid.regions_combine.CombineRegionsCreateCube.track_addedmem_create_combined_cube(50)  |
|          | 5.0                  | 5.0                 | 1.00    | experimental.ugrid.regions_combine.CombineRegionsCreateCube.track_addedmem_create_combined_cube(500) |
|          | 103±0.6ms            | 104±0.7ms           | 1.00    | experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(50)          |
|          | 694±5ms              | 698±5ms             | 1.00    | experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(500)         |
|          | 64.9±1ms             | 65.9±1ms            | 1.02    | experimental.ugrid.regions_combine.CombineRegionsSaveData.time_save(50)                              |
|          | 646±3ms              | 650±3ms             | 1.01    | experimental.ugrid.regions_combine.CombineRegionsSaveData.time_save(500)                             |
|          | 2.1752849999999997   | 2.1752849999999997  | 1.00    | experimental.ugrid.regions_combine.CombineRegionsSaveData.track_filesize_saved(50)                   |
|          | 216.01528499999998   | 216.01528499999998  | 1.00    | experimental.ugrid.regions_combine.CombineRegionsSaveData.track_filesize_saved(500)                  |
|          | 565±7μs              | 576±10μs            | 1.02    | import_iris.Iris.time__concatenate                                                                   |
|          | 167±2μs              | 167±2μs             | 1.00    | import_iris.Iris.time__constraints                                                                   |
|          | 101±0.9μs            | 101±0.9μs           | 1.00    | import_iris.Iris.time__data_manager                                                                  |
|          | 85.8±0.6μs           | 87.0±1μs            | 1.01    | import_iris.Iris.time__deprecation                                                                   |
|          | 109±1μs              | 109±0.9μs           | 1.00    | import_iris.Iris.time__lazy_data                                                                     |
|          | 784±5μs              | 789±7μs             | 1.01    | import_iris.Iris.time__merge                                                                         |
|          | 72.8±0.6μs           | 72.1±0.4μs          | 0.99    | import_iris.Iris.time__representation                                                                |
|          | 433±5μs              | 444±10μs            | 1.02    | import_iris.Iris.time_analysis                                                                       |
|          | 127±1μs              | 130±2μs             | 1.02    | import_iris.Iris.time_analysis__area_weighted                                                        |
|          | 99.9±1μs             | 99.2±0.9μs          | 0.99    | import_iris.Iris.time_analysis__grid_angles                                                          |
|          | 217±2μs              | 219±1μs             | 1.01    | import_iris.Iris.time_analysis__interpolation                                                        |
|          | 169±2μs              | 172±2μs             | 1.02    | import_iris.Iris.time_analysis__regrid                                                               |
|          | 102±1μs              | 103±0.7μs           | 1.01    | import_iris.Iris.time_analysis__scipy_interpolate                                                    |
|          | 128±0.6μs            | 129±1μs             | 1.01    | import_iris.Iris.time_analysis_calculus                                                              |
|          | 283±2μs              | 285±3μs             | 1.01    | import_iris.Iris.time_analysis_cartography                                                           |
|          | 84.8±1μs             | 84.2±0.6μs          | 0.99    | import_iris.Iris.time_analysis_geomerty                                                              |
|          | 200±2μs              | 201±2μs             | 1.01    | import_iris.Iris.time_analysis_maths                                                                 |
|          | 91.6±0.7μs           | 91.7±1μs            | 1.00    | import_iris.Iris.time_analysis_stats                                                                 |
|          | 168±1μs              | 168±2μs             | 1.00    | import_iris.Iris.time_analysis_trajectory                                                            |
|          | 275±6μs              | 276±4μs             | 1.00    | import_iris.Iris.time_aux_factory                                                                    |
|          | 81.0±0.4μs           | 80.8±1μs            | 1.00    | import_iris.Iris.time_common                                                                         |
|          | 156±2μs              | 154±3μs             | 0.99    | import_iris.Iris.time_common_lenient                                                                 |
|          | 882±10μs             | 894±10μs            | 1.01    | import_iris.Iris.time_common_metadata                                                                |
|          | 124±2μs              | 124±0.8μs           | 1.00    | import_iris.Iris.time_common_mixin                                                                   |
|          | 1.02±0.01ms          | 1.04±0.01ms         | 1.02    | import_iris.Iris.time_common_resolve                                                                 |
|          | 188±2μs              | 189±2μs             | 1.00    | import_iris.Iris.time_config                                                                         |
|          | 107±1μs              | 108±2μs             | 1.00    | import_iris.Iris.time_coord_categorisation                                                           |
|          | 325±3μs              | 333±8μs             | 1.02    | import_iris.Iris.time_coord_systems                                                                  |
|          | 641±3μs              | 647±9μs             | 1.01    | import_iris.Iris.time_coords                                                                         |
|          | 613±7μs              | 597±10μs            | 0.97    | import_iris.Iris.time_cube                                                                           |
|          | 209±2μs              | 210±2μs             | 1.00    | import_iris.Iris.time_exceptions                                                                     |
|          | 73.2±0.4μs           | 73.3±0.6μs          | 1.00    | import_iris.Iris.time_experimental                                                                   |
|          | 195±2μs              | 196±1μs             | 1.01    | import_iris.Iris.time_fileformats                                                                    |
|          | 226±4μs              | 229±3μs             | 1.01    | import_iris.Iris.time_fileformats__ff                                                                |
|          | 2.40±0.01ms          | 2.41±0.01ms         | 1.00    | import_iris.Iris.time_fileformats__ff_cross_references                                               |
|          | 73.7±0.9μs           | 75.2±0.4μs          | 1.02    | import_iris.Iris.time_fileformats__pp_lbproc_pairs                                                   |
|          | 108±2μs              | 108±0.9μs           | 1.01    | import_iris.Iris.time_fileformats_abf                                                                |
|          | 323±4μs              | 322±6μs             | 1.00    | import_iris.Iris.time_fileformats_cf                                                                 |
|          | 5.37±0.05ms          | 5.35±0.05ms         | 1.00    | import_iris.Iris.time_fileformats_dot                                                                |
|          | 68.4±0.8μs           | 69.2±0.8μs          | 1.01    | import_iris.Iris.time_fileformats_name                                                               |
|          | 237±3μs              | 238±2μs             | 1.01    | import_iris.Iris.time_fileformats_name_loaders                                                       |
|          | 113±1μs              | 114±1μs             | 1.01    | import_iris.Iris.time_fileformats_netcdf                                                             |
|          | 113±0.8μs            | 114±2μs             | 1.01    | import_iris.Iris.time_fileformats_nimrod                                                             |
|          | 189±2μs              | 192±3μs             | 1.02    | import_iris.Iris.time_fileformats_nimrod_load_rules                                                  |
|          | 686±8μs              | 692±10μs            | 1.01    | import_iris.Iris.time_fileformats_pp                                                                 |
|          | 160±1μs              | 162±2μs             | 1.02    | import_iris.Iris.time_fileformats_pp_load_rules                                                      |
|          | 124±0.9μs            | 122±2μs             | 0.98    | import_iris.Iris.time_fileformats_pp_save_rules                                                      |
|          | 437±7μs              | 442±3μs             | 1.01    | import_iris.Iris.time_fileformats_rules                                                              |
|          | 195±2μs              | 199±2μs             | 1.02    | import_iris.Iris.time_fileformats_structured_array_identification                                    |
|          | 80.0±0.8μs           | 80.1±1μs            | 1.00    | import_iris.Iris.time_fileformats_um                                                                 |
|          | 151±1μs              | 152±1μs             | 1.01    | import_iris.Iris.time_fileformats_um__fast_load                                                      |
|          | 131±0.6μs            | 132±3μs             | 1.01    | import_iris.Iris.time_fileformats_um__fast_load_structured_fields                                    |
|          | 71.8±0.7μs           | 72.1±0.9μs          | 1.00    | import_iris.Iris.time_fileformats_um__ff_replacement                                                 |
|          | 77.9±0.8μs           | 79.2±0.9μs          | 1.02    | import_iris.Iris.time_fileformats_um__optimal_array_structuring                                      |
|          | 863±4μs              | 859±4μs             | 1.00    | import_iris.Iris.time_fileformats_um_cf_map                                                          |
|          | 128±1μs              | 129±0.7μs           | 1.01    | import_iris.Iris.time_io                                                                             |
|          | 159±6μs              | 163±3μs             | 1.03    | import_iris.Iris.time_io_format_picker                                                               |
|          | 196±2μs              | 196±3μs             | 1.00    | import_iris.Iris.time_iris                                                                           |
|          | 120±1μs              | 120±1μs             | 1.01    | import_iris.Iris.time_iterate                                                                        |
|          | 8.13±0.04ms          | 8.20±0.02ms         | 1.01    | import_iris.Iris.time_palette                                                                        |
|          | 301±3μs              | 305±3μs             | 1.01    | import_iris.Iris.time_plot                                                                           |
|          | 93.7±2μs             | 96.8±2μs            | 1.03    | import_iris.Iris.time_quickplot                                                                      |
|          | 1.90±0.01ms          | 1.90±0.03ms         | 1.00    | import_iris.Iris.time_std_names                                                                      |
|          | 1.74±0.02ms          | 1.73±0.02ms         | 1.00    | import_iris.Iris.time_symbols                                                                        |
|          | 108±7ms              | 108±7ms             | 1.00    | import_iris.Iris.time_tests                                                                          |
|          | 220±2μs              | 222±2μs             | 1.01    | import_iris.Iris.time_third_party_cartopy                                                            |
|          | 4.81±0.04ms          | 4.80±0.03ms         | 1.00    | import_iris.Iris.time_third_party_cf_units                                                           |
|          | 103±2μs              | 105±0.7μs           | 1.01    | import_iris.Iris.time_third_party_cftime                                                             |
|          | 2.68±0.01ms          | 2.66±0.01ms         | 0.99    | import_iris.Iris.time_third_party_matplotlib                                                         |
|          | 1.01±0.01ms          | 1.02±0.02ms         | 1.01    | import_iris.Iris.time_third_party_numpy                                                              |
|          | 154±1μs              | 154±0.6μs           | 0.99    | import_iris.Iris.time_third_party_scipy                                                              |
|          | 93.4±1μs             | 92.8±0.8μs          | 0.99    | import_iris.Iris.time_time                                                                           |
|          | 293±5μs              | 289±2μs             | 0.99    | import_iris.Iris.time_util                                                                           |
|          | 81.6±0.9μs           | 82.5±1μs            | 1.01    | iterate.IZip.time_izip                                                                               |
|          | 7.79±0.05ms          | 7.97±0.1ms          | 1.02    | load.LoadAndRealise.time_load((1280, 960, 5), False, 'FF')                                           |
|          | 22.8±0.3ms           | 23.3±0.5ms          | 1.02    | load.LoadAndRealise.time_load((1280, 960, 5), False, 'NetCDF')                                       |
|          | 8.55±0.08ms          | 8.59±0.04ms         | 1.01    | load.LoadAndRealise.time_load((1280, 960, 5), False, 'PP')                                           |
|          | 7.85±0.09ms          | 7.86±0.03ms         | 1.00    | load.LoadAndRealise.time_load((1280, 960, 5), True, 'FF')                                            |
|          | 20.1±0.4ms           | 20.2±0.3ms          | 1.00    | load.LoadAndRealise.time_load((1280, 960, 5), True, 'NetCDF')                                        |
|          | 8.55±0.03ms          | 8.57±0.06ms         | 1.00    | load.LoadAndRealise.time_load((1280, 960, 5), True, 'PP')                                            |
|          | 1.32±0.01s           | 1.33±0.02s          | 1.01    | load.LoadAndRealise.time_load((2, 2, 1000), False, 'FF')                                             |
|          | 19.3±0.3ms           | 19.2±0.07ms         | 1.00    | load.LoadAndRealise.time_load((2, 2, 1000), False, 'NetCDF')                                         |
|          | 1.48±0.01s           | 1.47±0.01s          | 1.00    | load.LoadAndRealise.time_load((2, 2, 1000), False, 'PP')                                             |
|          | 1.32±0.01s           | 1.33±0.01s          | 1.01    | load.LoadAndRealise.time_load((2, 2, 1000), True, 'FF')                                              |
|          | 19.1±0.2ms           | 19.2±0.08ms         | 1.00    | load.LoadAndRealise.time_load((2, 2, 1000), True, 'NetCDF')                                          |
|          | 1.47±0.02s           | 1.49±0.01s          | 1.01    | load.LoadAndRealise.time_load((2, 2, 1000), True, 'PP')                                              |
|          | 3.81±0.02ms          | 3.77±0.05ms         | 0.99    | load.LoadAndRealise.time_load((50, 50, 2), False, 'FF')                                              |
|          | 18.7±0.2ms           | 18.6±0.09ms         | 1.00    | load.LoadAndRealise.time_load((50, 50, 2), False, 'NetCDF')                                          |
|          | 4.05±0.05ms          | 4.05±0.04ms         | 1.00    | load.LoadAndRealise.time_load((50, 50, 2), False, 'PP')                                              |
|          | 3.76±0.06ms          | 3.80±0.08ms         | 1.01    | load.LoadAndRealise.time_load((50, 50, 2), True, 'FF')                                               |
|          | 18.7±0.2ms           | 18.7±0.2ms          | 1.00    | load.LoadAndRealise.time_load((50, 50, 2), True, 'NetCDF')                                           |
|          | 4.01±0.02ms          | 4.01±0.02ms         | 1.00    | load.LoadAndRealise.time_load((50, 50, 2), True, 'PP')                                               |
|          | 34.0±2ms             | 34.8±1ms            | 1.03    | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'FF')                                        |
|          | 20.1±0.3ms           | 19.6±0.2ms          | 0.97    | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'NetCDF')                                    |
|          | 13.8±2ms             | 13.7±1ms            | 0.99    | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'PP')                                        |
|          | 26.0±3ms             | 26.1±1ms            | 1.00    | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'FF')                                         |
|          | 73.0±1ms             | 73.2±1ms            | 1.00    | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'NetCDF')                                     |
|          | 26.0±2ms             | 26.3±2ms            | 1.01    | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'PP')                                         |
|          | 444±2ms              | 448±6ms             | 1.01    | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'FF')                                          |
|          | 2.95±0.08ms          | 3.02±0.1ms          | 1.02    | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'NetCDF')                                      |
|          | 448±3ms              | 453±6ms             | 1.01    | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'PP')                                          |
|          | 449±2ms              | 451±5ms             | 1.00    | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'FF')                                           |
|          | 2.99±0.09ms          | 2.97±0.09ms         | 1.00    | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'NetCDF')                                       |
|          | 455±2ms              | 457±4ms             | 1.01    | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'PP')                                           |
|          | 1.55±0.1ms           | 1.57±0.09ms         | 1.01    | load.LoadAndRealise.time_realise((50, 50, 2), False, 'FF')                                           |
|          | 2.89±0.1ms           | 2.95±0.07ms         | 1.02    | load.LoadAndRealise.time_realise((50, 50, 2), False, 'NetCDF')                                       |
|          | 1.56±0.08ms          | 1.55±0.05ms         | 0.99    | load.LoadAndRealise.time_realise((50, 50, 2), False, 'PP')                                           |
|          | 1.56±0.09ms          | 1.54±0.08ms         | 0.98    | load.LoadAndRealise.time_realise((50, 50, 2), True, 'FF')                                            |
|          | 3.05±0.1ms           | 2.94±0.1ms          | 0.97    | load.LoadAndRealise.time_realise((50, 50, 2), True, 'NetCDF')                                        |
|          | 1.62±0.07ms          | 1.58±0.06ms         | 0.98    | load.LoadAndRealise.time_realise((50, 50, 2), True, 'PP')                                            |
|          | 338±6ms              | 331±3ms             | 0.98    | load.ManyVars.time_many_var_load                                                                     |
|          | 7.99±0.08ms          | 8.01±0.08ms         | 1.00    | load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'FF')                                     |
|          | 8.69±0.1ms           | 8.79±0.07ms         | 1.01    | load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'PP')                                     |
|          | 1.33±0.01s           | 1.33±0.02s          | 1.00    | load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'FF')                                       |
|          | 1.50±0.01s           | 1.50±0.01s          | 1.00    | load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'PP')                                       |
|          | 3.86±0.04ms          | 3.85±0.04ms         | 1.00    | load.STASHConstraint.time_stash_constraint((2, 2, 2), 'FF')                                          |
|          | 4.07±0.06ms          | 4.14±0.06ms         | 1.02    | load.STASHConstraint.time_stash_constraint((2, 2, 2), 'PP')                                          |
|          | 7.88±0.1ms           | 7.71±0.06ms         | 0.98    | load.StructuredFF.time_structured_load((1280, 960, 5), False)                                        |
|          | 4.51±0.03ms          | 4.51±0.05ms         | 1.00    | load.StructuredFF.time_structured_load((1280, 960, 5), True)                                         |
|          | 1.32±0.01s           | 1.33±0.02s          | 1.00    | load.StructuredFF.time_structured_load((2, 2, 1000), False)                                          |
|          | 354±2ms              | 359±3ms             | 1.01    | load.StructuredFF.time_structured_load((2, 2, 1000), True)                                           |
|          | 3.79±0.04ms          | 3.76±0.02ms         | 0.99    | load.StructuredFF.time_structured_load((2, 2, 2), False)                                             |
|          | 3.41±0.02ms          | 3.46±0.04ms         | 1.02    | load.StructuredFF.time_structured_load((2, 2, 2), True)                                              |
|          | 139±2ms              | 141±2ms             | 1.02    | load.TimeConstraint.time_time_constraint(20, 'FF')                                                   |
|          | 22.1±0.3ms           | 22.2±0.3ms          | 1.01    | load.TimeConstraint.time_time_constraint(20, 'NetCDF')                                               |
|          | 154±2ms              | 154±1ms             | 1.00    | load.TimeConstraint.time_time_constraint(20, 'PP')                                                   |
|          | 27.5±0.2ms           | 27.9±0.3ms          | 1.01    | load.TimeConstraint.time_time_constraint(3, 'FF')                                                    |
|          | 21.7±0.3ms           | 21.7±0.2ms          | 1.00    | load.TimeConstraint.time_time_constraint(3, 'NetCDF')                                                |
|          | 30.2±0.4ms           | 30.1±0.3ms          | 1.00    | load.TimeConstraint.time_time_constraint(3, 'PP')                                                    |
|          | 17.0±0.5ms           | 17.0±0.2ms          | 1.00    | load.ugrid.BasicLoading.time_load_file(1)                                                            |
|          | 39.4±0.5ms           | 40.4±0.4ms          | 1.03    | load.ugrid.BasicLoading.time_load_file(200000)                                                       |
|          | 13.5±0.2ms           | 13.7±0.6ms          | 1.01    | load.ugrid.BasicLoading.time_load_mesh(1)                                                            |
|          | 21.9±0.5ms           | 22.0±0.7ms          | 1.00    | load.ugrid.BasicLoading.time_load_mesh(200000)                                                       |
|          | 17.4±0.4ms           | 16.9±0.7ms          | 0.97    | load.ugrid.BasicLoadingTime.time_load_file(1)                                                        |
|          | 20.3±0.4ms           | 19.8±0.3ms          | 0.97    | load.ugrid.BasicLoadingTime.time_load_file(200000)                                                   |
|          | 13.6±0.07ms          | 13.4±0.1ms          | 0.99    | load.ugrid.BasicLoadingTime.time_load_mesh(1)                                                        |
|          | 16.8±0.4ms           | 16.3±0.3ms          | 0.97    | load.ugrid.BasicLoadingTime.time_load_mesh(200000)                                                   |
|          | 18.0±0.4ms           | 17.8±0.3ms          | 0.99    | load.ugrid.Callback.time_load_file_callback(1)                                                       |
|          | 47.4±0.6ms           | 48.0±0.4ms          | 1.01    | load.ugrid.Callback.time_load_file_callback(200000)                                                  |
|          | 18.3±0.5ms           | 17.8±0.3ms          | 0.98    | load.ugrid.CallbackTime.time_load_file_callback(1)                                                   |
|          | 21.2±0.5ms           | 21.3±0.5ms          | 1.00    | load.ugrid.CallbackTime.time_load_file_callback(200000)                                              |
|          | 2.79±0.1ms           | 2.72±0.08ms         | 0.97    | load.ugrid.DataRealisation.time_realise_data(10000)                                                  |
|          | 5.53±0.1ms           | 5.53±0.2ms          | 1.00    | load.ugrid.DataRealisation.time_realise_data(200000)                                                 |
|          | 38.8±1ms             | 39.9±2ms            | 1.03    | load.ugrid.DataRealisationTime.time_realise_data(10000)                                              |
|          | 819±7ms              | 818±10ms            | 1.00    | load.ugrid.DataRealisationTime.time_realise_data(200000)                                             |
|          | 101±0.6ns            | 102±0.3ns           | 1.01    | metadata_manager_factory.MetadataManagerFactory.time_AncillaryVariableMetadata_fields                |
|          | 893±4ns              | 903±4ns             | 1.01    | metadata_manager_factory.MetadataManagerFactory.time_AncillaryVariableMetadata_values                |
|          | 101±0.8ns            | 103±2ns             | 1.02    | metadata_manager_factory.MetadataManagerFactory.time_BaseMetadata_fields                             |
|          | 906±5ns              | 899±6ns             | 0.99    | metadata_manager_factory.MetadataManagerFactory.time_BaseMetadata_values                             |
|          | 101±1ns              | 102±0.4ns           | 1.00    | metadata_manager_factory.MetadataManagerFactory.time_CellMeasuresMetadata_fields                     |
|          | 1.02±0.01μs          | 1.01±0μs            | 0.99    | metadata_manager_factory.MetadataManagerFactory.time_CellMeasuresMetadata_values                     |
|          | 101±0.9ns            | 101±0.7ns           | 1.00    | metadata_manager_factory.MetadataManagerFactory.time_CoordMetadata_fields                            |
|          | 1.09±0.01μs          | 1.07±0μs            | 0.98    | metadata_manager_factory.MetadataManagerFactory.time_CoordMetadata_values                            |
|          | 102±2ns              | 102±0.8ns           | 1.01    | metadata_manager_factory.MetadataManagerFactory.time_CubeMetadata_fields                             |
|          | 1.01±0μs             | 1.01±0.01μs         | 1.00    | metadata_manager_factory.MetadataManagerFactory.time_CubeMetadata_values                             |
|          | 105±1ns              | 102±0.6ns           | 0.97    | metadata_manager_factory.MetadataManagerFactory.time_DimCoordMetadata_fields                         |
|          | 1.18±0.01μs          | 1.15±0.02μs         | 0.98    | metadata_manager_factory.MetadataManagerFactory.time_DimCoordMetadata_values                         |
|          | 1000±20ns            | 980±6ns             | 0.98    | metadata_manager_factory.MetadataManagerFactory__create.time_AncillaryVariableMetadata(1)            |
|          | 6.91±0.2μs           | 6.73±0.07μs         | 0.97    | metadata_manager_factory.MetadataManagerFactory__create.time_AncillaryVariableMetadata(10)           |
|          | 65.7±2μs             | 63.6±0.7μs          | 0.97    | metadata_manager_factory.MetadataManagerFactory__create.time_AncillaryVariableMetadata(100)          |
|          | 1.01±0.01μs          | 989±6ns             | 0.98    | metadata_manager_factory.MetadataManagerFactory__create.time_BaseMetadata(1)                         |
|          | 6.91±0.06μs          | 6.76±0.02μs         | 0.98    | metadata_manager_factory.MetadataManagerFactory__create.time_BaseMetadata(10)                        |
|          | 64.3±2μs             | 64.1±0.5μs          | 1.00    | metadata_manager_factory.MetadataManagerFactory__create.time_BaseMetadata(100)                       |
|          | 1.06±0.01μs          | 1.05±0.02μs         | 0.98    | metadata_manager_factory.MetadataManagerFactory__create.time_CellMeasureMetadata(1)                  |
|          | 7.29±0.09μs          | 7.36±0.08μs         | 1.01    | metadata_manager_factory.MetadataManagerFactory__create.time_CellMeasureMetadata(10)                 |
|          | 69.4±0.5μs           | 68.7±0.7μs          | 0.99    | metadata_manager_factory.MetadataManagerFactory__create.time_CellMeasureMetadata(100)                |
|          | 1.09±0.01μs          | 1.08±0.01μs         | 0.99    | metadata_manager_factory.MetadataManagerFactory__create.time_CoordMetadata(1)                        |
|          | 7.78±0.3μs           | 7.75±0.2μs          | 1.00    | metadata_manager_factory.MetadataManagerFactory__create.time_CoordMetadata(10)                       |
|          | 73.8±1μs             | 72.9±0.3μs          | 0.99    | metadata_manager_factory.MetadataManagerFactory__create.time_CoordMetadata(100)                      |
|          | 1.04±0.01μs          | 1.03±0μs            | 0.99    | metadata_manager_factory.MetadataManagerFactory__create.time_CubeMetadata(1)                         |
|          | 7.37±0.1μs           | 7.43±0.1μs          | 1.01    | metadata_manager_factory.MetadataManagerFactory__create.time_CubeMetadata(10)                        |
|          | 70.0±0.5μs           | 68.9±0.8μs          | 0.99    | metadata_manager_factory.MetadataManagerFactory__create.time_CubeMetadata(100)                       |
|          | 1.11±0.01μs          | 1.12±0.01μs         | 1.00    | metadata_manager_factory.MetadataManagerFactory__create.time_DimCoordMetadata(1)                     |
|          | 7.95±0.09μs          | 8.04±0.06μs         | 1.01    | metadata_manager_factory.MetadataManagerFactory__create.time_DimCoordMetadata(10)                    |
|          | 77.1±2μs             | 77.1±0.6μs          | 1.00    | metadata_manager_factory.MetadataManagerFactory__create.time_DimCoordMetadata(100)                   |
|          | 107±1ns              | 107±0.4ns           | 1.00    | mixin.CFVariableMixin.time_get_attributes                                                            |
|          | 108±1ns              | 107±0.5ns           | 1.00    | mixin.CFVariableMixin.time_get_long_name                                                             |
|          | 955±6ns              | 954±20ns            | 1.00    | mixin.CFVariableMixin.time_get_metadata                                                              |
|          | 107±0.7ns            | 108±0.5ns           | 1.01    | mixin.CFVariableMixin.time_get_standard_name                                                         |
|          | 107±1ns              | 108±0.5ns           | 1.01    | mixin.CFVariableMixin.time_get_units                                                                 |
|          | 108±0.4ns            | 107±0.7ns           | 0.99    | mixin.CFVariableMixin.time_get_var_name                                                              |
|          | 682±10ns             | 698±10ns            | 1.02    | mixin.CFVariableMixin.time_set_attributes                                                            |
|          | 113±0.6ns            | 114±0.7ns           | 1.00    | mixin.CFVariableMixin.time_set_long_name                                                             |
|          | 3.45±0.04μs          | 3.50±0.05μs         | 1.01    | mixin.CFVariableMixin.time_set_metadata__dict                                                        |
|          | 4.34±0.07μs          | 4.32±0.07μs         | 1.00    | mixin.CFVariableMixin.time_set_metadata__metadata                                                    |
|          | 4.27±0.07μs          | 4.26±0.05μs         | 1.00    | mixin.CFVariableMixin.time_set_metadata__tuple                                                       |
|          | 540±4ns              | 542±5ns             | 1.00    | mixin.CFVariableMixin.time_set_standard_name                                                         |
|          | 424±4ns              | 414±1ns             | 0.98    | mixin.CFVariableMixin.time_set_units                                                                 |
|          | 437±10ns             | 432±5ns             | 0.99    | mixin.CFVariableMixin.time_set_var_name                                                              |
|          | 370±2ms              | 374±2ms             | 1.01    | plot.AuxSort.time_aux_sort                                                                           |
|          | 81.0±3ms             | 80.1±3ms            | 0.99    | regridding.CurvilinearRegridding.time_regrid_pic                                                     |
|          | 98.1±0.7ms           | 97.5±0.6ms          | 0.99    | regridding.HorizontalChunkedRegridding.time_regrid_area_w                                            |
|          | 51.2±2ms             | 50.1±2ms            | 0.98    | regridding.HorizontalChunkedRegridding.time_regrid_area_w_new_grid                                   |
|          | 4.01±0.06ms          | 3.98±0.06ms         | 0.99    | save.NetcdfSave.time_netcdf_save_cube(50, False)                                                     |
|          | 70.6±0.5ms           | 71.1±0.7ms          | 1.01    | save.NetcdfSave.time_netcdf_save_cube(50, True)                                                      |
|          | 55.3±40ms            | 52.0±0.7ms          | 0.94    | save.NetcdfSave.time_netcdf_save_cube(600, False)                                                    |
|          | 566±3ms              | 565±5ms             | 1.00    | save.NetcdfSave.time_netcdf_save_cube(600, True)                                                     |
|          | 101±0.6ns            | 100.0±0.6ns         | 0.99    | save.NetcdfSave.time_netcdf_save_mesh(50, False)                                                     |
|          | 54.1±0.5ms           | 54.9±0.5ms          | 1.01    | save.NetcdfSave.time_netcdf_save_mesh(50, True)                                                      |
|          | 101±1ns              | 99.7±0.5ns          | 0.99    | save.NetcdfSave.time_netcdf_save_mesh(600, False)                                                    |
|          | 500±3ms              | 505±4ms             | 1.01    | save.NetcdfSave.time_netcdf_save_mesh(600, True)                                                     |
|          | 41.4±1ms             | 41.5±1ms            | 1.00    | stats.PearsonR.time_lazy                                                                             |
|          | 19.2±0.4ms           | 19.3±0.4ms          | 1.01    | stats.PearsonR.time_real                                                                             |
|          | 23.5±0.5ms           | 22.7±1ms            | 0.97    | trajectory.TrajectoryInterpolation.time_trajectory_linear                                            |
|          | 60.4±0.4ms           | 60.6±0.5ms          | 1.00    | trajectory.TrajectoryInterpolation.time_trajectory_nearest                                           |

Generated by GHA run 8521713466

@bjlittle bjlittle marked this pull request as ready for review April 2, 2024 12:03
@bjlittle
Copy link
Member Author

bjlittle commented Apr 2, 2024

As this pull-request is being automatically benchmarked, I'll add an associated whatsnew entry in a follow-up pull-request 👍

Copy link

codecov bot commented Apr 2, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 89.76%. Comparing base (375da2d) to head (c1b6651).
Report is 22 commits behind head on main.

❗ Current head c1b6651 differs from pull request most recent head 44bc4b8. Consider uploading reports for the commit 44bc4b8 to get more accurate results

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #5894      +/-   ##
==========================================
+ Coverage   89.73%   89.76%   +0.03%     
==========================================
  Files          92       93       +1     
  Lines       22898    22957      +59     
  Branches     5453     4995     -458     
==========================================
+ Hits        20547    20607      +60     
  Misses       1620     1620              
+ Partials      731      730       -1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Contributor

github-actions bot commented Apr 2, 2024

⏱️ Performance Benchmark Report: e06cb2a

Performance shifts
| Change   | Before [03a2d5cf]    | After [e06cb2af]    |   Ratio | Benchmark (Parameter)                                                                  |
|----------|----------------------|---------------------|---------|----------------------------------------------------------------------------------------|
| -        | 417±4ns              | 336±7ns             |    0.81 | coords.AuxCoord.time_bounds                                                            |
| -        | 405±3ns              | 317±10ns            |    0.78 | coords.AuxCoord.time_points                                                            |
| -        | 614±3ns              | 490±10ns            |    0.8  | experimental.ugrid.Connectivity.time_indices(1000000)                                  |
| -        | 609±3ns              | 485±9ns             |    0.8  | experimental.ugrid.Connectivity.time_indices(6)                                        |
| -        | 5.04±0.07μs          | 3.74±0.03μs         |    0.74 | experimental.ugrid.Mesh.time_connectivities(1000000)                                   |
| -        | 4.98±0.06μs          | 3.69±0.05μs         |    0.74 | experimental.ugrid.Mesh.time_connectivities(6)                                         |
| -        | 4.98±0.07μs          | 3.58±0.04μs         |    0.72 | experimental.ugrid.Mesh.time_remove_connectivities(1000000)                            |
| -        | 4.95±0.05μs          | 3.49±0.04μs         |    0.71 | experimental.ugrid.Mesh.time_remove_connectivities(6)                                  |
| -        | 512±8ns              | 397±2ns             |    0.78 | experimental.ugrid.regions_combine.CombineRegionsComputeRealData.time_compute_data(50) |
| -        | 103±2ns              | 78.8±2ns            |    0.77 | metadata_manager_factory.MetadataManagerFactory.time_AncillaryVariableMetadata_fields  |
| -        | 900±9ns              | 740±5ns             |    0.82 | metadata_manager_factory.MetadataManagerFactory.time_AncillaryVariableMetadata_values  |
| -        | 104±0.7ns            | 77.8±0.7ns          |    0.75 | metadata_manager_factory.MetadataManagerFactory.time_BaseMetadata_fields               |
| -        | 900±3ns              | 740±8ns             |    0.82 | metadata_manager_factory.MetadataManagerFactory.time_BaseMetadata_values               |
| -        | 106±4ns              | 78.3±1ns            |    0.74 | metadata_manager_factory.MetadataManagerFactory.time_CellMeasuresMetadata_fields       |
| -        | 104±2ns              | 77.8±0.6ns          |    0.75 | metadata_manager_factory.MetadataManagerFactory.time_CoordMetadata_fields              |
| -        | 103±1ns              | 78.2±1ns            |    0.76 | metadata_manager_factory.MetadataManagerFactory.time_CubeMetadata_fields               |
| -        | 104±4ns              | 78.6±1ns            |    0.76 | metadata_manager_factory.MetadataManagerFactory.time_DimCoordMetadata_fields           |
| -        | 109±3ns              | 83.7±0.4ns          |    0.77 | mixin.CFVariableMixin.time_get_attributes                                              |
| -        | 108±2ns              | 82.6±1ns            |    0.77 | mixin.CFVariableMixin.time_get_long_name                                               |
| -        | 949±7ns              | 782±10ns            |    0.82 | mixin.CFVariableMixin.time_get_metadata                                                |
| -        | 108±0.9ns            | 83.9±4ns            |    0.78 | mixin.CFVariableMixin.time_get_standard_name                                           |
| -        | 108±1ns              | 83.5±0.6ns          |    0.78 | mixin.CFVariableMixin.time_get_units                                                   |
| -        | 109±2ns              | 82.3±1ns            |    0.76 | mixin.CFVariableMixin.time_get_var_name                                                |
Full benchmark results

Benchmarks that have improved:

| Change   | Before [03a2d5cf]    | After [e06cb2af]    |   Ratio | Benchmark (Parameter)                                                                  |
|----------|----------------------|---------------------|---------|----------------------------------------------------------------------------------------|
| -        | 417±4ns              | 336±7ns             |    0.81 | coords.AuxCoord.time_bounds                                                            |
| -        | 405±3ns              | 317±10ns            |    0.78 | coords.AuxCoord.time_points                                                            |
| -        | 614±3ns              | 490±10ns            |    0.8  | experimental.ugrid.Connectivity.time_indices(1000000)                                  |
| -        | 609±3ns              | 485±9ns             |    0.8  | experimental.ugrid.Connectivity.time_indices(6)                                        |
| -        | 5.04±0.07μs          | 3.74±0.03μs         |    0.74 | experimental.ugrid.Mesh.time_connectivities(1000000)                                   |
| -        | 4.98±0.06μs          | 3.69±0.05μs         |    0.74 | experimental.ugrid.Mesh.time_connectivities(6)                                         |
| -        | 4.98±0.07μs          | 3.58±0.04μs         |    0.72 | experimental.ugrid.Mesh.time_remove_connectivities(1000000)                            |
| -        | 4.95±0.05μs          | 3.49±0.04μs         |    0.71 | experimental.ugrid.Mesh.time_remove_connectivities(6)                                  |
| -        | 512±8ns              | 397±2ns             |    0.78 | experimental.ugrid.regions_combine.CombineRegionsComputeRealData.time_compute_data(50) |
| -        | 103±2ns              | 78.8±2ns            |    0.77 | metadata_manager_factory.MetadataManagerFactory.time_AncillaryVariableMetadata_fields  |
| -        | 900±9ns              | 740±5ns             |    0.82 | metadata_manager_factory.MetadataManagerFactory.time_AncillaryVariableMetadata_values  |
| -        | 104±0.7ns            | 77.8±0.7ns          |    0.75 | metadata_manager_factory.MetadataManagerFactory.time_BaseMetadata_fields               |
| -        | 900±3ns              | 740±8ns             |    0.82 | metadata_manager_factory.MetadataManagerFactory.time_BaseMetadata_values               |
| -        | 106±4ns              | 78.3±1ns            |    0.74 | metadata_manager_factory.MetadataManagerFactory.time_CellMeasuresMetadata_fields       |
| -        | 104±2ns              | 77.8±0.6ns          |    0.75 | metadata_manager_factory.MetadataManagerFactory.time_CoordMetadata_fields              |
| -        | 103±1ns              | 78.2±1ns            |    0.76 | metadata_manager_factory.MetadataManagerFactory.time_CubeMetadata_fields               |
| -        | 104±4ns              | 78.6±1ns            |    0.76 | metadata_manager_factory.MetadataManagerFactory.time_DimCoordMetadata_fields           |
| -        | 109±3ns              | 83.7±0.4ns          |    0.77 | mixin.CFVariableMixin.time_get_attributes                                              |
| -        | 108±2ns              | 82.6±1ns            |    0.77 | mixin.CFVariableMixin.time_get_long_name                                               |
| -        | 949±7ns              | 782±10ns            |    0.82 | mixin.CFVariableMixin.time_get_metadata                                                |
| -        | 108±0.9ns            | 83.9±4ns            |    0.78 | mixin.CFVariableMixin.time_get_standard_name                                           |
| -        | 108±1ns              | 83.5±0.6ns          |    0.78 | mixin.CFVariableMixin.time_get_units                                                   |
| -        | 109±2ns              | 82.3±1ns            |    0.76 | mixin.CFVariableMixin.time_get_var_name                                                |

Benchmarks that have stayed the same:

| Change   | Before [03a2d5cf]    | After [e06cb2af]    | Ratio   | Benchmark (Parameter)                                                                                |
|----------|----------------------|---------------------|---------|------------------------------------------------------------------------------------------------------|
|          | n/a                  | n/a                 | n/a     | aux_factory.FactoryCommon.time_create                                                                |
|          | 4.32±0.04μs          | 4.38±0.05μs         | 1.01    | aux_factory.HybridHeightFactory.time_create                                                          |
|          | 4.85±0.03μs          | 4.90±0.1μs          | 1.01    | coords.AncillaryVariable.time_create                                                                 |
|          | 8.90±0.06μs          | 8.64±0.02μs         | 0.97    | coords.AuxCoord.time_create                                                                          |
|          | 247±20μs             | 244±9μs             | 0.99    | coords.AuxCoordLazy.time_bounds                                                                      |
|          | 13.3±0.7μs           | 13.6±0.5μs          | 1.02    | coords.AuxCoordLazy.time_create                                                                      |
|          | 243±20μs             | 240±10μs            | 0.99    | coords.AuxCoordLazy.time_points                                                                      |
|          | 5.27±0.06μs          | 5.24±0.08μs         | 0.99    | coords.CellMeasure.time_create                                                                       |
|          | 1.11±0.02μs          | 1.09±0.01μs         | 0.98    | coords.CellMethod.time_create                                                                        |
|          | n/a                  | n/a                 | n/a     | coords.CoordCommon.time_create                                                                       |
|          | 111±1μs              | 105±1μs             | 0.95    | coords.DimCoord.time_create                                                                          |
|          | 31.5±0.3μs           | 30.2±0.5μs          | 0.96    | coords.DimCoord.time_regular                                                                         |
|          | 379±2ms              | 381±5ms             | 1.00    | cube.Aggregation.time_aggregated_by                                                                  |
|          | 57.9±0.8μs           | 58.4±0.5μs          | 1.01    | cube.AncillaryVariable.time_add                                                                      |
|          | 11.4±0.1μs           | 10.7±0.2μs          | 0.95    | cube.AncillaryVariable.time_create                                                                   |
|          | 66.6±0.5μs           | 64.7±0.3μs          | 0.97    | cube.AuxCoord.time_add                                                                               |
|          | 9.52±0.2μs           | 9.39±0.06μs         | 0.99    | cube.AuxCoord.time_create                                                                            |
|          | 6.01±0.04μs          | 5.09±0.03μs         | 0.85    | cube.AuxCoord.time_return_coord_dims                                                                 |
|          | 4.51±0.06μs          | 3.77±0.06μs         | 0.84    | cube.AuxCoord.time_return_coords                                                                     |
|          | 40.2±0.7μs           | 38.0±0.5μs          | 0.94    | cube.AuxFactory.time_add                                                                             |
|          | 12.3±0.2μs           | 11.6±0.1μs          | 0.94    | cube.AuxFactory.time_create                                                                          |
|          | 59.6±0.7μs           | 58.0±0.5μs          | 0.97    | cube.CellMeasure.time_add                                                                            |
|          | 11.6±0.2μs           | 10.8±0.1μs          | 0.93    | cube.CellMeasure.time_create                                                                         |
|          | 52.6±0.4μs           | 52.0±0.4μs          | 0.99    | cube.CellMethod.time_add                                                                             |
|          | 7.21±0.1μs           | 7.66±0.1μs          | 1.06    | cube.CellMethod.time_create                                                                          |
|          | n/a                  | n/a                 | n/a     | cube.ComponentCommon.time_add                                                                        |
|          | n/a                  | n/a                 | n/a     | cube.ComponentCommon.time_create                                                                     |
|          | 131±0.3ms            | 130±0.5ms           | 1.00    | cube.Concatenate.time_concatenate                                                                    |
|          | 6.78±0.07μs          | 7.17±0.06μs         | 1.06    | cube.Cube.time_basic                                                                                 |
|          | 57.9±0.2ns           | 52.8±1ns            | 0.91    | cube.Cube.time_rename                                                                                |
|          | 61.3±0.9μs           | 55.7±0.7μs          | 0.91    | cube.Equality.time_equality                                                                          |
|          | 333±3ms              | 334±2ms             | 1.00    | cube.Merge.time_merge                                                                                |
|          | 29.4±1μs             | 27.7±1μs            | 0.94    | cube.MeshCoord.time_add(10000)                                                                       |
|          | 31.2±2μs             | 28.8±0.9μs          | 0.92    | cube.MeshCoord.time_add(1000000)                                                                     |
|          | 26.9±2μs             | 24.6±1μs            | 0.92    | cube.MeshCoord.time_add(6)                                                                           |
|          | 19.6±0.2μs           | 17.0±0.5μs          | 0.87    | cube.MeshCoord.time_create(10000)                                                                    |
|          | 19.4±0.3μs           | 16.7±0.3μs          | 0.86    | cube.MeshCoord.time_create(1000000)                                                                  |
|          | 18.7±0.3μs           | 16.5±0.3μs          | 0.88    | cube.MeshCoord.time_create(6)                                                                        |
|          | 57.6±4μs             | 55.3±2μs            | 0.96    | cube.MeshCoord.time_remove(10000)                                                                    |
|          | 60.0±5μs             | 59.5±1μs            | 0.99    | cube.MeshCoord.time_remove(1000000)                                                                  |
|          | 56.4±4μs             | 50.8±3μs            | 0.90    | cube.MeshCoord.time_remove(6)                                                                        |
|          | 2.95±0.05ms          | 2.44±0.3ms          | ~0.83   | experimental.ugrid.Connectivity.time_create(1000000)                                                 |
|          | 1.86±0.02ms          | 1.95±0.01ms         | 1.05    | experimental.ugrid.Connectivity.time_create(6)                                                       |
|          | 23.8±2ms             | 21.3±0.5ms          | 0.90    | experimental.ugrid.Connectivity.time_location_lengths(1000000)                                       |
|          | 2.72±0.03ms          | 2.73±0.04ms         | 1.00    | experimental.ugrid.Connectivity.time_location_lengths(6)                                             |
|          | 28.2±3ms             | 28.8±3ms            | 1.02    | experimental.ugrid.Connectivity.time_validate_indices(1000000)                                       |
|          | 3.99±0.02ms          | 4.12±0.08ms         | 1.03    | experimental.ugrid.Connectivity.time_validate_indices(6)                                             |
|          | 4.41±0.1ms           | 4.49±0.1ms          | 1.02    | experimental.ugrid.ConnectivityLazy.time_create(1000000)                                             |
|          | 3.24±0.04ms          | 3.41±0.04ms         | 1.05    | experimental.ugrid.ConnectivityLazy.time_create(6)                                                   |
|          | 259±9μs              | 258±8μs             | 0.99    | experimental.ugrid.ConnectivityLazy.time_indices(1000000)                                            |
|          | 255±9μs              | 254±4μs             | 0.99    | experimental.ugrid.ConnectivityLazy.time_indices(6)                                                  |
|          | 20.6±0.2ms           | 21.5±0.5ms          | 1.04    | experimental.ugrid.ConnectivityLazy.time_location_lengths(1000000)                                   |
|          | 2.99±0.05ms          | 3.02±0.03ms         | 1.01    | experimental.ugrid.ConnectivityLazy.time_location_lengths(6)                                         |
|          | 23.5±0.5ms           | 24.4±0.3ms          | 1.04    | experimental.ugrid.ConnectivityLazy.time_validate_indices(1000000)                                   |
|          | 4.33±0.06ms          | 4.39±0.07ms         | 1.01    | experimental.ugrid.ConnectivityLazy.time_validate_indices(6)                                         |
|          | 12.9±0.2μs           | 11.5±0.1μs          | 0.90    | experimental.ugrid.Mesh.time_add_connectivities(1000000)                                             |
|          | 364±5μs              | 360±7μs             | 0.99    | experimental.ugrid.Mesh.time_add_connectivities(6)                                                   |
|          | 4.83±0.04μs          | 4.30±0.04μs         | 0.89    | experimental.ugrid.Mesh.time_add_coords(1000000)                                                     |
|          | 4.82±0.03μs          | 4.21±0.05μs         | 0.87    | experimental.ugrid.Mesh.time_add_coords(6)                                                           |
|          | 5.87±0.1μs           | 5.13±0.04μs         | 0.87    | experimental.ugrid.Mesh.time_coords(1000000)                                                         |
|          | 5.86±0.07μs          | 5.14±0.04μs         | 0.88    | experimental.ugrid.Mesh.time_coords(6)                                                               |
|          | 45.7±0.8μs           | 41.3±0.7μs          | 0.90    | experimental.ugrid.Mesh.time_create(1000000)                                                         |
|          | 408±8μs              | 419±5μs             | 1.03    | experimental.ugrid.Mesh.time_create(6)                                                               |
|          | 79.7±2ms             | 82.5±2ms            | 1.03    | experimental.ugrid.Mesh.time_eq(1000000)                                                             |
|          | 277±2μs              | 256±4μs             | 0.92    | experimental.ugrid.Mesh.time_eq(6)                                                                   |
|          | 7.53±0.1μs           | 6.32±0.05μs         | 0.84    | experimental.ugrid.Mesh.time_remove_coords(1000000)                                                  |
|          | 7.46±0.09μs          | 6.27±0.04μs         | 0.84    | experimental.ugrid.Mesh.time_remove_coords(6)                                                        |
|          | 10.7±0.08μs          | 10.9±0.1μs          | 1.02    | experimental.ugrid.MeshCoord.time_bounds(10000)                                                      |
|          | 124±2ms              | 124±3ms             | 1.00    | experimental.ugrid.MeshCoord.time_bounds(1000000)                                                    |
|          | 5.33±0.1μs           | 5.34±0.07μs         | 1.00    | experimental.ugrid.MeshCoord.time_bounds(6)                                                          |
|          | 3.65±0.05ms          | 3.77±0.06ms         | 1.03    | experimental.ugrid.MeshCoord.time_create(10000)                                                      |
|          | 3.66±0.04ms          | 3.80±0.03ms         | 1.04    | experimental.ugrid.MeshCoord.time_create(1000000)                                                    |
|          | 199±0.7μs            | 195±4μs             | 0.98    | experimental.ugrid.MeshCoord.time_create(6)                                                          |
|          | 3.63±0.04μs          | 3.45±0.04μs         | 0.95    | experimental.ugrid.MeshCoord.time_points(10000)                                                      |
|          | 4.16±0.06μs          | 3.95±0.07μs         | 0.95    | experimental.ugrid.MeshCoord.time_points(1000000)                                                    |
|          | 2.93±0.02μs          | 2.73±0.05μs         | 0.93    | experimental.ugrid.MeshCoord.time_points(6)                                                          |
|          | 7.74±0.1ms           | 7.81±0.1ms          | 1.01    | experimental.ugrid.MeshCoordLazy.time_bounds(10000)                                                  |
|          | 125±2ms              | 124±2ms             | 0.99    | experimental.ugrid.MeshCoordLazy.time_bounds(1000000)                                                |
|          | 13.0±0.7μs           | 12.4±0.5μs          | 0.95    | experimental.ugrid.MeshCoordLazy.time_bounds(6)                                                      |
|          | 3.77±0.08ms          | 3.80±0.04ms         | 1.01    | experimental.ugrid.MeshCoordLazy.time_create(10000)                                                  |
|          | 3.72±0.05ms          | 3.82±0.05ms         | 1.03    | experimental.ugrid.MeshCoordLazy.time_create(1000000)                                                |
|          | 242±9μs              | 241±5μs             | 1.00    | experimental.ugrid.MeshCoordLazy.time_create(6)                                                      |
|          | 2.67±0.07ms          | 2.68±0.07ms         | 1.00    | experimental.ugrid.MeshCoordLazy.time_points(10000)                                                  |
|          | 4.70±0.1ms           | 4.81±0.1ms          | 1.02    | experimental.ugrid.MeshCoordLazy.time_points(1000000)                                                |
|          | 8.94±0.6μs           | 8.08±0.4μs          | 0.90    | experimental.ugrid.MeshCoordLazy.time_points(6)                                                      |
|          | 32.9±1μs             | 32.0±1μs            | 0.97    | experimental.ugrid.MeshLazy.time_add_connectivities(1000000)                                         |
|          | 410±20μs             | 420±10μs            | 1.02    | experimental.ugrid.MeshLazy.time_add_connectivities(6)                                               |
|          | 18.8±2μs             | 18.6±0.8μs          | 0.99    | experimental.ugrid.MeshLazy.time_add_coords(1000000)                                                 |
|          | 19.5±2μs             | 16.9±0.7μs          | 0.87    | experimental.ugrid.MeshLazy.time_add_coords(6)                                                       |
|          | 16.9±1μs             | 16.1±1μs            | 0.95    | experimental.ugrid.MeshLazy.time_connectivities(1000000)                                             |
|          | 16.8±0.6μs           | 15.5±0.8μs          | 0.92    | experimental.ugrid.MeshLazy.time_connectivities(6)                                                   |
|          | 19.0±0.7μs           | 19.0±0.9μs          | 1.00    | experimental.ugrid.MeshLazy.time_coords(1000000)                                                     |
|          | 19.8±1μs             | 20.0±0.7μs          | 1.01    | experimental.ugrid.MeshLazy.time_coords(6)                                                           |
|          | 80.2±4μs             | 79.8±3μs            | 1.00    | experimental.ugrid.MeshLazy.time_create(1000000)                                                     |
|          | 460±20μs             | 466±9μs             | 1.01    | experimental.ugrid.MeshLazy.time_create(6)                                                           |
|          | 80.7±3ms             | 80.6±2ms            | 1.00    | experimental.ugrid.MeshLazy.time_eq(1000000)                                                         |
|          | 365±10μs             | 347±20μs            | 0.95    | experimental.ugrid.MeshLazy.time_eq(6)                                                               |
|          | 18.0±0.9μs           | 16.9±0.8μs          | 0.94    | experimental.ugrid.MeshLazy.time_remove_connectivities(1000000)                                      |
|          | 18.3±0.9μs           | 16.2±0.6μs          | 0.88    | experimental.ugrid.MeshLazy.time_remove_connectivities(6)                                            |
|          | 32.0±1μs             | 32.9±2μs            | 1.03    | experimental.ugrid.MeshLazy.time_remove_coords(1000000)                                              |
|          | 31.3±1μs             | 31.0±0.9μs          | 0.99    | experimental.ugrid.MeshLazy.time_remove_coords(6)                                                    |
|          | n/a                  | n/a                 | n/a     | experimental.ugrid.UGridCommon.time_create(1000000)                                                  |
|          | n/a                  | n/a                 | n/a     | experimental.ugrid.UGridCommon.time_create(6)                                                        |
|          | 248±1ms              | 260±2ms             | 1.05    | experimental.ugrid.regions_combine.CombineRegionsComputeRealData.time_compute_data(500)              |
|          | 13.9±0.1ms           | 14.1±0.2ms          | 1.02    | experimental.ugrid.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(50)            |
|          | 15.4±0.4ms           | 15.8±0.2ms          | 1.02    | experimental.ugrid.regions_combine.CombineRegionsCreateCube.time_create_combined_cube(500)           |
|          | 5.0                  | 5.0                 | 1.00    | experimental.ugrid.regions_combine.CombineRegionsCreateCube.track_addedmem_create_combined_cube(50)  |
|          | 5.0                  | 5.0                 | 1.00    | experimental.ugrid.regions_combine.CombineRegionsCreateCube.track_addedmem_create_combined_cube(500) |
|          | 105±1ms              | 108±1ms             | 1.03    | experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(50)          |
|          | 697±6ms              | 714±3ms             | 1.02    | experimental.ugrid.regions_combine.CombineRegionsFileStreamedCalc.time_stream_file2file(500)         |
|          | 66.5±0.9ms           | 68.4±0.6ms          | 1.03    | experimental.ugrid.regions_combine.CombineRegionsSaveData.time_save(50)                              |
|          | 649±4ms              | 658±3ms             | 1.01    | experimental.ugrid.regions_combine.CombineRegionsSaveData.time_save(500)                             |
|          | 2.1752849999999997   | 2.1752849999999997  | 1.00    | experimental.ugrid.regions_combine.CombineRegionsSaveData.track_filesize_saved(50)                   |
|          | 216.01528499999998   | 216.01528499999998  | 1.00    | experimental.ugrid.regions_combine.CombineRegionsSaveData.track_filesize_saved(500)                  |
|          | 577±10μs             | 671±7μs             | 1.16    | import_iris.Iris.time__concatenate                                                                   |
|          | 166±3μs              | 185±2μs             | 1.11    | import_iris.Iris.time__constraints                                                                   |
|          | 102±1μs              | 112±1μs             | 1.10    | import_iris.Iris.time__data_manager                                                                  |
|          | 85.9±0.5μs           | 94.4±1μs            | 1.10    | import_iris.Iris.time__deprecation                                                                   |
|          | 110±0.9μs            | 121±2μs             | 1.11    | import_iris.Iris.time__lazy_data                                                                     |
|          | 787±4μs              | 910±8μs             | 1.16    | import_iris.Iris.time__merge                                                                         |
|          | 71.6±0.4μs           | 77.9±0.5μs          | 1.09    | import_iris.Iris.time__representation                                                                |
|          | 443±10μs             | 500±7μs             | 1.13    | import_iris.Iris.time_analysis                                                                       |
|          | 128±2μs              | 141±1μs             | 1.10    | import_iris.Iris.time_analysis__area_weighted                                                        |
|          | 99.6±0.8μs           | 110±1μs             | 1.11    | import_iris.Iris.time_analysis__grid_angles                                                          |
|          | 217±2μs              | 249±3μs             | 1.15    | import_iris.Iris.time_analysis__interpolation                                                        |
|          | 172±2μs              | 191±1μs             | 1.11    | import_iris.Iris.time_analysis__regrid                                                               |
|          | 102±0.7μs            | 114±0.8μs           | 1.11    | import_iris.Iris.time_analysis__scipy_interpolate                                                    |
|          | 128±0.8μs            | 140±1μs             | 1.09    | import_iris.Iris.time_analysis_calculus                                                              |
|          | 282±2μs              | 327±2μs             | 1.16    | import_iris.Iris.time_analysis_cartography                                                           |
|          | 84.6±0.4μs           | 94.0±1μs            | 1.11    | import_iris.Iris.time_analysis_geomerty                                                              |
|          | 202±2μs              | 218±2μs             | 1.08    | import_iris.Iris.time_analysis_maths                                                                 |
|          | 91.6±1μs             | 99.9±1μs            | 1.09    | import_iris.Iris.time_analysis_stats                                                                 |
|          | 171±2μs              | 173±1μs             | 1.02    | import_iris.Iris.time_analysis_trajectory                                                            |
|          | 277±5μs              | 311±7μs             | 1.12    | import_iris.Iris.time_aux_factory                                                                    |
|          | 80.7±0.9μs           | 84.7±0.7μs          | 1.05    | import_iris.Iris.time_common                                                                         |
|          | 155±2μs              | 166±2μs             | 1.07    | import_iris.Iris.time_common_lenient                                                                 |
|          | 877±8μs              | 982±8μs             | 1.12    | import_iris.Iris.time_common_metadata                                                                |
|          | 126±2μs              | 134±0.9μs           | 1.07    | import_iris.Iris.time_common_mixin                                                                   |
|          | 1.05±0.01ms          | 1.18±0.01ms         | 1.13    | import_iris.Iris.time_common_resolve                                                                 |
|          | 190±2μs              | 202±2μs             | 1.06    | import_iris.Iris.time_config                                                                         |
|          | 108±2μs              | 117±0.8μs           | 1.08    | import_iris.Iris.time_coord_categorisation                                                           |
|          | 327±8μs              | 359±4μs             | 1.10    | import_iris.Iris.time_coord_systems                                                                  |
|          | 649±6μs              | 751±7μs             | 1.16    | import_iris.Iris.time_coords                                                                         |
|          | 614±8μs              | 680±5μs             | 1.11    | import_iris.Iris.time_cube                                                                           |
|          | 212±2μs              | 226±3μs             | 1.07    | import_iris.Iris.time_exceptions                                                                     |
|          | 73.2±0.8μs           | 78.8±1μs            | 1.08    | import_iris.Iris.time_experimental                                                                   |
|          | 194±2μs              | 191±3μs             | 0.99    | import_iris.Iris.time_fileformats                                                                    |
|          | 229±3μs              | 257±2μs             | 1.12    | import_iris.Iris.time_fileformats__ff                                                                |
|          | 2.41±0.04ms          | 2.72±0.03ms         | 1.13    | import_iris.Iris.time_fileformats__ff_cross_references                                               |
|          | 74.7±0.9μs           | 80.0±0.7μs          | 1.07    | import_iris.Iris.time_fileformats__pp_lbproc_pairs                                                   |
|          | 107±1μs              | 116±2μs             | 1.08    | import_iris.Iris.time_fileformats_abf                                                                |
|          | 327±7μs              | 357±3μs             | 1.09    | import_iris.Iris.time_fileformats_cf                                                                 |
|          | 5.40±0.1ms           | 5.45±0.1ms          | 1.01    | import_iris.Iris.time_fileformats_dot                                                                |
|          | 69.2±0.6μs           | 77.0±1μs            | 1.11    | import_iris.Iris.time_fileformats_name                                                               |
|          | 239±6μs              | 260±1μs             | 1.09    | import_iris.Iris.time_fileformats_name_loaders                                                       |
|          | 115±2μs              | 122±2μs             | 1.06    | import_iris.Iris.time_fileformats_netcdf                                                             |
|          | 114±0.7μs            | 122±2μs             | 1.07    | import_iris.Iris.time_fileformats_nimrod                                                             |
|          | 194±3μs              | 213±4μs             | 1.10    | import_iris.Iris.time_fileformats_nimrod_load_rules                                                  |
|          | 685±8μs              | 776±4μs             | 1.13    | import_iris.Iris.time_fileformats_pp                                                                 |
|          | 160±2μs              | 181±3μs             | 1.13    | import_iris.Iris.time_fileformats_pp_load_rules                                                      |
|          | 124±2μs              | 134±3μs             | 1.08    | import_iris.Iris.time_fileformats_pp_save_rules                                                      |
|          | 446±4μs              | 520±5μs             | 1.17    | import_iris.Iris.time_fileformats_rules                                                              |
|          | 197±2μs              | 221±2μs             | 1.12    | import_iris.Iris.time_fileformats_structured_array_identification                                    |
|          | 79.4±0.4μs           | 84.5±1μs            | 1.06    | import_iris.Iris.time_fileformats_um                                                                 |
|          | 150±1μs              | 161±1μs             | 1.07    | import_iris.Iris.time_fileformats_um__fast_load                                                      |
|          | 131±2μs              | 139±0.7μs           | 1.06    | import_iris.Iris.time_fileformats_um__fast_load_structured_fields                                    |
|          | 71.3±0.6μs           | 76.8±0.5μs          | 1.08    | import_iris.Iris.time_fileformats_um__ff_replacement                                                 |
|          | 78.3±0.3μs           | 82.5±0.8μs          | 1.05    | import_iris.Iris.time_fileformats_um__optimal_array_structuring                                      |
|          | 866±10μs             | 985±5μs             | 1.14    | import_iris.Iris.time_fileformats_um_cf_map                                                          |
|          | 128±0.9μs            | 137±0.9μs           | 1.07    | import_iris.Iris.time_io                                                                             |
|          | 160±3μs              | 174±3μs             | 1.09    | import_iris.Iris.time_io_format_picker                                                               |
|          | 195±2μs              | 207±2μs             | 1.07    | import_iris.Iris.time_iris                                                                           |
|          | 119±0.9μs            | 128±1μs             | 1.07    | import_iris.Iris.time_iterate                                                                        |
|          | 8.20±0.06ms          | 8.51±0.2ms          | 1.04    | import_iris.Iris.time_palette                                                                        |
|          | 305±2μs              | 346±5μs             | 1.13    | import_iris.Iris.time_plot                                                                           |
|          | 94.5±0.3μs           | 104±0.5μs           | 1.10    | import_iris.Iris.time_quickplot                                                                      |
|          | 1.91±0.02ms          | 2.13±0.03ms         | 1.12    | import_iris.Iris.time_std_names                                                                      |
|          | 1.72±0.01ms          | 1.78±0.02ms         | 1.03    | import_iris.Iris.time_symbols                                                                        |
|          | 43.4±2ms             | 42.1±1ms            | 0.97    | import_iris.Iris.time_tests                                                                          |
|          | 223±4μs              | 232±5μs             | 1.04    | import_iris.Iris.time_third_party_cartopy                                                            |
|          | 4.85±0.04ms          | 4.92±0.05ms         | 1.01    | import_iris.Iris.time_third_party_cf_units                                                           |
|          | 103±0.9μs            | 107±0.7μs           | 1.04    | import_iris.Iris.time_third_party_cftime                                                             |
|          | 2.66±0.01ms          | 2.81±0.01ms         | 1.06    | import_iris.Iris.time_third_party_matplotlib                                                         |
|          | 1.01±0.01ms          | 1.06±0ms            | 1.05    | import_iris.Iris.time_third_party_numpy                                                              |
|          | 155±2μs              | 158±2μs             | 1.02    | import_iris.Iris.time_third_party_scipy                                                              |
|          | 93.0±1μs             | 102±1μs             | 1.09    | import_iris.Iris.time_time                                                                           |
|          | 289±5μs              | 314±2μs             | 1.09    | import_iris.Iris.time_util                                                                           |
|          | 82.1±0.8μs           | 74.9±2μs            | 0.91    | iterate.IZip.time_izip                                                                               |
|          | 7.94±0.1ms           | 8.03±0.07ms         | 1.01    | load.LoadAndRealise.time_load((1280, 960, 5), False, 'FF')                                           |
|          | 23.5±0.3ms           | 24.2±0.3ms          | 1.03    | load.LoadAndRealise.time_load((1280, 960, 5), False, 'NetCDF')                                       |
|          | 8.73±0.1ms           | 8.80±0.08ms         | 1.01    | load.LoadAndRealise.time_load((1280, 960, 5), False, 'PP')                                           |
|          | 7.81±0.06ms          | 8.10±0.08ms         | 1.04    | load.LoadAndRealise.time_load((1280, 960, 5), True, 'FF')                                            |
|          | 20.4±0.2ms           | 21.2±0.2ms          | 1.04    | load.LoadAndRealise.time_load((1280, 960, 5), True, 'NetCDF')                                        |
|          | 8.66±0.1ms           | 8.79±0.06ms         | 1.01    | load.LoadAndRealise.time_load((1280, 960, 5), True, 'PP')                                            |
|          | 1.34±0.01s           | 1.37±0.01s          | 1.03    | load.LoadAndRealise.time_load((2, 2, 1000), False, 'FF')                                             |
|          | 19.5±0.1ms           | 20.9±0.3ms          | 1.08    | load.LoadAndRealise.time_load((2, 2, 1000), False, 'NetCDF')                                         |
|          | 1.48±0.01s           | 1.52±0.01s          | 1.03    | load.LoadAndRealise.time_load((2, 2, 1000), False, 'PP')                                             |
|          | 1.32±0.01s           | 1.37±0.01s          | 1.03    | load.LoadAndRealise.time_load((2, 2, 1000), True, 'FF')                                              |
|          | 19.6±0.4ms           | 20.9±0.2ms          | 1.07    | load.LoadAndRealise.time_load((2, 2, 1000), True, 'NetCDF')                                          |
|          | 1.47±0.03s           | 1.52±0.02s          | 1.04    | load.LoadAndRealise.time_load((2, 2, 1000), True, 'PP')                                              |
|          | 3.79±0.05ms          | 3.84±0.04ms         | 1.01    | load.LoadAndRealise.time_load((50, 50, 2), False, 'FF')                                              |
|          | 18.9±0.3ms           | 20.0±0.2ms          | 1.06    | load.LoadAndRealise.time_load((50, 50, 2), False, 'NetCDF')                                          |
|          | 4.02±0.05ms          | 4.17±0.06ms         | 1.04    | load.LoadAndRealise.time_load((50, 50, 2), False, 'PP')                                              |
|          | 3.79±0.04ms          | 3.90±0.04ms         | 1.03    | load.LoadAndRealise.time_load((50, 50, 2), True, 'FF')                                               |
|          | 19.3±0.2ms           | 20.0±0.4ms          | 1.04    | load.LoadAndRealise.time_load((50, 50, 2), True, 'NetCDF')                                           |
|          | 4.03±0.02ms          | 4.20±0.05ms         | 1.04    | load.LoadAndRealise.time_load((50, 50, 2), True, 'PP')                                               |
|          | 34.2±3ms             | 34.3±3ms            | 1.00    | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'FF')                                        |
|          | 19.6±0.5ms           | 19.8±0.5ms          | 1.01    | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'NetCDF')                                    |
|          | 12.9±2ms             | 14.1±3ms            | 1.10    | load.LoadAndRealise.time_realise((1280, 960, 5), False, 'PP')                                        |
|          | 25.8±0.9ms           | 28.2±2ms            | 1.09    | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'FF')                                         |
|          | 72.8±1ms             | 72.6±1ms            | 1.00    | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'NetCDF')                                     |
|          | 26.0±1ms             | 26.3±2ms            | 1.01    | load.LoadAndRealise.time_realise((1280, 960, 5), True, 'PP')                                         |
|          | 446±2ms              | 444±3ms             | 1.00    | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'FF')                                          |
|          | 2.87±0.2ms           | 2.92±0.08ms         | 1.02    | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'NetCDF')                                      |
|          | 450±3ms              | 452±3ms             | 1.00    | load.LoadAndRealise.time_realise((2, 2, 1000), False, 'PP')                                          |
|          | 453±3ms              | 450±5ms             | 0.99    | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'FF')                                           |
|          | 3.17±0.1ms           | 3.04±0.1ms          | 0.96    | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'NetCDF')                                       |
|          | 458±3ms              | 459±5ms             | 1.00    | load.LoadAndRealise.time_realise((2, 2, 1000), True, 'PP')                                           |
|          | 1.52±0.08ms          | 1.62±0.08ms         | 1.07    | load.LoadAndRealise.time_realise((50, 50, 2), False, 'FF')                                           |
|          | 3.00±0.06ms          | 3.02±0.2ms          | 1.01    | load.LoadAndRealise.time_realise((50, 50, 2), False, 'NetCDF')                                       |
|          | 1.61±0.09ms          | 1.63±0.06ms         | 1.01    | load.LoadAndRealise.time_realise((50, 50, 2), False, 'PP')                                           |
|          | 1.58±0.1ms           | 1.65±0.1ms          | 1.05    | load.LoadAndRealise.time_realise((50, 50, 2), True, 'FF')                                            |
|          | 3.11±0.1ms           | 3.06±0.1ms          | 0.98    | load.LoadAndRealise.time_realise((50, 50, 2), True, 'NetCDF')                                        |
|          | 1.60±0.06ms          | 1.61±0.1ms          | 1.01    | load.LoadAndRealise.time_realise((50, 50, 2), True, 'PP')                                            |
|          | 332±2ms              | 358±7ms             | 1.08    | load.ManyVars.time_many_var_load                                                                     |
|          | 7.96±0.07ms          | 8.39±0.05ms         | 1.05    | load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'FF')                                     |
|          | 8.73±0.1ms           | 9.06±0.1ms          | 1.04    | load.STASHConstraint.time_stash_constraint((1280, 960, 5), 'PP')                                     |
|          | 1.34±0.01s           | 1.40±0.01s          | 1.05    | load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'FF')                                       |
|          | 1.51±0.02s           | 1.55±0.02s          | 1.03    | load.STASHConstraint.time_stash_constraint((2, 2, 1000), 'PP')                                       |
|          | 3.83±0.03ms          | 3.98±0.07ms         | 1.04    | load.STASHConstraint.time_stash_constraint((2, 2, 2), 'FF')                                          |
|          | 4.12±0.06ms          | 4.33±0.05ms         | 1.05    | load.STASHConstraint.time_stash_constraint((2, 2, 2), 'PP')                                          |
|          | 8.01±0.09ms          | 7.97±0.1ms          | 1.00    | load.StructuredFF.time_structured_load((1280, 960, 5), False)                                        |
|          | 4.58±0.05ms          | 4.71±0.03ms         | 1.03    | load.StructuredFF.time_structured_load((1280, 960, 5), True)                                         |
|          | 1.32±0.01s           | 1.36±0.01s          | 1.02    | load.StructuredFF.time_structured_load((2, 2, 1000), False)                                          |
|          | 357±2ms              | 378±3ms             | 1.06    | load.StructuredFF.time_structured_load((2, 2, 1000), True)                                           |
|          | 3.82±0.03ms          | 3.87±0.02ms         | 1.01    | load.StructuredFF.time_structured_load((2, 2, 2), False)                                             |
|          | 3.43±0.02ms          | 3.51±0.02ms         | 1.02    | load.StructuredFF.time_structured_load((2, 2, 2), True)                                              |
|          | 140±1ms              | 152±1ms             | 1.08    | load.TimeConstraint.time_time_constraint(20, 'FF')                                                   |
|          | 22.5±0.4ms           | 23.5±0.3ms          | 1.04    | load.TimeConstraint.time_time_constraint(20, 'NetCDF')                                               |
|          | 156±2ms              | 167±2ms             | 1.07    | load.TimeConstraint.time_time_constraint(20, 'PP')                                                   |
|          | 27.9±0.5ms           | 29.6±0.7ms          | 1.06    | load.TimeConstraint.time_time_constraint(3, 'FF')                                                    |
|          | 22.4±0.3ms           | 22.9±0.2ms          | 1.02    | load.TimeConstraint.time_time_constraint(3, 'NetCDF')                                                |
|          | 30.3±0.3ms           | 31.7±0.2ms          | 1.05    | load.TimeConstraint.time_time_constraint(3, 'PP')                                                    |
|          | 17.3±0.4ms           | 17.7±0.3ms          | 1.02    | load.ugrid.BasicLoading.time_load_file(1)                                                            |
|          | 39.9±0.3ms           | 40.0±0.6ms          | 1.00    | load.ugrid.BasicLoading.time_load_file(200000)                                                       |
|          | 13.9±0.4ms           | 14.2±0.1ms          | 1.02    | load.ugrid.BasicLoading.time_load_mesh(1)                                                            |
|          | 22.2±0.4ms           | 22.7±0.4ms          | 1.02    | load.ugrid.BasicLoading.time_load_mesh(200000)                                                       |
|          | 17.3±0.4ms           | 17.8±0.5ms          | 1.02    | load.ugrid.BasicLoadingTime.time_load_file(1)                                                        |
|          | 20.1±0.3ms           | 20.8±0.3ms          | 1.04    | load.ugrid.BasicLoadingTime.time_load_file(200000)                                                   |
|          | 13.7±0.3ms           | 14.4±0.2ms          | 1.05    | load.ugrid.BasicLoadingTime.time_load_mesh(1)                                                        |
|          | 17.1±0.1ms           | 17.3±0.3ms          | 1.01    | load.ugrid.BasicLoadingTime.time_load_mesh(200000)                                                   |
|          | 18.2±0.2ms           | 18.6±0.4ms          | 1.03    | load.ugrid.Callback.time_load_file_callback(1)                                                       |
|          | 47.9±0.5ms           | 48.3±0.9ms          | 1.01    | load.ugrid.Callback.time_load_file_callback(200000)                                                  |
|          | 18.2±0.4ms           | 18.6±0.3ms          | 1.03    | load.ugrid.CallbackTime.time_load_file_callback(1)                                                   |
|          | 22.1±0.3ms           | 22.3±0.6ms          | 1.01    | load.ugrid.CallbackTime.time_load_file_callback(200000)                                              |
|          | 2.81±0.09ms          | 2.86±0.1ms          | 1.02    | load.ugrid.DataRealisation.time_realise_data(10000)                                                  |
|          | 5.48±0.8ms           | 5.76±0.1ms          | 1.05    | load.ugrid.DataRealisation.time_realise_data(200000)                                                 |
|          | 39.4±0.7ms           | 39.8±1ms            | 1.01    | load.ugrid.DataRealisationTime.time_realise_data(10000)                                              |
|          | 808±5ms              | 793±6ms             | 0.98    | load.ugrid.DataRealisationTime.time_realise_data(200000)                                             |
|          | 997±4ns              | 850±9ns             | 0.85    | metadata_manager_factory.MetadataManagerFactory.time_CellMeasuresMetadata_values                     |
|          | 1.07±0μs             | 908±9ns             | 0.85    | metadata_manager_factory.MetadataManagerFactory.time_CoordMetadata_values                            |
|          | 994±6ns              | 853±8ns             | 0.86    | metadata_manager_factory.MetadataManagerFactory.time_CubeMetadata_values                             |
|          | 1.14±0μs             | 964±8ns             | 0.85    | metadata_manager_factory.MetadataManagerFactory.time_DimCoordMetadata_values                         |
|          | 999±7ns              | 887±10ns            | 0.89    | metadata_manager_factory.MetadataManagerFactory__create.time_AncillaryVariableMetadata(1)            |
|          | 6.78±0.04μs          | 6.94±0.1μs          | 1.02    | metadata_manager_factory.MetadataManagerFactory__create.time_AncillaryVariableMetadata(10)           |
|          | 63.9±0.6μs           | 66.7±0.9μs          | 1.04    | metadata_manager_factory.MetadataManagerFactory__create.time_AncillaryVariableMetadata(100)          |
|          | 998±2ns              | 880±7ns             | 0.88    | metadata_manager_factory.MetadataManagerFactory__create.time_BaseMetadata(1)                         |
|          | 6.79±0.04μs          | 6.92±0.2μs          | 1.02    | metadata_manager_factory.MetadataManagerFactory__create.time_BaseMetadata(10)                        |
|          | 64.2±0.7μs           | 66.4±0.6μs          | 1.03    | metadata_manager_factory.MetadataManagerFactory__create.time_BaseMetadata(100)                       |
|          | 1.04±0.01μs          | 937±10ns            | 0.90    | metadata_manager_factory.MetadataManagerFactory__create.time_CellMeasureMetadata(1)                  |
|          | 7.28±0.1μs           | 7.33±0.1μs          | 1.01    | metadata_manager_factory.MetadataManagerFactory__create.time_CellMeasureMetadata(10)                 |
|          | 69.2±0.2μs           | 71.3±0.8μs          | 1.03    | metadata_manager_factory.MetadataManagerFactory__create.time_CellMeasureMetadata(100)                |
|          | 1.08±0μs             | 967±10ns            | 0.89    | metadata_manager_factory.MetadataManagerFactory__create.time_CoordMetadata(1)                        |
|          | 7.81±0.08μs          | 7.77±0.1μs          | 1.00    | metadata_manager_factory.MetadataManagerFactory__create.time_CoordMetadata(10)                       |
|          | 73.0±0.9μs           | 74.5±1μs            | 1.02    | metadata_manager_factory.MetadataManagerFactory__create.time_CoordMetadata(100)                      |
|          | 1.04±0.01μs          | 921±5ns             | 0.89    | metadata_manager_factory.MetadataManagerFactory__create.time_CubeMetadata(1)                         |
|          | 7.40±0.1μs           | 7.36±0.1μs          | 0.99    | metadata_manager_factory.MetadataManagerFactory__create.time_CubeMetadata(10)                        |
|          | 69.9±0.7μs           | 71.2±0.8μs          | 1.02    | metadata_manager_factory.MetadataManagerFactory__create.time_CubeMetadata(100)                       |
|          | 1.12±0.01μs          | 994±10ns            | 0.89    | metadata_manager_factory.MetadataManagerFactory__create.time_DimCoordMetadata(1)                     |
|          | 8.21±0.09μs          | 8.31±0.2μs          | 1.01    | metadata_manager_factory.MetadataManagerFactory__create.time_DimCoordMetadata(10)                    |
|          | 77.1±2μs             | 79.0±0.8μs          | 1.03    | metadata_manager_factory.MetadataManagerFactory__create.time_DimCoordMetadata(100)                   |
|          | 694±20ns             | 760±6ns             | 1.10    | mixin.CFVariableMixin.time_set_attributes                                                            |
|          | 114±0.8ns            | 116±0.9ns           | 1.02    | mixin.CFVariableMixin.time_set_long_name                                                             |
|          | 3.47±0.03μs          | 3.56±0.07μs         | 1.02    | mixin.CFVariableMixin.time_set_metadata__dict                                                        |
|          | 4.39±0.03μs          | 4.48±0.1μs          | 1.02    | mixin.CFVariableMixin.time_set_metadata__metadata                                                    |
|          | 4.23±0.04μs          | 4.42±0.1μs          | 1.04    | mixin.CFVariableMixin.time_set_metadata__tuple                                                       |
|          | 536±8ns              | 560±6ns             | 1.04    | mixin.CFVariableMixin.time_set_standard_name                                                         |
|          | 415±9ns              | 435±4ns             | 1.05    | mixin.CFVariableMixin.time_set_units                                                                 |
|          | 436±4ns              | 446±6ns             | 1.02    | mixin.CFVariableMixin.time_set_var_name                                                              |
|          | 371±1ms              | 367±2ms             | 0.99    | plot.AuxSort.time_aux_sort                                                                           |
|          | 78.6±2ms             | 78.6±6ms            | 1.00    | regridding.CurvilinearRegridding.time_regrid_pic                                                     |
|          | 95.9±0.6ms           | 96.8±0.7ms          | 1.01    | regridding.HorizontalChunkedRegridding.time_regrid_area_w                                            |
|          | 49.5±3ms             | 48.1±3ms            | 0.97    | regridding.HorizontalChunkedRegridding.time_regrid_area_w_new_grid                                   |
|          | 3.98±0.1ms           | 4.10±0.09ms         | 1.03    | save.NetcdfSave.time_netcdf_save_cube(50, False)                                                     |
|          | 72.7±1ms             | 73.0±0.6ms          | 1.00    | save.NetcdfSave.time_netcdf_save_cube(50, True)                                                      |
|          | 52.4±0.4ms           | 52.2±0.8ms          | 1.00    | save.NetcdfSave.time_netcdf_save_cube(600, False)                                                    |
|          | 567±4ms              | 564±4ms             | 1.00    | save.NetcdfSave.time_netcdf_save_cube(600, True)                                                     |
|          | 101±1ns              | 90.2±1ns            | 0.89    | save.NetcdfSave.time_netcdf_save_mesh(50, False)                                                     |
|          | 55.8±0.6ms           | 56.7±0.6ms          | 1.02    | save.NetcdfSave.time_netcdf_save_mesh(50, True)                                                      |
|          | 102±2ns              | 90.3±1ns            | 0.88    | save.NetcdfSave.time_netcdf_save_mesh(600, False)                                                    |
|          | 497±3ms              | 495±3ms             | 1.00    | save.NetcdfSave.time_netcdf_save_mesh(600, True)                                                     |
|          | 41.8±1ms             | 40.1±1ms            | 0.96    | stats.PearsonR.time_lazy                                                                             |
|          | 19.3±0.3ms           | 19.2±0.3ms          | 0.99    | stats.PearsonR.time_real                                                                             |
|          | 24.1±1ms             | 23.7±0.7ms          | 0.98    | trajectory.TrajectoryInterpolation.time_trajectory_linear                                            |
|          | 60.9±0.3ms           | 58.7±0.6ms          | 0.96    | trajectory.TrajectoryInterpolation.time_trajectory_nearest                                           |

Generated by GHA run 8524852364

@bjlittle
Copy link
Member Author

bjlittle commented Apr 2, 2024

As this pull-request bumps our python support to include py312, but the benchmarking task will fail, as there is no equivalent py312 on main to compare with.

After discussing options with @trexfeathers, we've added a temporary workaround to force the benchmarking to complete successfully so that we can review the final performance report, see here.

We're happy to see that there are many general performance wins using iris with py312 🔥🚀🤩

I'm now going to back out the workaround, which will result in the benchmarking to fail again. This is expected, and it's acceptable to merge this pull-request with failing benchmarking.

Copy link
Contributor

@trexfeathers trexfeathers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @bjlittle, I'm happy that you got 'em all.

One question below

pyproject.toml Show resolved Hide resolved
@trexfeathers trexfeathers merged commit c8a663a into SciTools:main Apr 3, 2024
19 of 20 checks passed
tkknight added a commit to tkknight/iris that referenced this pull request Apr 3, 2024
* upstream/main: (163 commits)
  Restore latest Whats New files.
  Whats new updates for `v3.9.0rc0` (SciTools#5899)
  nep29: drop py39 and support py312 (SciTools#5894)
  Support NetCDF v3 files in chunking control code. (SciTools#5897)
  Avoid computing lazy scalar coordinates when printing a Cube (v2) (SciTools#5896)
  Force pytest colour output on GitHub Actions (SciTools#5895)
  Make typing 3.9 compatible.
  Improve typing readability.
  Updated environment lockfiles (SciTools#5892)
  [pre-commit.ci] pre-commit autoupdate
  What's New entry for SciTools#5740 .
  Iris to GeoVista conversion (SciTools#5740)
  Try Union for type hinting.
  Type hinting.
  Fix typo.
  Re-introduce backwards compatible warning.
  Updated documentation.
  Remove loose references to fill value warnings.
  Advertise structured_um_loading performance regression.
  [pre-commit.ci] pre-commit autoupdate
  ...
@bjlittle bjlittle deleted the drop-py39-add-py312 branch April 9, 2024 10:14
tkknight added a commit to tkknight/iris that referenced this pull request Apr 10, 2024
…th_numpydoc

* upstream/main: (39 commits)
  Bump scitools/workflows from 2024.03.3 to 2024.04.0 (SciTools#5907)
  [pre-commit.ci] pre-commit autoupdate (SciTools#5906)
  Updated environment lockfiles (SciTools#5904)
  Ignore flaticon.com in linkchecks. (SciTools#5905)
  Implement lazy area weights (SciTools#5658)
  Add option to specify chunks in `iris.util.broadcast_to_shape` (SciTools#5620)
  Unpin sphinx (SciTools#5901)
  DOC: clarify save_pairs_from_cube docstring (SciTools#5783)
  Restore latest Whats New files.
  Whats new updates for `v3.9.0rc0` (SciTools#5899)
  nep29: drop py39 and support py312 (SciTools#5894)
  Support NetCDF v3 files in chunking control code. (SciTools#5897)
  Avoid computing lazy scalar coordinates when printing a Cube (v2) (SciTools#5896)
  Force pytest colour output on GitHub Actions (SciTools#5895)
  Make typing 3.9 compatible.
  Improve typing readability.
  Updated environment lockfiles (SciTools#5892)
  [pre-commit.ci] pre-commit autoupdate
  What's New entry for SciTools#5740 .
  Iris to GeoVista conversion (SciTools#5740)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
benchmark_this Request that this pull request be benchmarked to check if it introduces performance shifts
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants