Skip to content
Tests

[DOP-18571] Collect and log Spark metrics in various method calls #2432

Sign in to view logs

[DOP-18571] Collect and log Spark metrics in various method calls

[DOP-18571] Collect and log Spark metrics in various method calls #2432

Run time

Learn about OS pricing on GitHub Actions
Job Run time
Get version matrix based on changes in PR/commit / Get version matrix based on changes in PR/commit
56s
Run core tests (spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run core tests (spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
55s
Run Clickhouse tests (server=24.6.3.70-alpine, spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run Clickhouse tests (server=24.6.3.70-alpine, spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
1m 20s
Run Clickhouse tests (server=21.1, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run Clickhouse tests (server=21.1, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
1m 26s
Run core tests (spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run core tests (spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
1m 17s
Run Greenplum tests (server=6.23.1, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run Greenplum tests (server=6.23.1, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
2m 5s
Run Kafka tests (server=3.2.3, spark=2.4.8, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run Kafka tests (server=3.2.3, spark=2.4.8, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
6m 19s
Run Greenplum tests (server=7.0.0, spark=3.2.4, pydantic=2, java=11, python=3.10, os=ubuntu-latest) / Run Greenplum tests (server=7.0.0, spark=3.2.4, pydantic=2, java=11, python=3.10, os=ubuntu-latest)
2m 14s
Run Kafka tests (server=3.7.1, spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run Kafka tests (server=3.7.1, spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
4m 0s
Run LocalFS tests (spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run LocalFS tests (spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
1m 26s
Run LocalFS tests (spark=2.4.8, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run LocalFS tests (spark=2.4.8, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
1m 28s
Run LocalFS tests (spark=3.2.4, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run LocalFS tests (spark=3.2.4, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
1m 28s
Run LocalFS tests (spark=3.5.0, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run LocalFS tests (spark=3.5.0, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
2m 12s
Run MongoDB tests (server=4.0.0, spark=3.2.4, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run MongoDB tests (server=4.0.0, spark=3.2.4, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
1m 28s
Run FTP tests (server=latest, pydantic=2, python=3.12, os=ubuntu-latest) / Run FTP tests (server=latest, pydantic=2, python=3.12, os=ubuntu-latest)
1m 8s
Run FTPS tests (server=latest, pydantic=2, python=3.12, os=ubuntu-latest) / Run FTPS tests (server=latest, pydantic=2, python=3.12, os=ubuntu-latest)
1m 38s
Run HDFS tests (server=hadoop3-hdfs, spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run HDFS tests (server=hadoop3-hdfs, spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
6m 37s
Run Hive tests (spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run Hive tests (spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
2m 24s
Run Hive tests (spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run Hive tests (spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
2m 7s
Run MongoDB tests (server=7.0.12, spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run MongoDB tests (server=7.0.12, spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
1m 54s
Run MSSQL tests (server=2017-GA-ubuntu, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run MSSQL tests (server=2017-GA-ubuntu, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
2m 32s
Run MSSQL tests (server=2022-CU14-ubuntu-22.04, spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run MSSQL tests (server=2022-CU14-ubuntu-22.04, spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
2m 32s
Run MySQL tests (server=5.7.13, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run MySQL tests (server=5.7.13, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
1m 30s
Run Oracle tests (server=23.4-slim-faststart, spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run Oracle tests (server=23.4-slim-faststart, spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
2m 28s
Run MySQL tests (server=9.0.1, spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run MySQL tests (server=9.0.1, spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
1m 50s
Run Oracle tests (server=11.2.0.2-slim-faststart, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run Oracle tests (server=11.2.0.2-slim-faststart, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
1m 34s
Run Postgres tests (server=16.3-alpine, spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run Postgres tests (server=16.3-alpine, spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
2m 59s
Run Postgres tests (server=9.4.26-alpine, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest) / Run Postgres tests (server=9.4.26-alpine, spark=2.3.1, pydantic=1, java=8, python=3.7, os=ubuntu-latest)
2m 35s
Run S3 tests (server=2024.7.26, spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run S3 tests (server=2024.7.26, spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
3m 26s
Run Samba tests (server=latest, pydantic=2, python=3.12, os=ubuntu-latest) / Run Samba tests (server=latest, pydantic=2, python=3.12, os=ubuntu-latest)
1m 22s
Run SFTP tests (server=9.6_p1-r0-ls154, pydantic=2, python=3.12, os=ubuntu-latest) / Run SFTP tests (server=9.6_p1-r0-ls154, pydantic=2, python=3.12, os=ubuntu-latest)
1m 27s
Run Teradata tests (spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest) / Run Teradata tests (spark=3.5.1, pydantic=2, java=20, python=3.12, os=ubuntu-latest)
52s
Run WebDAV tests (server=latest, pydantic=2, python=3.12, os=ubuntu-latest) / Run WebDAV tests (server=latest, pydantic=2, python=3.12, os=ubuntu-latest)
3m 18s
Tests done
27s
1h 13m 14s