Skip to content

Commit

Permalink
[SPARK-46002][INFRA][FOLLOWUP] Upgrade to Python 3.9 in daily maven test
Browse files Browse the repository at this point in the history
### What changes were proposed in this pull request?
Upgrade to Python 3.9 in daily maven test

### Why are the changes needed?
to be consistent with apache#43902

### Does this PR introduce _any_ user-facing change?
no

### How was this patch tested?
ci

### Was this patch authored or co-authored using generative AI tooling?
no

Closes apache#43975 from zhengruifeng/infra_sql_py_followup.

Authored-by: Ruifeng Zheng <ruifengz@apache.org>
Signed-off-by: Ruifeng Zheng <ruifengz@apache.org>
  • Loading branch information
zhengruifeng committed Nov 23, 2023
1 parent d14410c commit 4221c66
Showing 1 changed file with 5 additions and 5 deletions.
10 changes: 5 additions & 5 deletions .github/workflows/maven_test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -152,20 +152,20 @@ jobs:
with:
distribution: temurin
java-version: ${{ matrix.java }}
- name: Install Python 3.8
- name: Install Python 3.9
uses: actions/setup-python@v4
# We should install one Python that is higher than 3+ for SQL and Yarn because:
# - SQL component also has Python related tests, for example, IntegratedUDFTestUtils.
# - Yarn has a Python specific test too, for example, YarnClusterSuite.
if: contains(matrix.modules, 'resource-managers#yarn') || (contains(matrix.modules, 'sql#core'))
with:
python-version: 3.8
python-version: '3.9'
architecture: x64
- name: Install Python packages (Python 3.8)
- name: Install Python packages (Python 3.9)
if: (contains(matrix.modules, 'sql#core'))
run: |
python3.8 -m pip install 'numpy>=1.20.0' pyarrow pandas scipy unittest-xml-reporting 'grpcio==1.56.0' 'protobuf==3.20.3'
python3.8 -m pip list
python3.9 -m pip install 'numpy>=1.20.0' pyarrow pandas scipy unittest-xml-reporting 'grpcio==1.59.3' 'grpcio-status==1.59.3' 'protobuf==4.25.1'
python3.9 -m pip list
# Run the tests.
- name: Run tests
env: ${{ fromJSON(inputs.envs) }}
Expand Down

0 comments on commit 4221c66

Please sign in to comment.