FilesExpand file tree

 master

/

base.yml

Copy path

View Runs

Blame

More file actions

Blame

More file actions

Latest commit

 

History

History

History

36 lines (31 loc) · 837 Bytes

 master

/

base.yml

Copy path

Top

File metadata and controls

• Code
• Blame

36 lines (31 loc) · 837 Bytes

Raw

Copy raw file

Download raw file

Open symbols panel

Edit and raw actions

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

on:

push:

branches:

- "**"

jobs:

test:

runs-on: ubuntu-latest

strategy:

fail-fast: false

matrix:

PYSPARK_VERSION: ["3.0", "3.1.3", "3.2"]

steps:

- uses: actions/checkout@v3

- uses: actions/setup-python@v2

name: Install Python 3.8

with:

python-version: 3.8

- uses: actions/setup-java@v1

name: Setup Java 11

if: startsWith(matrix.PYSPARK_VERSION, '3')

with:

java-version: "11"

- name: Running tests with pyspark==${{matrix.PYSPARK_VERSION}}

env:

SPARK_VERSION: ${{matrix.PYSPARK_VERSION}}

run: |

pip install --upgrade pip

pip install poetry

poetry install

poetry add pyspark==$SPARK_VERSION

poetry run python -m pytest -s tests