FilesExpand file tree

master

/

HelloSpark.py

Copy path

Blame

More file actions

Blame

More file actions

Latest commit

 

History

History

History

17 lines (11 loc) · 319 Bytes

master

/

HelloSpark.py

Copy path

Top

File metadata and controls

• Code
• Blame

17 lines (11 loc) · 319 Bytes

Raw

Copy raw file

Download raw file

Open symbols panel

Edit and raw actions

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

from pyspark.sql import *

if __name__ == "__main__":

spark = SparkSession.builder \

.appName("Hello Spark") \

.master("local[2]") \

.getOrCreate()

data_list = [("Ravi", 28),

("David", 45),

("Abdul", 27)]

df = spark.createDataFrame(data_list).toDF("Name", "Age")

df.show()