FilesExpand file tree

 master

/

CollectExample.py

Copy path

Blame

More file actions

Blame

More file actions

Latest commit

 

History

History

History

15 lines (9 loc) · 393 Bytes

 master

/

CollectExample.py

Copy path

Top

File metadata and controls

• Code
• Blame

15 lines (9 loc) · 393 Bytes

Raw

Copy raw file

Download raw file

Open symbols panel

Edit and raw actions

1

2

3

4

5

6

7

8

9

10

11

12

13

14

from pyspark import SparkContext, SparkConf

if __name__ == "__main__":

conf = SparkConf().setAppName("collect").setMaster("local[*]")

sc = SparkContext(conf = conf)

inputWords = ["spark", "hadoop", "spark", "hive", "pig", "cassandra", "hadoop"]

wordRdd = sc.parallelize(inputWords)

words = wordRdd.collect()

for word in words:

print(word)