FilesExpand file tree

 master

/

WordCount.py

Copy path

Blame

More file actions

Blame

More file actions

Latest commit

 

History

History

History

15 lines (9 loc) · 426 Bytes

 master

/

WordCount.py

Copy path

Top

File metadata and controls

• Code
• Blame

15 lines (9 loc) · 426 Bytes

Raw

Copy raw file

Download raw file

Open symbols panel

Edit and raw actions

1

2

3

4

5

6

7

8

9

10

11

12

13

14

from pyspark import SparkContext, SparkConf

if __name__ == "__main__":

conf = SparkConf().setAppName("word count").setMaster("local[3]")

sc = SparkContext(conf = conf)

lines = sc.textFile("in/word_count.text")

words = lines.flatMap(lambda line: line.split(" "))

wordCounts = words.countByValue()

for word, count in wordCounts.items():

print("{} : {}".format(word, count))