import sys from pyspark import SparkConf, SparkContext sc = SparkContext("local", "pysaprk word counts") lines = sc.textFile(sys.argv[1]).cache() words = lines.flatMap(lambda line: line.split(" "))...

Hi! Linked assignment below. I just need #3, and I am linking the code for #2 to make it even easier! It needs just a few adjustments


import sys from pyspark import SparkConf, SparkContext sc = SparkContext("local", "pysaprk word counts") lines = sc.textFile(sys.argv[1]).cache() words = lines.flatMap(lambda line: line.split(" ")) pairs = words.map(lambda word: (word, 1)) counts = pairs.reduceByKey(lambda a, b: a + b) counts.saveAsTextFile("counts"); sc.stop()