Scala 统计文本中单词的数量

var file = sc.textFile(“file:///root/abc.txt”)
var a = file.flatMap(line => line.split("\t"))
var b = a.map(word => (word,1))
var c = b.reduceByKey(+) 相当于 var c = b.reduceByKey((a,b) => (a+b))
c.collect

合并起来:
var file = sc.textFile(“file:///root/abc.txt”)
val word = file.flatMap(line>line.split(" ")).map(,1).reduceByKey(+_).collect

排序:val word = file.flatMap(line+>line.split(" ")).map(,1).reduceByKey(+_).collect.sorted

猜你喜欢

转载自blog.csdn.net/qq_41854797/article/details/88848734