Operators commonly used spark summary (8) - filter

The out over a certain number of collect

val filterRdd = sc.parallelize(List(1,2,3,4,5)).map(_*2).filter(_>5)
filterRdd.collect
# res5: Array[Int] = Array(6, 8, 10)

 

Guess you like

Origin www.cnblogs.com/pocahontas/p/11441040.html