近期在写spark单词统计时一直报下面的错误
py4j.protocol.Py4JError: An error occurred while calling o21.isBarrier. Trace:
py4j.Py4JException: Method isBarrier([]) does not exist
at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:318)
at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:326)
at py4j.Gateway.invoke(Gateway.java:274)
at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
at py4j.commands.CallCommand.execute(CallCommand.java:79)
at py4j.GatewayConnection.run(GatewayConnection.java:238)
at java.lang.Thread.run(Thread.java:748)
错误原因：pyspark的版本与spark安装包的版本不一致
改错方法：根据自己spark的版本去修改pyspark的版本
注意：在安装spark时要根据Hadoop的版本去选择spark否也会报错