Spark压缩格式

CompressionCodec.scala

private val shortCompressionCodecNames = Map(

    "lz4" -> classOf[LZ4CompressionCodec].getName,

    "lzf" -> classOf[LZFCompressionCodec].getName,

    "snappy" -> classOf[SnappyCompressionCodec].getName,

    "zstd" -> classOf[ZStdCompressionCodec].getName)

转载于:https://www.jianshu.com/p/4ddfcd4f4d70