CDH启动lzo压缩

CDH安装完毕
image.png

2.添加parcel

image.png

image.png

image.png

image.png


image.png

image.png

image.png

image.png



HDFS配置

HDFS配置项中搜索“压缩编码解码器”,加入com.hadoop.compression.lzo.LzopCodec

image.png

Hive配置项中搜索“Hive 辅助 JAR 目录”,加入/opt/cloudera/parcels/GPLEXTRAS/lib/hadoop/lib

image.png

Sqoop 配置   sqoop-conf/sqoop-env.sh Sqoop 1 Client 客户端高级配置代码段(安全阀)

HADOOP_CLASSPATH=$HADOOP_CLASSPATH:/opt/cloudera/parcels/GPLEXTRAS/lib/hadoop/lib/*

JAVA_LIBRARY_PATH=$JAVA_LIBRARY_PATH:/opt/cloudera/parcels/GPLEXTRAS/lib/hadoop/lib/native

image.png

yarn配置

yarn配置项中搜索“yarn.nodemanager.resource.memory-mb”,修改成4G

yarn配置项中搜索“yarn.scheduler.maximum-allocation-mb”,修改成2G





猜你喜欢

转载自blog.51cto.com/wsxxsl/2668231