Hadoop的学习笔记(Hive|pig|zookeeper|hbase)

轉載的,此筆記的鏈接地址請點擊此處

<div class="postText">
	<div id="cnblogs_post_body" class="blogpost-body"><table border="0" align="left">

海量数据

    那些年Google公开的大数据领域论文

    大数据量,海量数据 处理方法总结

    布隆过滤器应用

    Google Dremel 原理 – 如何能3秒分析1PB

     Google Spanner原理- 全球级的分布式数据库

    悉数那些“巨型”数据仓库

    Hadoop在业界的使用情况

扫描二维码关注公众号,回复: 4417404 查看本文章

    淘宝Hadoop集群的概况

    淘宝数据魔方技术架构解析

    Facebook的实时Hadoop系统

    Apache Hadoop Goes Realtime at Facebook(译) 

数据统计

  网站统计中的数据收集原理及实现

数据挖掘

  一个电商数据分析师的经验总结

  五个免费开源的数据挖掘软件

  Google推出Prediction API

  K Nearest Neighbor 算法(归类)

  K-Means 算法(聚类)

  kmeans算法java版本

  

hadoop2

  hadoop2升级的那点事情(详解)

hadoop

  介绍

    Hadoop分布式文件系统:架构和设计要点

    mapreduce作业流程概论

    Hadoop使用场景

  管理

    hadoop集群部署

    hadoop部署注意项

    hadoop配置文件说明

    hadoop集群默认配置和常用配置

      hadoop集群测量

    Hadoop管理员的十个最佳实践

    Hadoop 权限管理

    Hadoop FS Shell

    Hadoop Shell 讲解

    hadoop fs -count的结果含义

    Hadoop添加节点datanode

    Hadoop删除节点

    hadoop SecondaryNameNode和NameNode

    hadoop 根据SecondaryNameNode恢复Namenode

    hadoop机架感知

    HDFS 安全模式

    hadoop的dfs.replication

    Hadoop回收站trash

    hadoop升级

    Hadoop计算能力调度器算法解析

    Hadoop计算能力调度器应用和配置

    hadoop mapred-queue-acls 配置

    hadoop和kerberos的整合总结

    hadoop的dfs.umask

    NFS服务对Hadoop(hdfs)集群影响测试

    Facebook团队关于Hadoop/HBase在SSD上的实验和讨论

    HADOOP动态加载配置

    基于计算机资源分析hadoop的默认counter

  调优

    hadoop作业调优参数整理及原理

  原理实现

    

    HDFS的基本概念

    HDFS 读写流程

    HDFS namenode源码分析 

    HDFS datanode源码分析

      HDFS dfsclient读文件过程 源码分析

      HDFS dfsclient写文件过程 源码分析

    How MapReduce Works 

    MapReduce源码分析总结

      eclipse下编译hadoop源代码

    基于hadoop的crc校验谈hadoop的离线设计思想

    Hadoop在MapReduce中使用压缩详解

    HDFS数据的Checksum

    Hadoop开发常用的InputFormat和OutputFormat

    Hadoop之failed task和killed task

    Hadoop的调度器总结

hive

  Hive体系架构

  应用

    Hadoop和Hive的数据处理流程

  管理

    hive部署手册

    hive元数据中utf8的修改

      hive并发调用的运行方式-个人经验篇

     

    hive Cli常用操作(翻译自Hive wiki)

    hive数据类型(翻译自Hive Wiki)

    hive 创建/删除/截断 表(翻译自Hive wiki)

    hive数据操作(翻译自Hive wiki+实例讲解)

    hive原生和复合类型的数据加载和使用

      hive修改 表/分区语句

    hive select操作(翻译自Hive wiki)

    hive GroupBy操作(翻译自Hive wiki)

      hive 中 Order by, Sort by ,Dristribute by,Cluster By 的作用和用法

     Hive Join(翻译自Hive wiki)

     hive lateral view语句(翻译自Hive wiki)

     Hive Union(翻译自Hive wiki)

     Hive子查询(翻译自Hive wiki)

     hive实例讲解实现in和not in子句

     Hive Explain(翻译自Hive wiki)

     Hive虚拟列(翻译自Hive wiki)

     hive 锁定(翻译自Hive wiki)

      hive函数(Hive wiki)

    hive udf开发流程(Hive wiki)

    hive udaf开发入门和运行过程详解

    hive中UDTF编写和使用

    hive属性(Hive wiki)

    hive中分组取前N个值的实现

    hive sql遇到的问题

  优化

    hive大数据倾斜总结

    hive join详解

     

    hive文件存储格式

    hive怎样决定reducer个数

    hive的hive.exec.parallel参数说明

    hive local hadoop特性    

pig

  介绍入门

    Apache Pig入门 –介绍/基本架构/与Hive对比

  管理

    pig部署手册

  教程

    Apache Pig中文教程集合

zookeeper

  ZooKeeper概述

  部署与管理ZooKeeper

  ZooKeeper典型应用场景

  ZooKeeper程序员指南

  Zookeeper Api(java)入门与应用

  zookeeper java例子(官网)

  zookeeper 生产者与消费者(官网)

  zookeeper 应用场景与方案(官网)

  ZooKeeper 会话超时

  Watcher使用的注意事项

  zookeeper 权限控制

  Paxos在大型系统中常见的应用场景

  Zookeeper全解析——Paxos作为灵魂

  Zookeeper全解析——Client端

  zookeeper系列之通信模型

hbase

  HBase体系结构

  hbase数据模型

    HBase使用场景和成功案例

  Hbase配置手册

  hbase shell(官方)

  hbase shell基础和常用命令详解

  Hive HBase集成(官网)

  HBase Java API类介绍 

  通过Java Api与HBase交互

  HBase二级索引与Join

  HBase配置性能调优

  HBase设计与开发性能优化

  

  HBase 在淘宝的应用和优化

  (H2与HBase)面向行or面向列的存储模型

  HBase查询一条数据的过程

<div class="clear"></div>
<div class="diggword" id="digg_tips">
</div>
« 上一篇: Hadoop在MapReduce中使用压缩详解
» 下一篇: hadoop升级
</div>

<div class="postfoot">
	posted on <span id="post-date">2012-04-22 22:52</span> <a href="https://www.cnblogs.com/ggjucheng/">ggjucheng</a> 阅读(<span id="post_view_count">35337</span>) 评论(<span id="post_comment_count">11</span>)  <a href="https://i.cnblogs.com/EditPosts.aspx?postid=2465625" rel="nofollow">编辑</a> <a href="#" onclick="AddToWz(2465625);return false;">收藏</a>
</div>

评论

	<div class="post">			
		<div class="postTitle">
			<a href="#2662221" class="layer">#1楼</a><a name="2662221" id="comment_anchor_2662221"></a>
				<span>
					 <span class="comment_date">2013-04-20 01:29</span>
				</span>
			<a id="a_comment_author_2662221" href="http://home.cnblogs.com/u/137425/" target="_blank">mojunbin</a> <a href="http://msg.cnblogs.com/send/mojunbin" title="发送站内短消息" class="sendMsg2This">&nbsp;</a>
		</div>
		<div class="postText">
			<div id="comment_body_2662221" class="blog_comment_body">很不错的收集,顶!</div><div class="comment_vote"><a href="javascript:void(0);" class="comment_digg" onclick="return voteComment(2662221,'Digg',this)">支持(0)</a><a href="javascript:void(0);" class="comment_bury" onclick="return voteComment(2662221,'Bury',this)">反对(0)</a></div>
		</div>
        <div class="commentOpt">
		&nbsp;&nbsp;<span class="comment_actions"><a href="javascript:void(0);" onclick="return ReplyComment(2662221,'vrjDR85agCKk1Lvab/YmQJoUiDsTxN5VIgK2ytVMcJ/m60CgqYOeKA==')">回复</a><a href="javascript:void(0);" onclick="return QuoteComment(2662221,'vrjDR85agCKk1Lvab/YmQJoUiDsTxN5VIgK2ytVMcJ/m60CgqYOeKA==')">引用</a></span>
        </div>
	</div>
	<br>

	<div class="post">			
		<div class="postTitle">
			<a href="#2818468" class="layer">#2楼</a><a name="2818468" id="comment_anchor_2818468"></a>
				<span>
					 <span class="comment_date">2013-11-18 11:26</span>
				</span>
			<a id="a_comment_author_2818468" href="http://home.cnblogs.com/u/197426/" target="_blank">twlkyao</a> <a href="http://msg.cnblogs.com/send/twlkyao" title="发送站内短消息" class="sendMsg2This">&nbsp;</a>
		</div>
		<div class="postText">
			<div id="comment_body_2818468" class="blog_comment_body">很不错的系统学习的资料</div><div class="comment_vote"><a href="javascript:void(0);" class="comment_digg" onclick="return voteComment(2818468,'Digg',this)">支持(0)</a><a href="javascript:void(0);" class="comment_bury" onclick="return voteComment(2818468,'Bury',this)">反对(0)</a></div>
		</div>
        <div class="commentOpt">
		&nbsp;&nbsp;<span class="comment_actions"><a href="javascript:void(0);" onclick="return ReplyComment(2818468,'maYYV0xGETlrX98nmrjnYI+K7nbLXC8ONayayUU3PgLPvzVY5MF63g==')">回复</a><a href="javascript:void(0);" onclick="return QuoteComment(2818468,'maYYV0xGETlrX98nmrjnYI+K7nbLXC8ONayayUU3PgLPvzVY5MF63g==')">引用</a></span>
        </div>
	</div>
	<br>

	<div class="post">			
		<div class="postTitle">
			<a href="#2888727" class="layer">#3楼</a><a name="2888727" id="comment_anchor_2888727"></a>
				<span>
					 <span class="comment_date">2014-03-05 11:26</span>
				</span>
			<a id="a_comment_author_2888727" href="http://home.cnblogs.com/u/596259/" target="_blank">it_blog_zpt</a> <a href="http://msg.cnblogs.com/send/it_blog_zpt" title="发送站内短消息" class="sendMsg2This">&nbsp;</a>
		</div>
		<div class="postText">
			<div id="comment_body_2888727" class="blog_comment_body">很好的集合</div><div class="comment_vote"><a href="javascript:void(0);" class="comment_digg" onclick="return voteComment(2888727,'Digg',this)">支持(0)</a><a href="javascript:void(0);" class="comment_bury" onclick="return voteComment(2888727,'Bury',this)">反对(0)</a></div>
		</div>
        <div class="commentOpt">
		&nbsp;&nbsp;<span class="comment_actions"><a href="javascript:void(0);" onclick="return ReplyComment(2888727,'bBsIDmh91oDW2FCKwRM2biAG4VtXa4CXl3iA7Wy9vfHIT5uCn5VjGQ==')">回复</a><a href="javascript:void(0);" onclick="return QuoteComment(2888727,'bBsIDmh91oDW2FCKwRM2biAG4VtXa4CXl3iA7Wy9vfHIT5uCn5VjGQ==')">引用</a></span>
        </div>
	</div>
	<br>

	<div class="post">			
		<div class="postTitle">
			<a href="#2910898" class="layer">#4楼</a><a name="2910898" id="comment_anchor_2910898"></a>
				<span>
					 <span class="comment_date">2014-04-03 20:38</span>
				</span>
			<a id="a_comment_author_2910898" href="https://www.cnblogs.com/fenglife/" target="_blank">fenglife</a> <a href="http://msg.cnblogs.com/send/fenglife" title="发送站内短消息" class="sendMsg2This">&nbsp;</a>
		</div>
		<div class="postText">
			<div id="comment_body_2910898" class="blog_comment_body">很系统性的学习资料,非常感谢</div><div class="comment_vote"><a href="javascript:void(0);" class="comment_digg" onclick="return voteComment(2910898,'Digg',this)">支持(0)</a><a href="javascript:void(0);" class="comment_bury" onclick="return voteComment(2910898,'Bury',this)">反对(0)</a></div>
		</div>
        <div class="commentOpt">
		&nbsp;&nbsp;<span class="comment_actions"><a href="javascript:void(0);" onclick="return ReplyComment(2910898,'WDJ/Nr4ciY9ZTYY798cidPK078CxriaYVKdWbhVB7uuQ2KesSc0S9Q==')">回复</a><a href="javascript:void(0);" onclick="return QuoteComment(2910898,'WDJ/Nr4ciY9ZTYY798cidPK078CxriaYVKdWbhVB7uuQ2KesSc0S9Q==')">引用</a></span>
        </div>
	</div>
	<br>

	<div class="post">			
		<div class="postTitle">
			<a href="#2924079" class="layer">#5楼</a><a name="2924079" id="comment_anchor_2924079"></a>
				<span>
					 <span class="comment_date">2014-04-23 21:14</span>
				</span>
			<a id="a_comment_author_2924079" href="http://home.cnblogs.com/u/475594/" target="_blank">whdugh</a> <a href="http://msg.cnblogs.com/send/whdugh" title="发送站内短消息" class="sendMsg2This">&nbsp;</a>
		</div>
		<div class="postText">
			<div id="comment_body_2924079" class="blog_comment_body">楼主的学习精神值得敬佩</div><div class="comment_vote"><a href="javascript:void(0);" class="comment_digg" onclick="return voteComment(2924079,'Digg',this)">支持(0)</a><a href="javascript:void(0);" class="comment_bury" onclick="return voteComment(2924079,'Bury',this)">反对(0)</a></div>
		</div>
        <div class="commentOpt">
		&nbsp;&nbsp;<span class="comment_actions"><a href="javascript:void(0);" onclick="return ReplyComment(2924079,'5ijt8hjg3ATXc1iTKRFkFAhjkhVjTGzWOfAqlGynh33i2IdmCNJBJQ==')">回复</a><a href="javascript:void(0);" onclick="return QuoteComment(2924079,'5ijt8hjg3ATXc1iTKRFkFAhjkhVjTGzWOfAqlGynh33i2IdmCNJBJQ==')">引用</a></span>
        </div>
	</div>
	<br>

	<div class="post">			
		<div class="postTitle">
			<a href="#3023835" class="layer">#6楼</a><a name="3023835" id="comment_anchor_3023835"></a>
				<span>
					 <span class="comment_date">2014-09-05 11:45</span>
				</span>
			<a id="a_comment_author_3023835" href="https://www.cnblogs.com/renxinyuan/" target="_blank">任心愿</a> <a href="http://msg.cnblogs.com/send/%E4%BB%BB%E5%BF%83%E6%84%BF" title="发送站内短消息" class="sendMsg2This">&nbsp;</a>
		</div>
		<div class="postText">
			<div id="comment_body_3023835" class="blog_comment_body">太感谢博主啦!!灰常不错的学习资料!!</div><div class="comment_vote"><a href="javascript:void(0);" class="comment_digg" onclick="return voteComment(3023835,'Digg',this)">支持(0)</a><a href="javascript:void(0);" class="comment_bury" onclick="return voteComment(3023835,'Bury',this)">反对(0)</a></div><span id="comment_3023835_avatar" style="display:none;">http://pic.cnblogs.com/face/653419/20170329222620.png</span>
		</div>
        <div class="commentOpt">
		&nbsp;&nbsp;<span class="comment_actions"><a href="javascript:void(0);" onclick="return ReplyComment(3023835,'tXkW2PNcMuBktOek3dGI3dZw0HhrfBrX1cTBtQ6heSNfK6QaHspwYQ==')">回复</a><a href="javascript:void(0);" onclick="return QuoteComment(3023835,'tXkW2PNcMuBktOek3dGI3dZw0HhrfBrX1cTBtQ6heSNfK6QaHspwYQ==')">引用</a></span>
        </div>
	</div>
	<br>

	<div class="post">			
		<div class="postTitle">
			<a href="#3130534" class="layer">#7楼</a><a name="3130534" id="comment_anchor_3130534"></a>
				<span>
					 <span class="comment_date">2015-02-19 00:25</span>
				</span>
			<a id="a_comment_author_3130534" href="https://www.cnblogs.com/baolibin528/" target="_blank">鲍礼彬</a> <a href="http://msg.cnblogs.com/send/%E9%B2%8D%E7%A4%BC%E5%BD%AC" title="发送站内短消息" class="sendMsg2This">&nbsp;</a>
		</div>
		<div class="postText">
			<div id="comment_body_3130534" class="blog_comment_body">真心感谢博主</div><div class="comment_vote"><a href="javascript:void(0);" class="comment_digg" onclick="return voteComment(3130534,'Digg',this)">支持(0)</a><a href="javascript:void(0);" class="comment_bury" onclick="return voteComment(3130534,'Bury',this)">反对(0)</a></div>
		</div>
        <div class="commentOpt">
		&nbsp;&nbsp;<span class="comment_actions"><a href="javascript:void(0);" onclick="return ReplyComment(3130534,'cRO8bnWSumV2EsL+q9jLUhDy4Z+drWi93unQIbniFKRhkB0/namfmQ==')">回复</a><a href="javascript:void(0);" onclick="return QuoteComment(3130534,'cRO8bnWSumV2EsL+q9jLUhDy4Z+drWi93unQIbniFKRhkB0/namfmQ==')">引用</a></span>
        </div>
	</div>
	<br>

	<div class="post">			
		<div class="postTitle">
			<a href="#3593481" class="layer">#8楼</a><a name="3593481" id="comment_anchor_3593481"></a>
				<span>
					 <span class="comment_date">2016-12-30 21:12</span>
				</span>
			<a id="a_comment_author_3593481" href="http://home.cnblogs.com/u/1089148/" target="_blank">沙漠有痕</a> <a href="http://msg.cnblogs.com/send/%E6%B2%99%E6%BC%A0%E6%9C%89%E7%97%95" title="发送站内短消息" class="sendMsg2This">&nbsp;</a>
		</div>
		<div class="postText">
			<div id="comment_body_3593481" class="blog_comment_body">非常有条理 看着很不错 谢谢博主!</div><div class="comment_vote"><a href="javascript:void(0);" class="comment_digg" onclick="return voteComment(3593481,'Digg',this)">支持(0)</a><a href="javascript:void(0);" class="comment_bury" onclick="return voteComment(3593481,'Bury',this)">反对(0)</a></div>
		</div>
        <div class="commentOpt">
		&nbsp;&nbsp;<span class="comment_actions"><a href="javascript:void(0);" onclick="return ReplyComment(3593481,'7td45CIHt4rpjNBDmo1bGrhTdMb9WD7+qN3tJt6KVRSvUF3B3ZwLDA==')">回复</a><a href="javascript:void(0);" onclick="return QuoteComment(3593481,'7td45CIHt4rpjNBDmo1bGrhTdMb9WD7+qN3tJt6KVRSvUF3B3ZwLDA==')">引用</a></span>
        </div>
	</div>
	<br>

	<div class="post">			
		<div class="postTitle">
			<a href="#3666696" class="layer">#9楼</a><a name="3666696" id="comment_anchor_3666696"></a>
				<span>
					 <span class="comment_date">2017-04-13 00:19</span>
				</span>
			<a id="a_comment_author_3666696" href="https://www.cnblogs.com/xxxholicl/" target="_blank">老妖仔</a> <a href="http://msg.cnblogs.com/send/%E8%80%81%E5%A6%96%E4%BB%94" title="发送站内短消息" class="sendMsg2This">&nbsp;</a>
		</div>
		<div class="postText">
			<div id="comment_body_3666696" class="blog_comment_body">感谢博主的整理!</div><div class="comment_vote"><a href="javascript:void(0);" class="comment_digg" onclick="return voteComment(3666696,'Digg',this)">支持(0)</a><a href="javascript:void(0);" class="comment_bury" onclick="return voteComment(3666696,'Bury',this)">反对(0)</a></div><span id="comment_3666696_avatar" style="display:none;">http://pic.cnblogs.com/face/1116425/20170302142428.png</span>
		</div>
        <div class="commentOpt">
		&nbsp;&nbsp;<span class="comment_actions"><a href="javascript:void(0);" onclick="return ReplyComment(3666696,'b7B+ntf9zXAtRQ+9L9uHbNu9YO4fbWy2qeHKfI+omZeY+f/DM9nb/Q==')">回复</a><a href="javascript:void(0);" onclick="return QuoteComment(3666696,'b7B+ntf9zXAtRQ+9L9uHbNu9YO4fbWy2qeHKfI+omZeY+f/DM9nb/Q==')">引用</a></span>
        </div>
	</div>
	<br>

	<div class="post">			
		<div class="postTitle">
			<a href="#3907328" class="layer">#10楼</a><a name="3907328" id="comment_anchor_3907328"></a>
				<span>
					 <span class="comment_date">2018-02-11 15:38</span>
				</span>
			<a id="a_comment_author_3907328" href="https://www.cnblogs.com/laov/" target="_blank">大牛笔记</a> <a href="http://msg.cnblogs.com/send/%E5%A4%A7%E7%89%9B%E7%AC%94%E8%AE%B0" title="发送站内短消息" class="sendMsg2This">&nbsp;</a>
		</div>
		<div class="postText">
			<div id="comment_body_3907328" class="blog_comment_body"><a href="http://www.daniubiji.cn/archives/596" target="_blank">http://www.daniubiji.cn/archives/596</a><br>HDFS读写流程</div><div class="comment_vote"><a href="javascript:void(0);" class="comment_digg" onclick="return voteComment(3907328,'Digg',this)">支持(0)</a><a href="javascript:void(0);" class="comment_bury" onclick="return voteComment(3907328,'Bury',this)">反对(0)</a></div><span id="comment_3907328_avatar" style="display:none;">http://pic.cnblogs.com/face/u352072.gif?id=18105439</span>
		</div>
        <div class="commentOpt">
		&nbsp;&nbsp;<span class="comment_actions"><a href="javascript:void(0);" onclick="return ReplyComment(3907328,'tGAgHM5YXKUHh55BLbSRik0qnHLMTe37IkRtJJW9I9WjPCHOG9Dp2A==')">回复</a><a href="javascript:void(0);" onclick="return QuoteComment(3907328,'tGAgHM5YXKUHh55BLbSRik0qnHLMTe37IkRtJJW9I9WjPCHOG9Dp2A==')">引用</a></span>
        </div>
	</div>
	<br>

	<div class="post">			
		<div class="postTitle">
			<a href="#4099308" class="layer">#11楼</a><a name="4099308" id="comment_anchor_4099308"></a><span id="comment-maxId" style="display:none;">4099308</span><span id="comment-maxDate" style="display:none;">2018/10/26 15:02:16</span>
				<span>
					 <span class="comment_date">2018-10-26 15:02</span>
				</span>
			<a id="a_comment_author_4099308" href="http://home.cnblogs.com/u/1494828/" target="_blank">jjjjkk</a> <a href="http://msg.cnblogs.com/send/jjjjkk" title="发送站内短消息" class="sendMsg2This">&nbsp;</a>
		</div>
		<div class="postText">
			<div id="comment_body_4099308" class="blog_comment_body">作者深度好文,深受感慨,想要继续交流学习的小伙伴可以加大数据群:824762628,进群可向管理员免费获取hadoop大数据资料一份</div><div class="comment_vote"><a href="javascript:void(0);" class="comment_digg" onclick="return voteComment(4099308,'Digg',this)">支持(0)</a><a href="javascript:void(0);" class="comment_bury" onclick="return voteComment(4099308,'Bury',this)">反对(0)</a></div>
		</div>
        <div class="commentOpt">
		&nbsp;&nbsp;<span class="comment_actions"><a href="javascript:void(0);" onclick="return ReplyComment(4099308,'DLZW7SvoKBq7whGby32S+7PbRr1lOA1REEnOCTcRhqKhFAVlrxqjQw==')">回复</a><a href="javascript:void(0);" onclick="return QuoteComment(4099308,'DLZW7SvoKBq7whGby32S+7PbRr1lOA1REEnOCTcRhqKhFAVlrxqjQw==')">引用</a></span>
        </div>
	</div>
	<br>

猜你喜欢

转载自blog.csdn.net/weixin_41919236/article/details/84666507