技术标签: zookeeper hadoop 大数据开发相关系统和框架的安装部署 分布式 hbase 大数据
简介:本篇博客是介绍怎么安装配置Hbase集群的,主要内容包括Hbase的相关网址,Hbase集群安装部署详细教程,Hbase集群高可用配置等。
1、Hbase官网:https://hbase.apache.org/
2、Hbase下载地址:https://hbase.apache.org/downloads.html
2、Hbase相关安装部署操作文档:
[[email protected] software]$ tar -zxvf hbase-2.0.5-bin.tar.gz -C /home/lqs/module
[[email protected] bin]$ sudo vim /etc/profile.d/my_env.sh
#HBASE_HOME
export HBASE_HOME=/home/lqs/module/hbase-2.0.5
export PATH=$PATH:$HBASE_HOME/bin
1.hbase-env.sh修改内容:
[[email protected] conf]$ pwd
/home/lqs/module/hbase-2.0.5/conf
[[email protected] conf]$ vim hbase-env.sh
export HBASE_MANAGES_ZK=false
[[email protected] conf]$ vim hbase-site.xml
<configuration>
<property>
<name>hbase.rootdir</name>
<value>hdfs://bdc112:8020/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>bdc112,bdc113,bdc114</value>
</property>
</configuration>
[[email protected] conf]$ vim regionservers
添加如下内容:
bdc112
bdc113
bdc114
[[email protected] module]$ xsync hbase-2.0.5/
注意:启动Hbase前一定要启动hadoop集群和Zookeeper集群!!!
1、单点启动
[[email protected] hbase-2.0.5]$ bin/hbase-daemon.sh start master
[[email protected] hbase-2.0.5]$ bin/hbase-daemon.sh start master regionserver
2、群启
[[email protected] hbase-2.0.5]$ start-hbase.sh
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/lqs/module/hbase-2.0.5/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/lqs/module/hadoop-3.1.3/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
running master, logging to /home/lqs/module/hbase-2.0.5/logs/hbase-lqs-master-bdc112.out
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/lqs/module/hbase-2.0.5/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/lqs/module/hadoop-3.1.3/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
bdc112: running regionserver, logging to /home/lqs/module/hbase-2.0.5/logs/hbase-lqs-regionserver-bdc112.out
bdc113: running regionserver, logging to /home/lqs/module/hbase-2.0.5/bin/../logs/hbase-lqs-regionserver-bdc113.out
bdc114: running regionserver, logging to /home/lqs/module/hbase-2.0.5/bin/../logs/hbase-lqs-regionserver-bdc114.out
3、群停
[[email protected] ~]$ stop-hbase.sh
stopping hbase..........
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/lqs/module/hbase-2.0.5/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/lqs/module/hadoop-3.1.3/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
启动成功后,可以通过“host:port”的方式来访问HBase管理页面,例如:
http://bdc112:16010
页面如下:
意义或者是作用:
在HBase中HMaster负责监控HRegionServer的生命周期,均衡RegionServer的负载,如果HMaster挂掉了,那么整个HBase集群将陷入不健康的状态,并且此时的工作状态并不会维持太久。所以HBase支持对HMaster的高可用配置。
1、关闭Hbase集群,没有开启不用管
stop-hbase.sh
(需要配置好环境变量,否则只能在hbase的bin下用)
2、在conf目录下创建backup-masters文件
[[email protected] conf]$ pwd
/home/lqs/module/hbase-2.0.5/conf
[[email protected] conf]$ vim backup-masters
输入:bdc1113
注意:这个备份节点可以设置多个,且可以任意设置
3、分发到集群的其他节点
[[email protected] conf]$ pwd
/home/lqs/module/hbase-2.0.5/conf
[[email protected] conf]$ xsync backup-masters
==================== bdc112 ====================
sending incremental file list
sent 62 bytes received 12 bytes 148.00 bytes/sec
total size is 7 speedup is 0.09
==================== bdc113 ====================
sending incremental file list
backup-masters
sent 116 bytes received 35 bytes 302.00 bytes/sec
total size is 7 speedup is 0.05
==================== bdc114 ====================
sending incremental file list
backup-masters
sent 116 bytes received 35 bytes 100.67 bytes/sec
total size is 7 speedup is 0.05
4、重新群启Hbase
[[email protected] conf]$ start-hbase.sh
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/lqs/module/hbase-2.0.5/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/lqs/module/hadoop-3.1.3/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
running master, logging to /home/lqs/module/hbase-2.0.5/logs/hbase-lqs-master-bdc112.out
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/lqs/module/hbase-2.0.5/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/lqs/module/hadoop-3.1.3/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
bdc112: running regionserver, logging to /home/lqs/module/hbase-2.0.5/logs/hbase-lqs-regionserver-bdc112.out
bdc113: running regionserver, logging to /home/lqs/module/hbase-2.0.5/bin/../logs/hbase-lqs-regionserver-bdc113.out
bdc114: running regionserver, logging to /home/lqs/module/hbase-2.0.5/bin/../logs/hbase-lqs-regionserver-bdc114.out
bdc113: running master, logging to /home/lqs/module/hbase-2.0.5/bin/../logs/hbase-lqs-master-bdc113.out
截图如下:
前言数据可视化API(Web),是基于腾讯位置服务JavaScript API GL实现的专业地理空间数据可视化渲染引擎。通过这套API,可以实现轨迹数据、坐标点数据、热力、迁徙、航线等空间数据的可视化展现。使用步骤1、注册成为腾讯位置服务开发者,并进入控制台 -> key管理界面创建key;2、数据可视化API(以下简称可视化API),所提供的可视化效果是以图层的方式叠加在JavaScript API GL之上,图层中所显示的数据由实例化的对象统一管理。3、加载可视化API可视化A
一. Python的numpy库作业过程中需要注意的点:1.字符串要用引号引起来2.除法运算的分母有多项时要用括号括起来 一般情况下不会使用math库,因为输入大部分都是矩阵、向量等,用numpy库会更方便。3.row vector行向量,Numpy与math的区别在于解决矩阵或向量问题,而非单个的实数等。4.要注意写乘号,为不能直接写s(1-s),要写成s...
Conclusion:High Level Synthesis of Complex Applications:An H.264 Video DecoderAim:Why need H.264:what is H.264:H.264 Video Decodingthe reason to choose H.264Introduce High Level SynthesisMETHODOLOGYH264 case 编译整理说明H264论文下载链接Aim:The article main shares t
2019年压力焊作业安全生产模拟考试题库及答案题库来源:安全生产模拟考试一点通第1题、【判断题】 1998年原劳动部劳保所和中国劳动保护科学技术学会提出了《职业安全卫生管理体系试行标准》。A、正确 B、错误正确答案:B第2题、【判断题】 1999年10月国家经贸委颁布了《职业安全卫生管理体系规范及使用指南》,并下发了在国内开展职业安全卫生管理体系试点工作的通知。A、正确 B...
2.4GHz RF-SIM卡及读写终端技术概述 1. 2.4GHz RF-SIM卡技术概要 (1)、使用2.4GHz频段, 自动选频; (2)、通信速率1Mbps,高可靠性连接与通信; (3)、支持自动感应和主动触发连接两种通信方法; (4)、双向通信距离10CM-500CM,可以根据应用调整; (5)、单向数据广播(半径100M); (6
题源:https://ac.nowcoder.com/acm/contest/5657#question在线编程常见输入输出JavaScript练习ABCDEFGHIJA输入包括两个正整数a,b(1 <= a, b <= 10^9),输入数据包括多组。输出a+b的结果输入:1 510 20输出:630var n;while(n = readline()){ var s = n.split(' '); console.log(parseInt(s[.
苹果6S微信,所有小程序都不能看广告和分享?您应该在“设置”中将其关闭。你可以打开小程序设置,如果你想看广告,打开设置,调整它。我希望我能帮助你。非常感谢。苹果6S微信打开一直显示收取中,微信里所有功能都不能打开了是怎么回事?在安装停止更改说明文件之前,我们发现有一个副作用,即微信消息有延迟。删除后微信正常接收信息。苹果6s下微信显示无法安装应用程序?建议先清理手机内存。内存不足,微信安装失败。清...
7-1 列出连通集 (25 分)给定一个有N个顶点和E条边的无向图,请用DFS和BFS分别列出其所有的连通集。假设顶点从0到N−1编号。进行搜索时,假设我们总是从编号最小的顶点出发,按编号递增的顺序访问邻接点。输入格式:输入第1行给出2个整数N(0<N≤10)和E,分别是图的顶点数和边数。随后E行,每行给出一条边的两个端点。每行中的数字之间用1空格分隔。输出格式:按照"{ v1 v2 … vk }"的格式,每行输出一个连通集。先输出DFS的结果,再输出BFS的结果。输入样例:8 6
五张表:userrolerightuser_rolerole_right<resultMap id="BaseResultMapUser" type="com.usst.cad.backmanage.pojo.User"> <id column="ID" property="id" jdbcType="VARCHAR"/> <...
?id=1’) order by 3%23http://192.168.197.146/sqli-labs/sqli-labs/Less-3/?id=-1’) union select 1,database(),3%23http://192.168.197.146/sqli-labs/sqli-labs/Less-3/?id=-1’) union select 1,(select group_...
标签:虽然网上关于CocoaPods安装教程多不胜数,但是我在安装的过程中还是出现了很多错误,所以大家可以照下来步骤装一下,我相信会很好用.前言在iOS项目中使用第三方类库可以说是非常常见的事,但是要正确地配置他们有时候是非常繁琐的事情,幸运的是CocoaPods是一个很好的解决方案。什么是CocoaPodsCocoaPods是OS X和iOS下的一个第三类库管理工具,通过Co...