redis-mysql-kafka安装

redis

Icon

如何安装：

wget http://download.redis.io/releases/redis-2.8.7.tar.gz

tar xzf redis-2.8.7.tar.gz

cd redis-2.8.7

make

mkdir -p /home/work/local/redis/conf

make PREFIX=/home/work/local/redis install

cp redis.conf /home/work/local/redis/conf

vim /home/work/local/redis/conf 修改pid文件目录

启动：

cd /home/work/local/redis

nohup ./bin/redis-server conf/redis.conf 2>&1 > /dev/null &

mysql

Icon

如何安装：

参考文档：http://blog.csdn.net/wendi_0506/article/details/39478369/

mysql安装包：http://dev.mysql.com/downloads/mysql/#downloads 在select platform中下载source code中的tar包

wget http://dev.mysql.com/get/Downloads/MySQL-5.6/mysql-5.6.31.tar.gz

tar zxvf mysql-5.6.31.tar.gz

cd mysql-5.6.31

cmake -DCMAKE_INSTALL_PREFIX=/home/work/local/mysql -DMYSQL_UNIX_ADDR=/home/work/local/mysql/mysql.sock -DDEFAULT_CHARSET=utf8 -DDEFAULT_COLLATION=utf8_general_ci -DWITH_INNOBASE_STORAGE_ENGINE=1 -DWITH_ARCHIVE_STORAGE_ENGINE=1 -DWITH_BLACKHOLE_STORAGE_ENGINE=1 -DMYSQL_DATADIR=/home/work/local/mysql/data -DMYSQL_TCP_PORT=3306 -DENABLE_DOWNLOADS=1

make && make install

cd /home/work/local/mysql

scripts/mysql_install_db --datadir=/home/work/local/mysql/data

启动:

cd /home/work/local/mysql

nohup bin/mysqld_safe 2>&1 > /dev/null &

zookeeper

Icon

如何安装：

参考文档：https://blog.csdn.net/lk10207160511/article/details/50526404

tomcat

Icon

安装：tomcat作为web服务器，应尽量与线上服务器的版本、定制化配置统一，所以tomcat的安装资源可以从运维获取，这里不多做介绍

配置：如若涉及到服务拆分，需要修改以下配置

/home/work/local/tomcat_8080/conf/server.xml 4处设计port的参数需要改成系统未占用的端口，否则无法启动成功
/home/work/local/tomcat_8080/bin/catalina.sh 修改tomcat的home目录：CATALINA_HOME=/home/work/local/tomcat_8xxx

启动：cd /home/work/local/tomcat_8080/bin && sh startup.sh

日志：除业务日志外，tomcat自身的启动日志在TOMCAT_HOME/logs/catalina.out 若发现tomcat启动失败，查此日志会有错误提示

kafka

Icon

安装：kafka安装比较简单，官网下载与线上版本一致的包，配置默认不需要改（除非需要修改端口号或修改了zk的默认端口）解压后直接启动即可

一定要注意保证机器上只有一个zookeeper进程，不然kafka会无法注册到zookeeper

启动：

cd /home/work/local/kafka/bin

nohup sh kafka-server-start.sh ../config/server.properties 2>&1 > /dev/null &

Icon

安装：官方下载与线上一致版本，解压即可 https://www.elastic.co/downloads/elasticsearch

启动：

su es

cd /home/work/local/elasticsearch-5.0.0/bin

nohup ./elasticsearch -d 2>&1 &

disconf

Icon

disconf数据库

如果需要新增配置或批量修改配置，可以修改env和config表，很简单。看一眼就懂；

insert into env (env_id,name) values (8,'docker4');

insert into env (env_id,name) values (14,'docker_yangpeng');

insert into env (env_id,name) values (15,'docker_zhaoxing');

select * from env;

delete from config where env_id=5;

insert into config (type,name,value,app_id,version,env_id,status) select type,name,value,app_id,version,env_id+20,status from config where env_id=2;

update config set value=REPLACE(value,'ip:port','ip:port'') where env_id=20;

update config set value=REPLACE(value,'ip:port'','ip:port'') where env_id=23;

elk

Icon

日志中心目前主要是单点结构：

nginx(5.45) ：日志:/data/applog/nginx 启动：cd /data/soft/openresty/nginx && ./sbin/nginx -c ./conf/nginx.conf
logstash(5.45) ：采集nginx日志输出到es 日志在：/data/elk-soft/log_service.log 安装在：/data/elk-soft/logstash-5.6.0 启动: cd /data/elk-soft/logstash-5.6.0/bin && nohup ./logstash -f ../config/logcenter.conf 2>&1 &
es(58.115)：安装在：/data/apps/elk_home/elasticsearch-5.5.0 es账号密码：elastic:xxxxxx 启动：bin/elasticsearch -d
kibana(5.43): cd /data/elk-soft/kibana-5.5.0-linux-x86_64 && nohup ./bin/../node/bin/node --no-warnings ./bin/../src/cli 2>&1 &

搭建文档：http://wiki.uxin001.com/pages/viewpage.action?pageId=2303604

问题排查：

确认以上四个资源进程是否还在，不在则重启
逐步观察资源日志，查看是否有报错、延迟、解析问题等
调试curl：curl -H 'Content-Type: application/json; charset=UTF-8' -H 'Accept: application/json' -H 'User-Agent: Dalvik/2.1.0 (Linux; U; Android 8.0.0; Nexus 5X Build/OPR4.170623.006)' -H 'Host: 101.200.175.73' --data-binary '{"i":{"app_id":"hongdou","app_supplier":"00","app_version":"3.2.8","imei":"353627073801659","ip":"","model":"Nexus%205X","network_supplier":"","network_type":"WIFI","os":"iOS","os_unlock":0,"os_version":"8.0.0","resolution":"1080x1794"},"m":[{"communicatePrice":0.0,"duration":4328,"name":"appLaunch","price":0.0,"tb":1526673264048,"te":1526673268376},{"communicatePrice":0.0,"duration":1146,"name":"loginTencentIMSDK","price":0.0,"result":"200-success","tb": 1533716952756,"te": 1533716952756,"uid":"112233445567"}]}' --compressed 'http://192.168.5.45/app'
检查机器负载：cpu、内存、磁盘
kibana上查看monitoring、management有无异常
重启大法好(除es外都用root权限启动)

定时任务：可登录机器查看crontab

2018-09-10Es证书过期，导致Kibana无法使用，更新证书方法：

1.查看当前ES证书信息，是否过期以及过期时间

curl -XGET -u account:password 'http://60.205.58.115:9200/_license'

2.新建license.json证书文件(主要是修改过期时间，目前已修改到2050年)

cd /data/apps/elk_home/elasticsearch-5.5.0/plugins/x-pack vim license.json

cat license.json

{"license":{"uid":"e029e745-2e28-46a2-9423-41877be51189","type":"platinum","issue_date_in_millis":1536537600000,"expiry_date_in_millis":2546092800000,"max_nodes":1000,"issued_to":"my-application","issuer":"elasticsearc","signature":"AAAAAwAAAA1s8cd","start_date_in_millis":1536537600000}}

3.重新导入证书

curl -PUT -u account:password 'http://60.205.58.115:9200/_xpack/license' -H "Content-Type: application/json" -d @license.json

redis-mysql-kafka安装

猜你喜欢