Kibana shutdown and stop failure solution

1. Problem description

The ElasticSearch service stops abnormally, and Kibana prompts that it cannot connect to ElasticSearch

log   [08:22:53.102] [warning][admin][elasticsearch] Unable to revive connection: http://node1:9200/
  log   [08:22:53.105] [warning][admin][elasticsearch] No living connections
  log   [08:22:55.611] [warning][elasticsearch][monitoring-ui] Unable to revive connection: http://node1:9200/
  log   [08:22:55.612] [warning][elasticsearch][monitoring-ui] No living connections
  log   [08:22:55.614] [warning][admin][elasticsearch] Unable to revive connection: http://node1:9200/
  log   [08:22:55.614] [warning][admin][elasticsearch] No living connections
  log   [08:22:57.620] [warning][admin][elasticsearch] Unable to revive connection: http://node1:9200/
  log   [08:22:57.621] [warning][admin][elasticsearch] No living connections
  log   [08:22:58.120] [warning][elasticsearch][monitoring-ui] Unable to revive connection: http://node1:9200/
  log   [08:22:58.121] [warning][elasticsearch][monitoring-ui] No living connections
  log   [08:22:58.122] [warning][admin][elasticsearch] Unable to revive connection: http://node1:9200/
  log   [08:22:58.123] [warning][admin][elasticsearch] No living connections
  log   [08:23:00.631] [warning][elasticsearch][monitoring-ui] Unable to revive connection: http://node1:9200/
  log   [08:23:00.632] [warning][elasticsearch][monitoring-ui] No living connections
  log   [08:23:00.633] [warning][admin][elasticsearch] Unable to revive connection: http://node1:9200/
  log   [08:23:00.634] [warning][admin][elasticsearch] No living connections
  log   [08:23:01.541] [warning][data][elasticsearch] Unable to revive connection: http://node1:9200/
  log   [08:23:01.542] [warning][data][elasticsearch] No living connections
  log   [08:23:01.543] [warning][elasticsearch][monitoring-ui] Unable to revive connection: http://node1:9200/
  log   [08:23:01.544] [warning][elasticsearch][monitoring-ui] No living connections
  log   [08:23:01.545] [warning][license][xpack] License information could not be obtained from Elasticsearch. Error: No Living connections
  log   [08:23:01.546] [warning][license][xpack] License information could not be obtained from Elasticsearch. Error: No Living connections
  log   [08:23:03.139] [warning][elasticsearch][monitoring-ui] Unable to revive connection: http://node1:9200/
  log   [08:23:03.140] [warning][elasticsearch][monitoring-ui] No living connections
  log   [08:23:03.141] [warning][admin][elasticsearch] Unable to revive connection: http://node1:9200/
  log   [08:23:03.141] [warning][admin][elasticsearch] No living connections
  log   [08:23:05.647] [warning][elasticsearch][monitoring-ui] Unable to revive connection: http://node1:9200/
  log   [08:23:05.648] [warning][elasticsearch][monitoring-ui] No living connections
  log   [08:23:05.650] [warning][admin][elasticsearch] Unable to revive connection: http://node1:9200/
  log   [08:23:05.650] [warning][admin][elasticsearch] No living connections
  log   [08:23:08.157] [warning][elasticsearch][monitoring-ui] Unable to revive connection: http://node1:9200/
  log   [08:23:08.158] [warning][elasticsearch][monitoring-ui] No living connections
  log   [08:23:08.160] [warning][admin][elasticsearch] Unable to revive connection: http://node1:9200/
  log   [08:23:08.160] [warning][admin][elasticsearch] No living connections
  log   [08:23:10.670] [warning][elasticsearch][monitoring-ui] Unable to revive connection: http://node1:9200/
  log   [08:23:10.671] [warning][elasticsearch][monitoring-ui] No living connections
  log   [08:23:10.672] [warning][admin][elasticsearch] Unable to revive connection: http://node1:9200/
  log   [08:23:10.673] [warning][admin][elasticsearch] No living connections
  log   [08:23:13.180] [warning][elasticsearch][monitoring-ui] Unable to revive connection: http://node1:9200/
  log   [08:23:13.181] [warning][elasticsearch][monitoring-ui] No living connections
  log   [08:23:13.182] [warning][admin][elasticsearch] Unable to revive connection: http://node1:9200/
  log   [08:23:13.183] [warning][admin][elasticsearch] No living connections
  log   [08:23:15.690] [warning][elasticsearch][monitoring-ui] Unable to revive connection: http://node1:9200/
  log   [08:23:15.691] [warning][elasticsearch][monitoring-ui] No living connections
  log   [08:23:15.693] [warning][admin][elasticsearch] Unable to revive connection: http://node1:9200/
  log   [08:23:15.694] [warning][admin][elasticsearch] No living connections
  log   [08:23:18.201] [warning][elasticsearch][monitoring-ui] Unable to revive connection: http://node1:9200/
  log   [08:23:18.202] [warning][elasticsearch][monitoring-ui] No living connections
  log   [08:23:18.203] [warning][admin][elasticsearch] Unable to revive connection: http://node1:9200/
  log   [08:23:18.204] [warning][admin][elasticsearch] No living connections
  log   [08:23:20.713] [warning][elasticsearch][monitoring-ui] Unable to revive connection: http://node1:9200/
  log   [08:23:20.714] [warning][elasticsearch][monitoring-ui] No living connections
  log   [08:23:20.716] [warning][admin][elasticsearch] Unable to revive connection: http://node1:9200/
  log   [08:23:20.717] [warning][admin][elasticsearch] No living connections
  log   [08:23:23.223] [warning][elasticsearch][monitoring-ui] Unable to revive connection: http://node1:9200/
  log   [08:23:23.224] [warning][elasticsearch][monitoring-ui] No living connections
  log   [08:23:23.226] [warning][admin][elasticsearch] Unable to revive connection: http://node1:9200/
  log   [08:23:23.226] [warning][admin][elasticsearch] No living connections
  log   [08:23:25.732] [warning][elasticsearch][monitoring-ui] Unable to revive connection: http://node1:9200/
  log   [08:23:25.733] [warning][elasticsearch][monitoring-ui] No living connections

try closing kibana

[root@node1 elastic]# ps -ef|grep kibana
root     24796 24763  0 16:16 pts/0    00:00:00 grep --color=auto kibana
[root@node1 elastic]# kill 24796
bash: kill: (24796) - No such process
[root@node1 elastic]# 

The shutdown failed because the command could not query the PID of kibana

2. Solution 1

try below command

[elastic@node1 kibana-5.6.5]$ fuser -n tcp 5601
5601/tcp:            24001
[elastic@node1 kibana-5.6.5]$ kill 24001
[elastic@node1 kibana-5.6.5]$ jps
25104 Jps
24941 Elasticsearch
[1]+  Terminated              bin/kibana
[elastic@node1 kibana-5.6.5]$ 

3. Solution 2

[elastic@node1 ~]$ ps -ef | grep node
root       752     1  0 Apr23 ?        00:00:00 /usr/sbin/mcelog --ignorenodev --daemon --syslog
elastic  25184 19489  7 16:31 pts/1    00:00:12 bin/../node/bin/node --no-warnings bin/../src/cli
elastic  25228 24873  0 16:33 pts/0    00:00:00 grep --color=auto node
[elastic@node1 ~]$ 
[elastic@node1 ~]$ kill 25184

Guess you like

Origin http://43.154.161.224:23101/article/api/json?id=324840426&siteId=291194637