背景： 昨天接到任务，需要在云服务器上部署一套公司业务系统
业务组件（tomcat、mysql zookeeper dubbo redis）都是存放在/home下，于是拷贝了原服务器内的/home到新服务器（centos7.5）
执行启动脚本， 发现网站并不能打开
启动tomcat后 使用netstat -lntp 查看 tomcat的SHUTDOWN端口没有起来，说明tomcat并没有完全启动
server.xml
查看catalina.out发现deploy ROOT.war耗时非常久， （正常只需10s左右）
且zookeeper dubbo的链接地址非本机ip，且有报错：
com.alibaba.dubbo.remoting.transport.AbstractClient:112}- [DUBBO] Failed to start NettyClient XXXXX/XXXXXXX connect to the server
经过大量实验后 （升级tomcat版本、升级系统版本、更换系统内核版本）仍然无效
最后通过dubbo的报错百度后，确定问题出在这， dubbo zookeeper链接的并不是本机ip，
这个问题在ip地址不是本机网卡的时候会遇到 （比如云服务器）
解决办法：
echo ‘quorumListenOnAllIPs=true’ >> /home/zookeeper/zookeeper-3.4.9/conf/zoo.cfg
然后重启服务
总结： 业务系统起不来一定要仔细查看日志每一条报错
[2020-02-04 17:55:44 WARN ] [localhost-startStop-1] {com.alibaba.dubbo.remoting.transport.AbstractClient:112}- [DUBBO] Failed to start NettyClient hefei_ceshi/120.209.131.70 connect to the server /120.209.131.70:20882 (check == false, ignore and retry later!), cause: client(url: dubbo://120.209.131.70:20882/com.prison.res.service.IResService?anyhost=true&application=common-consumer&check=false&codec=dubbo&default.check=false&default.delay=-1&default.retries=0&default.timeout=600000&delay=-1&dubbo=2.8.4&generic=false&heartbeat=60000&interface=com.prison.res.service.IResService&methods=countDistrictLine,delDistrictRuleUserById,getDistrictByLineId,checkLine,delDistrictPoint,getFilesByEvtId,getResFile,queryRuleUser,getDistrictById,checkBeforeSaveOrUpdate,queryDistrictLineTag,isCanParent,queryDistrictDevicesByPartyId,getDistrictByParentPartyId,countDistricts,countDistrictRule,queryDistrictLine,deleteDistrictPoint,getDistrictPointByPointId,delDistrictUserNum,getDistrictDevicesByParentId,saveOrUpdDistrictLine,delDistrictDevice,getDistrictByDeviceId,saveOrUpdDistrictPoint,getResFileByResIds,saveOrUpdDistrict,getDistrictCriminalCharts,getDistrictListByType,countResEvents,getDistrictDrawArea,getResFileByResId,queryResEvents,queryDistrictPointsByLineId,saveOrUpdDistrictRule,getDistrictUserNumByDistrictId,delDistrict,saveOrUpdResEvent,queryLinePointByLineId,queryDistrictParents,listDistrictPoint,queryDistrictRule,delDistrictLine,queryDistrictLineByName,queryLinePointByPoint,saveOrUpdDistrictUserNum,DistrictUserNumByMonitorId,getDistrictUserNumByDeviceId,getDistrictPoint,getDistrictDevice,delDistrictRule,updKeyDistrict,queryDistricts,getResConfig,delResEvent,getDistrictUserNumByDistrictCode,queryDistrictsTag,queryDistrictPoints,delDistrictLines,delDistrictDrawArea,countDistrictDevices,saveOrUpdResRelat,saveOrUpdResFile,getDistrictLinePreview,saveOrUpdDistrictDevice,queryRuleUserById,getDistrictMarkDevice,countDistrictPoint,getDistrictRoot,updResEvent,saveOrUpdRuleUser,getDistrictPreview,queryDistrictLineByLineId,queryDistrictDevices,delResFile,getDistrictPointByDeviceid,queryResEventUnTransFinish,getResEvent&organization=dubbox&owner=programmer&pid=13699&revision=1.0&side=consumer×tamp=1580810141493&version=1.0.0) failed to connect to server /120.209.131.70:20882 client-side timeout 3000ms (elapsed: 3001ms) from netty client 120.209.131.70 using dubbo version 2.8.4, dubbo version: 2.8.4, current host: 120.209.131.70
com.alibaba.dubbo.remoting.RemotingException: client(url: dubbo://120.209.131.70:20882/com.prison.res.service.IResService?anyhost=true&application=common-consumer&check=false&codec=dubbo&default.check=false&default.delay=-1&default.retries=0&default.timeout=600000&delay=-1&dubbo=2.8.4&generic=false&heartbeat=60000&interface=com.prison.res.service.IResService&methods=countDistrictLine,delDistrictRuleUserById,getDistrictByLineId,checkLine,delDistrictPoint,getFilesByEvtId,getResFile,queryRuleUser,getDistrictById,checkBeforeSaveOrUpdate,queryDistrictLineTag,isCanParent,queryDistrictDevicesByPartyId,getDistrictByParentPartyId,countDistricts,countDistrictRule,queryDistrictLine,deleteDistrictPoint,getDistrictPointByPointId,delDistrictUserNum,getDistrictDevicesByParentId,saveOrUpdDistrictLine,delDistrictDevice,getDistrictByDeviceId,saveOrUpdDistrictPoint,getResFileByResIds,saveOrUpdDistrict,getDistrictCriminalCharts,getDistrictListByType,countResEvents,getDistrictDrawArea,getResFileByResId,queryResEvents,queryDistrictPointsByLineId,saveOrUpdDistrictRule,getDistrictUserNumByDistrictId,delDistrict,saveOrUpdResEvent,queryLinePointByLineId,queryDistrictParents,listDistrictPoint,queryDistrictRule,delDistrictLine,queryDistrictLineByName,queryLinePointByPoint,saveOrUpdDistrictUserNum,DistrictUserNumByMonitorId,getDistrictUserNumByDeviceId,getDistrictPoint,getDistrictDevice,delDistrictRule,updKeyDistrict,queryDistricts,getResConfig,delResEvent,getDistrictUserNumByDistrictCode,queryDistrictsTag,queryDistrictPoints,delDistrictLines,delDistrictDrawArea,countDistrictDevices,saveOrUpdResRelat,saveOrUpdResFile,getDistrictLinePreview,saveOrUpdDistrictDevice,queryRuleUserById,getDistrictMarkDevice,countDistrictPoint,getDistrictRoot,updResEvent,saveOrUpdRuleUser,getDistrictPreview,queryDistrictLineByLineId,queryDistrictDevices,delResFile,getDistrictPointByDeviceid,queryResEventUnTransFinish,getResEvent&organization=dubbox&owner=programmer&pid=13699&revision=1.0&side=consumer×tamp=1580810141493&version=1.0.0) failed to connect to server /120.209.131.70:20882 client-side timeout 3000ms (elapsed: 3001ms) from netty client 120.209.131.70 using dubbo version 2.8.4
at com.alibaba.dubbo.remoting.transport.netty.NettyClient.doConnect(NettyClient.java:144)
at com.alibaba.dubbo.remoting.transport.AbstractClient.connect(AbstractClient.java:280)
at com.alibaba.dubbo.remoting.transport.AbstractClient.(AbstractClient.java:103)
at com.alibaba.dubbo.remoting.transport.netty.NettyClient.(NettyClient.java:78)
at com.alibaba.dubbo.remoting.transport.netty.NettyTransporter.connect(NettyTransporter.java:37)
at com.alibaba.dubbo.remoting.Transporter A d p a t i v e . c o n n e c t ( T r a n s p o r t e r Adpative.connect(Transporter Adpative.connect(TransporterAdpative.java)
at com.alibaba.dubbo.remoting.Transporters.connect(Transporters.java:67)
at com.alibaba.dubbo.remoting.exchange.support.header.HeaderExchanger.connect(HeaderExchanger.java:37)
at com.alibaba.dubbo.remoting.exchange.Exchangers.connect(Exchangers.java:102)
at com.alibaba.dubbo.rpc.protocol.dubbo.DubboProtocol.initClient(DubboProtocol.java:424)
at com.alibaba.dubbo.rpc.protocol.dubbo.DubboProtocol.getSharedClient(DubboProtocol.java:390)
at com.alibaba.dubbo.rpc.protocol.dubbo.DubboProtocol.getClients(DubboProtocol.java:367)
at com.alibaba.dubbo.rpc.protocol.dubbo.DubboProtocol.refer(DubboProtocol.java:349)
at com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper.refer(ProtocolFilterWrapper.java:62)
at com.alibaba.dubbo.rpc.protocol.ProtocolListenerWrapper.refer(ProtocolListenerWrapper.java:65)
at com.alibaba.dubbo.rpc.Protocol A d p a t i v e . r e f e r ( P r o t o c o l Adpative.refer(Protocol Adpative.refer(ProtocolAdpative.java)
at com.alibaba.dubbo.registry.integration.RegistryDirectory.toInvokers(RegistryDirectory.java:395)
at com.alibaba.dubbo.registry.integration.RegistryDirectory.refreshInvoker(RegistryDirectory.java:224)
at com.alibaba.dubbo.registry.integration.RegistryDirectory.notify(RegistryDirectory.java:195)
at com.alibaba.dubbo.registry.support.AbstractRegistry.notify(AbstractRegistry.java:449)
at com.alibaba.dubbo.registry.support.FailbackRegistry.doNotify(FailbackRegistry.java:273)
at com.alibaba.dubbo.registry.support.FailbackRegistry.notify(FailbackRegistry.java:259)
at com.alibaba.dubbo.registry.zookeeper.ZookeeperRegistry.doSubscribe(ZookeeperRegistry.java:170)
at com.alibaba.dubbo.registry.support.FailbackRegistry.subscribe(FailbackRegistry.java:189)
at com.alibaba.dubbo.registry.integration.RegistryDirectory.subscribe(RegistryDirectory.java:133)
at com.alibaba.dubbo.registry.integration.RegistryProtocol.doRefer(RegistryProtocol.java:271)
at com.alibaba.dubbo.registry.integration.RegistryProtocol.refer(RegistryProtocol.java:254)
at com.alibaba.dubbo.rpc.protocol.ProtocolFilterWrapper.refer(ProtocolFilterWrapper.java:60)
at com.alibaba.dubbo.rpc.protocol.ProtocolListenerWrapper.refer(ProtocolListenerWrapper.java:63)
at com.alibaba.dubbo.rpc.Protocol A d p a t i v e . r e f e r ( P r o t o c o l Adpative.refer(Protocol Adpative.refer(ProtocolAdpative.java)
at com.alibaba.dubbo.config.ReferenceConfig.createProxy(ReferenceConfig.java:392)
at com.alibaba.dubbo.config.ReferenceConfig.init(ReferenceConfig.java:300)
at com.alibaba.dubbo.config.ReferenceConfig.get(ReferenceConfig.java:138)
at com.alibaba.dubbo.config.spring.ReferenceBean.getObject(ReferenceBean.java:65)
at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:168)
at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.getObjectFromFactoryBean(FactoryBeanRegistrySupport.java:103)
at org.springframework.beans.factory.support.AbstractBeanFactory.getObjectForBeanInstance(AbstractBeanFactory.java:1585)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:254)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1192)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1116)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1014)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:545)
at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:88)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:331)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1214)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:543)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482)
at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.getBeansOfType(DefaultListableBeanFactory.java:534)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.getBeansOfType(DefaultListableBeanFactory.java:523)
at org.springframework.context.support.AbstractApplicationContext.getBeansOfType(AbstractApplicationContext.java:1162)
at com.prison.common.cache.LocalCacher.init(LocalCacher.java:16)
at com.prison.common.init.ApplicationCacheInit.setApplicationContext(ApplicationCacheInit.java:30)
at org.springframework.context.support.ApplicationContextAwareProcessor.invokeAwareInterfaces(ApplicationContextAwareProcessor.java:119)
at org.springframework.context.support.ApplicationContextAwareProcessor.postProcessBeforeInitialization(ApplicationContextAwareProcessor.java:94)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:408)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1570)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:545)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482)
at org.springframework.beans.factory.support.AbstractBeanFactory 1. g e t O b j e c t ( A b s t r a c t B e a n F a c t o r y . j a v a : 306 ) a t o r g . s p r i n g f r a m e w o r k . b e a n s . f a c t o r y . s u p p o r t . D e f a u l t S i n g l e t o n B e a n R e g i s t r y . g e t S i n g l e t o n ( D e f a u l t S i n g l e t o n B e a n R e g i s t r y . j a v a : 230 ) a t o r g . s p r i n g f r a m e w o r k . b e a n s . f a c t o r y . s u p p o r t . A b s t r a c t B e a n F a c t o r y . d o G e t B e a n ( A b s t r a c t B e a n F a c t o r y . j a v a : 302 ) a t o r g . s p r i n g f r a m e w o r k . b e a n s . f a c t o r y . s u p p o r t . A b s t r a c t B e a n F a c t o r y . g e t B e a n ( A b s t r a c t B e a n F a c t o r y . j a v a : 197 ) a t o r g . s p r i n g f r a m e w o r k . b e a n s . f a c t o r y . s u p p o r t . D e f a u l t L i s t a b l e B e a n F a c t o r y . p r e I n s t a n t i a t e S i n g l e t o n s ( D e f a u l t L i s t a b l e B e a n F a c t o r y . j a v a : 772 ) a t o r g . s p r i n g f r a m e w o r k . c o n t e x t . s u p p o r t . A b s t r a c t A p p l i c a t i o n C o n t e x t . f i n i s h B e a n F a c t o r y I n i t i a l i z a t i o n ( A b s t r a c t A p p l i c a t i o n C o n t e x t . j a v a : 839 ) a t o r g . s p r i n g f r a m e w o r k . c o n t e x t . s u p p o r t . A b s t r a c t A p p l i c a t i o n C o n t e x t . r e f r e s h ( A b s t r a c t A p p l i c a t i o n C o n t e x t . j a v a : 538 ) a t o r g . s p r i n g f r a m e w o r k . w e b . c o n t e x t . C o n t e x t L o a d e r . c o n f i g u r e A n d R e f r e s h W e b A p p l i c a t i o n C o n t e x t ( C o n t e x t L o a d e r . j a v a : 446 ) a t o r g . s p r i n g f r a m e w o r k . w e b . c o n t e x t . C o n t e x t L o a d e r . i n i t W e b A p p l i c a t i o n C o n t e x t ( C o n t e x t L o a d e r . j a v a : 328 ) a t o r g . s p r i n g f r a m e w o r k . w e b . c o n t e x t . C o n t e x t L o a d e r L i s t e n e r . c o n t e x t I n i t i a l i z e d ( C o n t e x t L o a d e r L i s t e n e r . j a v a : 107 ) a t o r g . a p a c h e . c a t a l i n a . c o r e . S t a n d a r d C o n t e x t . l i s t e n e r S t a r t ( S t a n d a r d C o n t e x t . j a v a : 5118 ) a t o r g . a p a c h e . c a t a l i n a . c o r e . S t a n d a r d C o n t e x t . s t a r t I n t e r n a l ( S t a n d a r d C o n t e x t . j a v a : 5634 ) a t o r g . a p a c h e . c a t a l i n a . u t i l . L i f e c y c l e B a s e . s t a r t ( L i f e c y c l e B a s e . j a v a : 145 ) a t o r g . a p a c h e . c a t a l i n a . c o r e . C o n t a i n e r B a s e . a d d C h i l d I n t e r n a l ( C o n t a i n e r B a s e . j a v a : 899 ) a t o r g . a p a c h e . c a t a l i n a . c o r e . C o n t a i n e r B a s e . a d d C h i l d ( C o n t a i n e r B a s e . j a v a : 875 ) a t o r g . a p a c h e . c a t a l i n a . c o r e . S t a n d a r d H o s t . a d d C h i l d ( S t a n d a r d H o s t . j a v a : 652 ) a t o r g . a p a c h e . c a t a l i n a . s t a r t u p . H o s t C o n f i g . d e p l o y W A R ( H o s t C o n f i g . j a v a : 1092 ) a t o r g . a p a c h e . c a t a l i n a . s t a r t u p . H o s t C o n f i g 1.getObject(AbstractBeanFactory.java:306) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197) at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:772) at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:839) at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:538) at org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:446) at org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:328) at org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:107) at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:5118) at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5634) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:145) at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:899) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:875) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:652) at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1092) at org.apache.catalina.startup.HostConfig 1.getObject(AbstractBeanFactory.java:306)atorg.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)atorg.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)atorg.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)atorg.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:772)atorg.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:839)atorg.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:538)atorg.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:446)atorg.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:328)atorg.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:107)atorg.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:5118)atorg.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5634)atorg.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:145)atorg.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:899)atorg.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:875)atorg.apache.catalina.core.StandardHost.addChild(StandardHost.java:652)atorg.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1092)atorg.apache.catalina.startup.HostConfigDeployWar.run(HostConfig.java:1984)
at java.util.concurrent.Executors R u n n a b l e A d a p t e r . c a l l ( E x e c u t o r s . j a v a : 471 ) a t j a v a . u t i l . c o n c u r r e n t . F u t u r e T a s k . r u n ( F u t u r e T a s k . j a v a : 262 ) a t j a v a . u t i l . c o n c u r r e n t . T h r e a d P o o l E x e c u t o r . r u n W o r k e r ( T h r e a d P o o l E x e c u t o r . j a v a : 1145 ) a t j a v a . u t i l . c o n c u r r e n t . T h r e a d P o o l E x e c u t o r RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor RunnableAdapter.call(Executors.java:471)atjava.util.concurrent.FutureTask.run(FutureTask.java:262)atjava.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)atjava.util.concurrent.ThreadPoolExecutorWorker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)