A "heartbeat" experience~

        I often see someone mistakenly delete the data in the production environment, and I often warn myself not to make the same mistake. However, life doesn't go on as you want it to, it always makes you nervous at some point. And I've had this little tension recently.
       Guangzhou, which has failed many times in winter, the temperature makes people very helpless. At noon, at the sweltering customer site, I was struggling to troubleshoot a problem. The test environment is OK, but the production environment always reports errors. So, I want to deploy the production environment package to the test environment to see if it is a problem with the environment or data.
       The server is linux and the middleware is weblogic. Log in to the production environment via SSH, COPY the production environment package to the local, then SSH in to the test environment and throw the package up. Log in to the console of the test environment and deploy the COPY package in the past. It is estimated that the test environment has not been restarted for a long time, the deployment process has been stuck, and the progress is very slow. Impatient, directly ps out all java processes, and then kill -9 to kill. When I was doing ps, I was still very puzzled. Usually, there are at most 2 java processes in the test environment. Why are there so many this time? No matter, kill them all. Then use the command to restart weblogic, but it prompts that it has been started. It's strange, isn't it all killed? Taking a closer look, the one that was killed just now was in the production environment, and the two SSH windows were mixed up. Suddenly, the heartbeat began to speed up, and the sweat kept coming out. Fortunately, the production environment is a two-machine cluster, and I just killed one of them. After calming down, I immediately used the command to start all the kills I just killed. After the IP login verification was all right, I breathed a sigh of relief!
       After thinking about it, I am still very scared. The client of this project has always been dissatisfied with us, often complained, and played with it by accident. This time it is also a small luck.
       Lenovo also once used his development machine to connect to the database of the production environment, which caused some data exceptions, and he spent another noon to repair it manually.
       After this time, after each SSH operation, I will close the window and connect again the next time I use it. Some operations such as update and delete are performed after several confirmations each time.
       Be careful to make the Wannian Ship! ! !