Operation and maintenance job learning process

Side by link: https://www.nowcoder.com/discuss/142474

Operation and maintenance jobs required knowledge more widely, operating systems, computer networks, linux, database, data structure, operation and maintenance of common tools, etc.

1. Operating System

2. Computer Network

3. linux

4. Database

5. Data structure

6. Design and Analysis of Algorithms

7. Common operation and maintenance tool

1. System Monitoring Tool

htop command == "installation:

1. The default mouse support image interface;
2. It can be horizontal or vertical scroll through the list of processes, in order to see all processes and complete command line;
3. You can kill the process directly through F9.

$yum -u install htop  (需要epel)

2. Multi-function information system statistical tools

dstat command == "Show support for plug $ dstat --list

# Common parameters

• -l: Displays load balancing amount equivalent to uptime statistics

• -m: display memory usage (used, buffer, cache, free)

• -r: display I / 0 count (read, write)

• -s: Display swap usage (used, free)

• -t: Displays the current time

• --fs: displays file system statistics data (files, inodes)

• --socket: display network statistics (tot, tcp, udp, raw, frg)

• --tcp: show common TCP statistics (lis, act, syn, tim, clo)

• --udp: UDP interface displays some dynamic data and current amounts of listening (lis, act)

Common plug-ins

• --disk-util: displaying each disk util

• --proc-count: displays the number of running programs

• --top-bio: Displays the maximum process block I / O

• --top-cpu: Displays the maximum CPU usage of the process

• --top-mem: displays take up memory processes

• --output: output to the specified csv file

3. Resource Monitor Command

glances command

Support server / client mode, remote monitoring. When monitoring port 61209

Monitored end: glances -s monitoring client: glances -c ip

4. Bulk Administration Tool Host

ansible

5. Network detection means

ethtoll command

# 查看网卡中 接收模块RX、发送模块TX和Autonegotiate模块的状态：启动on 或 停用off 部分网卡驱动不支持
ethtool -a|--show-pause devname
# 修改网卡中 接收模块RX、发送模块TX和Autonegotiate模块的状态。
ethtool -A|--pause devname [autoneg on|off] [rx on|off] [tx on|off]
# 显示网卡驱动信息，如驱动名称、版本等
ethtool -i|--driver devname
# 显示register dump信息
ethtool -d|--register-dump devname [raw on|off] [hex on|off] [file name]
# 显示EEPROM dump信息
ethtool -e|--eeprom-dump devname [raw on|off] [offset N] [length N]
# 修改网卡EEPROM byte。
ethtool -E|--change-eeprom devname [magic N] [offset N] [length N] [value N]
# 显示网卡Offload参数状态
ethtool -k|--show-features|--show-offload devname
# 修改网卡Offload参数状态
ethtool -K|--features|--offload devname feature on|off ...
# 用于区别不同ethX对应网卡的物理位置，常用的方法是使网卡port上的led不断的闪；N指示了网卡闪的持续时间，以秒为单位。
ethtool -p|--identify devname [N]
# 修改网卡的部分配置
ethtool -s devname [speed N] [duplex half|full] [port tp|aui|bnc|mii] [mdix auto|on|off] [autoneg on|off] [advertise N]
           [phyad N] [xcvr internal|external] [wol p|u|m|b|a|g|s|d...]  [sopass         xx:yy:zz:aa:bb:cc] [msglvl N | msglvl type
              on|off ...]
# 网卡执行自我检测，有两种模式： offline or online
 ethtool -t|--test devname [offline|online|external_lb]

Check the machine speed on the card  $ ethtool eth0

NIC stop sending module TX $ ethtool -A tx off eth0

View Card check what kind of drive $ ethtool -i eth0

Forced eth0 network card running in Fast mode $ ethtool -s eth0 speed 100

iptraf-ngcommand

parameter	effect
-i iface	Network interface: immediately turn on the specified network interface IP traffic monitoring, interface to all, refers to monitor all network interfaces
-g	Immediately begin production of the network interface summary status information
-d iface	Network interface: open network traffic monitoring detailed information on the specified network interface
-s iface	Network interface: on the specified network interface begins to monitor TCP and UDP network traffic information immediately
-z iface	Network interface: the network interface on the specified display package count
-l iface	Network interface: the network interface on the specified information immediately begins to monitor the LAN workstations
-t timeout	Iptraf-ng instruction specified time monitoring, timeout monitoring time index minute
-B	The standard output to '/ dev / null', close the standard input, the program runs as a background
-L logfile	Specify a log file records all the command line, the default file location is: / var / log / iptraf
-l interval	Log record specified time interval (unit: minute)
-u	Allows the use of the interface is not supported as an Ethernet device
-f	Clear all counters

6. Network testing tools

ss command

parameter	effect
-H	Does not display the header row
-n	Not resolve service name
-r	Resolve numeric address and port
-a	Show all sockets
-l	Show only listening sockets
-O	Display Timer information
-e	Information display socket
-t	Show only tcp
-u	Show only udp
-4	Show only IPv4 addresses
-6	Display only IPv6 addresses

7. File Open tool

lsof command

Detailed output content:

• COMMAND: name of the process

• PID: the process identifier

• TID: thread identifier

• USER: Process owners

• FD: file descriptor

  • cwd: represents the current work directory, the current working directory of the application, which is the application startup directory.

  • txt: File Type This is a program code, such as an application binary itself or shared library.

  • lnn：library reference（AIX）

  • er：FD information error（see NAME column）

  • vol: jail directory (FreeBSD)

  • ltx：shared library text（code and data）

  • mxx：hex memory-mapped type number xx

  • m86：DOS Merge mapped file

  • mem：memory-mapped file

  • mmap：memory-mapped device

  • pd：parent directory

  • rtd：root directory

  • v86：VP/ix mapped file

  • 0: standard output

  • 1: standard input

  • 2: standard error

• TYPE: file type, common file types are the following:

  • DIR: represents the directory

  • CHR: The character type

  • BLK: block device type

  • UNIX: Unix domain socket

  • FIFO: First In First Out (FIFO) queue

  • IPv4: Internet Protocol (IP) sockets

• DEVICE: Specifies the name of the disk

• SIZE / OFF: size of the file

• NODE: inode (file identifier on the disk)

• NAME: Open the exact name of the file

parameter	effect
-a	AND logic, the combined output options content
-c	Lists the name to specify the name of the beginning of the process of open files
-d	List open file descriptors specified process
+d	The file is opened under the listed directory
+D	Recursively list files from being opened directory
-n	Lists of files using NFS
-u	Lists the specified user to open the file
-p	The process is specified, lists open files
-i	List open socket

8. diagnostic tool

stracecommand

tcpdumpcommand

Operation and maintenance personnel must be familiar with the operation and maintenance tools summary

OS: Centos, ※, Ubuntu , Redhat ※ ,, SUSE, Freebsd

Web services: nginx ※ ,, the Apache ※ ,, lighttpd, PHP ※ ,, Tomcat ※ ※ ,, Resin,

Database: MySQL ※ ,, MariaDB, PostgreSQL, Mysql-Proxy

DB middleware: maxscale, MyCat, atlas, cobar, amoeba, MySQL-proxy

代理相关：lvs,keepalived,haproxy,nginx,heartbeat,apache,（此行都是※)

网站缓存：squid※,nginx※,varnish

NOSQL库:Redis※,Memcached※,MongoDB※,HBase,Cassandra※,CouchDB,Tyrant※

存储相关：Nfs※,FastDF※S,Moosefs(mfs※,Hadoop※,glusterfs※,lustre

版本管理：svn※,git※

监控报警：nagios※,cacti※,zabbix※,munin,hyperic,mrtg,graphite,云监控※

域名解析：bind※,powerdns,dnsmasq※

同步软件：rsync※,inotify※,sersync※,drbd※,csync2,union,lsyncd,scp※

批量管理：ssh+rsync+sersync※,Ansible※,Saltstack※,expect※,puppet※, cfengine

虚拟   化：kvm※,xen※

云计   算：openstack,※docker※,cloudstack,K8S※

内网软件：iptables※,zebra※,iftraf※,ntop※,tc※,iftop

邮件软件：qmail,posfix※,sendmail,zimbra

远程拨号：openvp※,pptp※,openswan※,ipip※

统一认证：openldap※

队列工具：ActiveMQ,RabbitMQ※,Metaq,MemcacheQ,Zeromq

打包发布：mvn※,ants,jenkins,※svn

测试软件：ab,JMeter,Webbench,LoadRunner,http_load,tcpcopy（都是※）

带宽测试：smokeping,iozone

性能测试：dd, fio(IOPS测试),iozone(磁盘测试)

日志相关：rsyslog,Awstats※,flume,storm,ELK(Elasticsearch+Logstash+Kibana)※

搜索软件：Sphinx※,Xapian,Solr※

DB代理：mysql-proxy,amoeba（更多还是程序实现读写分离

无人值守：kickstart,cobbler※

软件安装：rpm,yum※（设计rpm包定制及yum仓库构建）

搜索软件：Sphinx,Xapian（大公司自己开发类似百度的小规模内部搜索引擎）

大数据：HDFS,Hive,Hbase,Zookeeper,Pig,Spark, Mahout,flume,sqoop

开发语言：Shell※,Python※,go※

前端框架：Dojo、jQuery、YUI、ExtJS、MooTools 

Html5、webworker、websocket、webGL、nodejs

MVC框架

实现动态页面 JSP（struct、spring）/PHP/ASP

VPN、隧道

Linux、shell、grep、awk、sed、vi、ps、

提示：

(1）带※的为最近几年用的比较多，也是近年来linux运维的大众。

(2）学习要有舍有得，什么都抓必然短时间都不会精，抓精髓，大众软件（带※）先熟练了，这是基础加提高。