一、这篇文章讲了什么? 这篇文章参考性很强,希望以后多分享一些文章啦。所以就把草稿箱的其中一篇很实用性的Linux小技巧分享给运维的基友们。后续该篇文章会一直更新新技巧哟。感谢童鞋们的关注哈。二、干货开始啦!1.查看端口监听[root@linuxidc ~]# netstat -n | awk "/^tcp/ {++S[$NF]} END {for(a in S) print a,S[a]}"CLOSE_WAIT 4ESTABLISHED 343 2.查看端口监听状态统计[root@Master ~]# netstat -aultn | awk "/^tcp/ {++S[$NF]} END {for(a in S) print a,S[a]}"TIME_WAIT 28253ESTABLISHED 15LISTEN 13 可以看出当前系统有28253的端口在使用,3.优化以上内核参数方式:编辑/etc/sysctl.confnet.ipv4.tcp_syncookies = 1net.ipv4.tcp_tw_reuse = 1net.ipv4.tcp_tw_recycle = 1net.ipv4.tcp_fin_timeout = 30 修改完成后,sysctl -p 立即生效4.修改流量大的web 服务器上,优化内核参数net.ipv4.tcp_keepalive_time = 1200net.ipv4.ip_local_port_range = 10000 65000net.ipv4.tcp_max_syn_backlog = 8192net.ipv4.tcp_max_tw_buckets = 5000#这几个参数,建议只在流量非常大的服务器上开启,会有显著的效果。一般的流量小的服务器上,没有必要去设置这几个参数。 5.查看linux 系统默认网关ip route show | grep "default" | awk "{print $3}" 6.过滤文件中的注释以及空格开头egrep -v "^$|^#" /etc/rsyslog.conf 7.如何清空/删除 last记录#清空最后登录echo >/var/log/wtmp#清空历史纪录echo > ./.bash_history#在空格后输入命令,不记录到历史命令中,先输入到环境变量中export HISTCONTROL=ignorespace 8.mysql密码忘记了,咋办?vi /etc/my.cnf 添加下面一句话[mysqld]skip-grant-tables重启mysqld。之后登陆mysql系统,修改root 的密码USE mysql;UPDATE user SET Password = password ( "new-password" ) WHERE User = "root" ;flush privileges以上就可以了。 9.利用tcpdump 监控某个接口上的端口,如80 端口,-i 后跟网络接口,CentOS6上是eth0。-c 是抓的包数目[root@web ~]# tcpdump -i eno16777984 "port 80" -c 8tcpdump: verbose output suppressed, use -v or -vv for full protocol decodelistening on eno16777984, link-type EN10MB (Ethernet), capture size 65535 bytes23:41:42.142270 IP 192.168.30.65.27342 > web.ichunqiu.com.http: Flags [S], seq 779859144, win 8192, options [mss 1460,nop,wscale 8,nop,nop,sackOK], length 023:41:42.142360 IP web.ichunqiu.com.http > 192.168.30.65.27342: Flags [S.], seq 1569747590, ack 779859145, win 29200, options [mss 1460,nop,nop,sackOK,nop,wscale 7], length 023:41:42.142677 IP 192.168.30.65.27342 > web.ichunqiu.com.http: Flags [.], ack 1, win 256, length 023:41:42.142722 IP 192.168.30.65.27343 > web.ichunqiu.com.http: Flags [S], seq 2277286734, win 8192, options [mss 1460,nop,wscale 8,nop,nop,sackOK], length 023:41:42.142759 IP web.ichunqiu.com.http > 192.168.30.65.27343: Flags [S.], seq 3574925053, ack 2277286735, win 29200, options [mss 1460,nop,nop,sackOK,nop,wscale 7], length 023:41:42.143280 IP 192.168.30.65.27344 > web.ichunqiu.com.http: Flags [S], seq 2564439030, win 8192, options [mss 1460,nop,wscale 8,nop,nop,sackOK], length 023:41:42.143317 IP web.ichunqiu.com.http > 192.168.30.65.27344: Flags [S.], seq 4279749150, ack 2564439031, win 29200, options [mss 1460,nop,nop,sackOK,nop,wscale 7], length 023:41:42.143346 IP 192.168.30.65.27343 > web.ichunqiu.com.http: Flags [.], ack 1, win 256, length 08 packets captured23 packets received by filter0 packets dropped by kernel10.统计web服务器站点的日志,如apache 的access.log日志
[root@elk ~]# awk "{print $1}" /var/log/nginx/access.log | sort | uniq -c | sort -nr | head -n 25 5568 124.126.211.201 5247 123.125.2.108 4085 139.59.253.208
- 利用系统自带geoiplookup查看访问者的ip归属地(注:需要在本机先安装GeoIP软件)如下:
安装geoip软件[root@elk nginx]# yum install GeoIP -y查询ip归属地[root@elk nginx]# cat access.log-20160903 | awk "{ print $1 }" | sort | uniq -c | sort -rn | head -n 25 |
awk "{ printf("%5d %-15s ", $1, $2); system("geoiplookup " $2 " | cut -d \: -f2 ") }" 5568124.126.211.201 CN, China 5337123.125.2.108 CN, China 4085139.59.253.208AU, Australia 1543223.223.181.131 CN, China 8093.174.93.99NL, Netherlands 42121.43.61.205 CN, China 2636.110.44.114 CN, China 26183.6.143.154 CN, China 25116.226.39.94 CN, China 24111.207.81.199CN, China 24106.81.231.217CN, China 1836.44.56.82 CN, China 18112.80.61.114 CN, China 11220.181.132.219 CN, China561.141.94.68CN, China5171.8.167.69CN, China4101.226.33.240CN, China3180.153.212.13CN, China3180.153.206.20CN, China3171.8.167.68CN, China3101.226.89.119CN, China3101.226.33.226CN, China3101.226.102.97CN, China227.221.19.18CN, China
- 查看访问者404 错误页面的请求次数以及请求页面,并按降序排列
[root@elk nginx]# cat /var/log/nginx/access.log | awk "($9 ~ /404/)" | awk "{ print $7 }" | sort | uniq -c | sort -rn | head -n 25
[root@elk nginx]# cat /var/log/nginx/access.log | awk -F" "{ print $6 }" | sort | uniq -c |sort -frn | head -n 25
[root@elk nginx]# cat /var/log/nginx/access.log | awk "{ print $1 }" | sort | uniq -c | wc -l122
[root@elk nginx]# cat /var/log/nginx/access.log | grep `date "+%d/%b/%G"` | awk "{ print $1 }" | sort | uniq -c | wc -l10
[root@elk nginx]# cat access.log | grep `date "+%b/%G"` | awk "{ print $1 }" | sort | uniq -c | wc -l111
[root@elk nginx]# cat /var/log/nginx/access.log | awk "{ print $9 }" | sort | uniq -c | sort -rn 8973 200 7304 401720 304 79 404 49 400 10 502 10 "-"7 2014 4994 4094 1731 405
[root@elk nginx]# cat /var/log/nginx/access.log | awk "{ print $7 }" | sort | uniq -c | sort -rn | head -n 25 4015 /elasticsearch/packetbeat-*/_field_stats?level=indices 3581 /favicon.ico 2117 /bundles/src/ui/public/images/elk.ico799 /340 /elasticsearch/logstash-*/_field_stats?level=indices225 /elasticsearch/.kibana/_refresh171 /app/kibana167 /elasticsearch/_msearch?timeout=0&ignore_unavailable=true&preference=1472786252222153 /elasticsearch/_msearch?timeout=0&ignore_unavailable=true&preference=1472784429830144 /elasticsearch/_mget?timeout=0&ignore_unavailable=true&preference=1472746017033139 /elasticsearch/.kibana/index-pattern/_search?fields=132 /bundles/src/ui/public/images/kibana.svg130 /bundles/kibana.bundle.js?v=10000129 /bundles/node_modules/font-awesome/fonts/fontawesome-webfont.woff2128 /bundles/commons.style.css?v=10000128 /bundles/commons.bundle.js?v=10000121 /bundles/kibana.style.css?v=10000107 /elasticsearch/topbeat-*/_field_stats?level=indices 97 /elasticsearch/_mget?timeout=0&ignore_unavailable=true&preference=1472744909049 97 /elasticsearch/.kibana/visualization/_search?size=100 75 /elasticsearch/_mget?timeout=0&ignore_unavailable=true&preference=1472749929499 72 /elasticsearch/_mget?timeout=0&ignore_unavailable=true&preference=1472750405461 66 /elasticsearch/_mget?timeout=0&ignore_unavailable=true&preference=1472750160122 66 /elasticsearch/.kibana/dashboard/_search?size=100 62 /elasticsearch/_mget?timeout=0&ignore_unavailable=true&preference=1472743171471
- 实时的查看请求者ip、http方法、响应码、请求的页面
[root@elk nginx]# tailf /var/log/nginx/access.log | awk "{ printf("%-15s %s %s %s
", $1, $6, $9,$7) }"60.191.52.254"HEAD401http://115.236.176.134:3434/141.212.122.160"GET401/101.200.215.149"GET401/manager/html114.44.57.4"CONNECT400126mx01.mxmail.netease.com:25187.160.7.218"GET401/cgi/common.cgi187.160.7.218"GET401/stssys.htm187.160.7.218"GET401/187.160.7.218"POST401/command.php218.75.70.3"GET401/163.172.173.181"GET401http://www.baidu.com/cache/global/img/gs.gif123.125.2.108"GET200/123.125.2.108"GET200/app/kibana123.125.2.108"GET304/bundles/commons.style.css?v=10000
- 跟上面的类似,只是在第四个字段加了个GeoIP解析归属地,如下:
[root@elk nginx]# tailf /var/log/nginx/access.log | awk "{"geoiplookup " $1 " | cut -d \: -f2 " | getline geoprintf("%-15s %s %s %-20s %s
", $1, $6, $9, geo, $7);}"123.125.2.108"GET304 CN, China/bundles/src/ui/public/images/kibana.svg123.125.2.108"POST200 CN, China/elasticsearch/_mget?timeout=0&ignore_unavailable=true&preference=1472922034187123.125.2.108"POST200 CN, China/elasticsearch/.kibana/index-pattern/_search?fields=123.125.2.108"GET200 CN, China/elasticsearch/.kibana/_mapping/*/field/_source?_=1472922034556123.125.2.108"POST200 CN, China/elasticsearch/_mget?timeout=0&ignore_unavailable=true&preference=1472922034187123.125.2.108"GET304 CN, China/bundles/node_modules/font-awesome/fonts/fontawesome-webfont.woff2
[root@elk nginx]# awk -F" "($6 ~ /^-?$/)" /var/log/nginx/access.log | awk "{ print $1 }" | sort | uniq114.44.57.4183.129.160.229218.75.70.361.231.3.9811.linux中利用python开启临时的web下载服务,访问端口是88,http://ip:88/,端口可以自定义其它的,避免与系统其它的冲突[root@web ~]# python -m SimpleHTTPServer 88Serving HTTP on 0.0.0.0 port 88 ... 12.vim 复制多行内容:1,10 co 10意思是复制第1行到10行之间的内容到第10行后面。:1,-1 co 10意思是复制第1行到文件最后一行之间的内容到第10行后面。 13.快速删除文件内每行中的的空格
删除行首的空格[root@hcloud webtest]# sed -i "s/^[ ]*//g" filename 删除行尾的空格[root@hcloud webtest]# sed -i "s/[ ]*$//g" filename14.windows 编写的脚本到linux 上运行,编码错误解决方法::set ff=unix:wq 15.yum 安装软件时,出现以下提示:Resolving DependenciesThere are unfinished transactions remaining. You might consider running yum-complete-transaction first to finish them. 解决方法:[root@test ]# yum-complete-transaction 16.用grep 过滤文件中的空行已经#注释,并将显示出来的内容标上行号grep -Ev"^$|^#" hosts >test.txt && cat -n test.txt && rm -f test.txt 17.假如server的某个进程的日志由于访问量或者其它错误bug导致日志大小暴增,且该日志分区空间即将不足,需要在线清空该日志(清理前先备份) 解决方法,有以下几种: 1)cat /dev/null > logfile 2)dd if=/dev/null of=logfile 3)rm logfile 18.利用linux 自带工具实时检测网卡流量 1)ifconfig[root@zabbix-6 ~]# watch -d ifconfig eth0 2)/proc/net/dev[root@zabbix-6 ~]# watch -d cat /proc/net/dev 19.模拟cpu升高(可后台运行n次,每个进程的使用率*n 就是总的cpu利用率) 1)dd if=/dev/zero of=/dev/null 2)fulload() { dd if=/dev/zero of=/dev/null | dd if=/dev/zero of=/dev/null | dd if=/dev/zero of=/dev/null | dd if=/dev/zero of=/dev/null & }; fulload; read; killall dd 3)yes > /dev/null & 4) 哈哈,这个慎用。。。。。!!!!:(){ :|:& };: 20. 查看浏览器内部的缓存,谷歌为例,浏览器内输入以下内容:chrome://net-internals/#dns更新历史:2016/09/04: 更新web 服务器的访问日志分析
本文永久更新链接地址