账号密码登录
微信安全登录
微信扫描二维码登录

登录后绑定QQ、微信即可实现信息互通

手机验证码登录
找回密码返回
邮箱找回 手机找回
注册账号返回
其他登录方式
分享
  • 收藏
    X
    使用Awk分析Nginx日志大于某个时间内非200状态的数据
    • 2019-05-10 00:00
    • 10
    50
    0

    使用PHP写了一个同步ES和Redis的服务脚本,每分钟不定时会收到很多http请求,有点担心会失败,打算做一个补跑的脚本,目前是想通过awk分析nginx日志 检索大于某个时间非200状态的数据进行从新发送,但是Awk不怎么会用,只是完成了一部分。。

    想要的结果:
    通过定时任务15分钟运行一次,然后查询大十五分钟前非200状态的数据,但是现在是用grep指定时间做不到这种效果(现在自己写的可以做到指定分钟内,感觉1分钟运行一次,数据太大会死循环),研究了半天也没个结果,有没有大佬可否帮忙在个基础上改进一下

    Nginx 日志格式
    "06/May/2019:03:03:00 +0000" "GET / HTTP/1.1" "41" "-" "curl/7.29.0" "10.1.7.31" "-" "127.0.0.1:9000" "500" "500" "0.021" "0.021" "[20953311,21829304,22006993]"
    "06/May/2019:03:07:11 +0000" "POST / HTTP/1.1" "20" "-" "curl/7.29.0" "10.1.7.31" "-" "127.0.0.1:9000" "500" "500" "0.058" "0.058" "[20953311,21829304,22006993]"
    "06/May/2019:03:15:47 +0000" "POST / HTTP/1.1" "20" "-" "curl/7.29.0" "10.1.7.31" "-" "127.0.0.1:9000" "500" "500" "0.055" "0.055" "[20953311,21829304,22006993]"
    "06/May/2019:03:16:44 +0000" "POST / HTTP/1.1" "20" "-" "curl/7.29.0" "10.1.7.31" "-" "127.0.0.1:9000" "200" "200" "0.051" "0.051" "[20953311,21829304,22006993]"
    "06/May/2019:03:40:26 +0000" "POST / HTTP/1.1" "20" "-" "curl/7.29.0" "10.1.7.31" "-" "127.0.0.1:9000" "200" "200" "0.057" "0.057" "[22769461]"
    "06/May/2019:03:41:11 +0000" "POST / HTTP/1.1" "20" "-" "curl/7.29.0" "10.1.7.31" "-" "127.0.0.1:9000" "500" "500" "0.058" "0.058" "[20953311,21829304,22006993]"
    "06/May/2019:03:41:47 +0000" "POST / HTTP/1.1" "20" "-" "curl/7.29.0" "10.1.7.31" "-" "127.0.0.1:9000" "500" "500" "0.055" "0.055" "[20953311,21829304,22006993]"
    "06/May/2019:03:42:44 +0000" "POST / HTTP/1.1" "20" "-" "curl/7.29.0" "10.1.7.31" "-" "127.0.0.1:9000" "200" "200" "0.051" "0.051" "[20953311,21829304,22006993]"
    "06/May/2019:03:43:26 +0000" "POST / HTTP/1.1" "20" "-" "curl/7.29.0" "10.1.7.31" "-" "127.0.0.1:9000" "200" "200" "0.057" "0.057" "[22769461]"
    目前自己研究出来的AWK命令
    cat file.log |grep "06/May/2019:03:16" | awk -F "[\"\"]" '{if($18!=200){print $26}}'
    1
    打赏
    收藏
    点击回答
    您的回答被采纳后将获得:提问者悬赏的 10 元积分
        全部回答
    • 0
    • G.dragon° 普通会员 1楼
      502 Bad Gateway

      502 Bad Gateway


      nginx
    更多回答
    扫一扫访问手机版
    • 回到顶部
    • 回到顶部