做网站seo的人都知道蜘蛛爬虫这个词,每个搜索引擎都有自己的蜘蛛,蜘蛛的作用就是爬取各个网站的网页从而收录到自己的数据库中供用户搜索,蜘蛛在爬取网站的时候网站服务器的压力也会增大,如果细心的站长就会从网站日记分析各个搜索引擎蜘蛛爬虫的记录,有时候会发现有很多ip都在爬取网页,有的可能就是假蜘蛛,只要知道官方蜘蛛的IP就可以屏蔽这些假蜘蛛了。
360搜索引擎蜘蛛IP
42.236.99.2 42.236.99.3 42.236.99.4 42.236.99.5 42.236.99.6 42.236.99.7 42.236.99.8 42.236.99.9 42.236.99.10 42.236.99.11 42.236.99.12 42.236.99.13 42.236.99.14 42.236.99.15 42.236.99.16 42.236.99.17 42.236.99.18 42.236.99.19 42.236.99.20 42.236.99.21 42.236.99.22 42.236.99.23 42.236.99.24 42.236.99.25 42.236.99.26 42.236.99.27 42.236.99.28 42.236.99.29 42.236.99.30 42.236.99.31 42.236.99.32 42.236.99.33 42.236.99.34 42.236.99.35 42.236.99.36 42.236.99.37 42.236.99.38 42.236.99.39 42.236.99.40 42.236.99.41 42.236.99.42 42.236.99.43 42.236.99.44 42.236.99.45 42.236.99.46 42.236.99.47 42.236.99.48 42.236.99.49 42.236.99.50 42.236.99.51 42.236.99.52 42.236.99.53 42.236.99.54 42.236.99.55 42.236.99.56 42.236.99.57 42.236.99.58 42.236.99.59 42.236.99.60 42.236.99.61 42.236.99.62 42.236.99.63 42.236.99.64 42.236.99.65 42.236.99.66 42.236.99.67 42.236.99.68 42.236.99.69 42.236.99.70 42.236.99.71 42.236.99.72 42.236.99.73 42.236.99.74 42.236.99.75 42.236.99.76 42.236.99.77 42.236.99.78 42.236.99.79 42.236.99.80 42.236.99.81 42.236.99.82 42.236.99.83 42.236.99.84 42.236.99.85 42.236.99.86 42.236.99.87 42.236.99.88 42.236.99.89 42.236.99.90 42.236.99.91 42.236.99.92 42.236.99.93 42.236.99.94 42.236.99.95 42.236.99.96 42.236.99.97 42.236.99.98 42.236.99.99 42.236.99.100 42.236.99.101 42.236.99.102 42.236.99.103 42.236.99.104 42.236.99.105 42.236.99.106 42.236.99.107 42.236.99.108 42.236.99.109 42.236.99.110 42.236.99.111 42.236.99.112 42.236.99.113 42.236.99.114 42.236.99.115 42.236.99.116 42.236.99.117 42.236.99.118 42.236.99.119 42.236.99.120 42.236.99.121 42.236.99.122 42.236.99.123 42.236.99.124 42.236.99.125 42.236.99.126 42.236.12.130 42.236.12.131 42.236.12.132 42.236.12.133 42.236.12.134 42.236.12.135 42.236.12.136 42.236.12.137 42.236.12.138 42.236.12.139 42.236.12.140 42.236.12.141 42.236.12.142 42.236.12.143 42.236.12.144 42.236.12.145 42.236.12.146 42.236.12.147 42.236.12.148 42.236.12.149 42.236.12.150 42.236.12.151 42.236.12.152 42.236.12.153 42.236.12.154 42.236.12.155 42.236.12.156 42.236.12.157 42.236.12.158 42.236.12.159 42.236.12.160 42.236.12.161 42.236.12.162 42.236.12.163 42.236.12.164 42.236.12.165 42.236.12.166 42.236.12.167 42.236.12.168 42.236.12.169 42.236.12.170 42.236.12.171 42.236.12.172 42.236.12.173 42.236.12.174 42.236.12.175 42.236.12.176 42.236.12.177 42.236.12.178 42.236.12.179 42.236.12.180 42.236.12.181 42.236.12.182 42.236.12.183 42.236.12.184 42.236.12.185 42.236.12.186 42.236.12.187 42.236.12.188 42.236.12.189 42.236.12.190 42.236.46.66 42.236.46.67 42.236.46.68 42.236.46.69 42.236.46.70 42.236.46.71 42.236.46.72 42.236.46.73 42.236.46.74 42.236.46.75 42.236.46.76 42.236.46.77 42.236.46.78 42.236.46.79 42.236.46.80 42.236.46.81 42.236.46.82 42.236.46.83 42.236.46.84 42.236.46.85 42.236.46.86 42.236.46.87 42.236.46.88 42.236.46.89 42.236.46.90 42.236.46.91 42.236.46.92 42.236.46.93 42.236.46.94 42.236.46.95 42.236.46.96 42.236.46.97 42.236.46.98 42.236.46.99 42.236.46.100 42.236.46.101 42.236.46.102 42.236.46.103 42.236.46.104 42.236.46.105 42.236.46.106 42.236.46.107 42.236.46.108 42.236.46.109 42.236.46.110 42.236.46.111 42.236.46.112 42.236.46.113 42.236.46.114 42.236.46.115 42.236.46.116 42.236.46.117 42.236.46.118 42.236.46.119 42.236.46.120 42.236.46.121 42.236.46.122 42.236.46.123 42.236.46.124 42.236.54.2 42.236.54.3 42.236.54.4 42.236.54.5 42.236.54.6 42.236.54.7 42.236.54.8 42.236.54.9 42.236.54.10 42.236.54.11 42.236.54.12 42.236.54.13 42.236.54.14 42.236.54.15 42.236.54.16 42.236.54.17 42.236.54.18 42.236.54.19 42.236.54.20 42.236.54.21 42.236.54.22 42.236.54.23 42.236.54.24 42.236.54.25 42.236.54.26 42.236.54.27 42.236.54.28 42.236.54.29 42.236.54.30 42.236.54.31 42.236.54.32 42.236.54.33 42.236.54.34 42.236.54.35 42.236.54.36 42.236.54.37 42.236.54.38 42.236.54.39 42.236.54.40 42.236.54.41 42.236.54.42 42.236.54.43 42.236.54.44 42.236.54.45 42.236.54.46 42.236.54.47 42.236.54.48 42.236.54.49 42.236.54.50 42.236.54.51 42.236.54.52 42.236.54.53 42.236.54.54 42.236.54.55 42.236.54.56 42.236.54.57 42.236.54.58 42.236.54.59 42.236.54.60 42.236.54.61 42.236.54.62 42.236.55.2 42.236.55.3 42.236.55.4 42.236.55.5 42.236.55.6 42.236.55.7 42.236.55.8 42.236.55.9 42.236.55.10 42.236.55.11 42.236.55.12 42.236.55.13 42.236.55.14 42.236.55.15 42.236.55.16 42.236.55.17 42.236.55.18 42.236.55.19 42.236.55.20 42.236.55.21 42.236.55.22 42.236.55.23 42.236.55.24 42.236.55.25 42.236.55.26 42.236.55.27 42.236.55.28 42.236.55.29 42.236.55.30 42.236.55.31 42.236.55.32 42.236.55.33 42.236.55.34 42.236.55.35 42.236.55.36 42.236.55.37 42.236.55.38 42.236.55.39 42.236.55.40 42.236.55.41 42.236.55.42 42.236.55.43 42.236.55.44 42.236.55.45 42.236.55.46 42.236.55.47 42.236.55.48 42.236.55.49 42.236.55.50 42.236.55.51 42.236.55.52 42.236.55.53 42.236.55.54 42.236.55.55 42.236.55.56 42.236.55.57 42.236.55.58 42.236.55.59 42.236.55.60 42.236.101.194 42.236.101.195 42.236.101.196 42.236.101.197 42.236.101.198 42.236.101.199 42.236.101.200 42.236.101.201 42.236.101.202 42.236.101.203 42.236.101.204 42.236.101.205 42.236.101.206 42.236.101.207 42.236.101.208 42.236.101.209 42.236.101.210 42.236.101.211 42.236.101.212 42.236.101.213 42.236.101.214 42.236.101.215 42.236.101.216 42.236.101.217 42.236.101.218 42.236.101.219 42.236.101.220 42.236.101.221 42.236.101.222 42.236.101.223 42.236.101.224 42.236.101.225 42.236.101.226 42.236.101.227 42.236.101.228 42.236.101.229 42.236.101.230 42.236.101.231 42.236.101.232 42.236.101.233 42.236.101.234 42.236.101.235 42.236.101.236 42.236.101.237 42.236.101.238 42.236.101.239 42.236.101.240 42.236.101.241 42.236.101.242 42.236.101.243 42.236.101.244 42.236.101.245 42.236.101.246 42.236.101.247 42.236.101.248 42.236.101.249 42.236.101.250 42.236.101.251 42.236.101.252 42.236.102.2 42.236.102.3 42.236.102.4 42.236.102.5 42.236.102.6 42.236.102.7 42.236.102.8 42.236.102.9 42.236.102.10 42.236.102.11 42.236.102.12 42.236.102.13 42.236.102.14 42.236.102.15 42.236.102.16 42.236.102.17 42.236.102.18 42.236.102.19 42.236.102.20 42.236.102.21 42.236.102.22 42.236.102.23 42.236.102.24 42.236.102.25 42.236.102.26 42.236.102.27 42.236.102.28 42.236.102.29 42.236.102.30 42.236.102.31 42.236.102.32 42.236.102.33 42.236.102.34 42.236.102.35 42.236.102.36 42.236.102.37 42.236.102.38 42.236.102.39 42.236.102.40 42.236.102.41 42.236.102.42 42.236.103.66 42.236.103.67 42.236.103.68 42.236.103.69 42.236.103.70 42.236.103.71 42.236.103.72 42.236.103.73 42.236.103.74 42.236.103.75 42.236.103.76 42.236.103.77 42.236.103.78 42.236.103.79 42.236.103.80 42.236.103.81 42.236.103.82 42.236.103.83 42.236.103.84 42.236.103.85 42.236.103.86 42.236.103.87 42.236.103.88 42.236.103.89 42.236.103.90 42.236.103.91 42.236.103.92 42.236.103.93 42.236.103.94 42.236.103.95 42.236.103.96 42.236.103.97 42.236.103.98 42.236.103.99 42.236.103.100 42.236.103.101 42.236.103.102 42.236.103.103 42.236.103.104 42.236.103.105 42.236.103.106 42.236.103.107 42.236.103.108 42.236.103.109 42.236.103.110 42.236.103.111 42.236.103.112 42.236.103.113 42.236.103.114 42.236.103.115 42.236.103.116 42.236.103.117 42.236.103.118 42.236.103.119 42.236.103.120 42.236.103.121 42.236.103.122 42.236.103.123 42.236.103.124 42.236.103.125 42.236.99.130 42.236.99.131 42.236.99.132 42.236.99.133 42.236.99.134 42.236.99.135 42.236.99.136 42.236.99.137 42.236.99.138 42.236.99.139 42.236.99.140 42.236.99.141 42.236.99.142 42.236.99.143 42.236.99.144 42.236.99.145 42.236.99.146 42.236.99.147 42.236.99.148 42.236.99.149 42.236.99.150 42.236.99.151 42.236.99.152 42.236.99.153 42.236.99.154 42.236.99.155 42.236.99.156 42.236.99.157 42.236.99.158 42.236.99.159 42.236.99.160 42.236.99.161 42.236.99.162 42.236.99.163 42.236.99.164 42.236.99.165 42.236.99.166 42.236.99.167 42.236.99.168 42.236.99.169 42.236.99.170 42.236.99.171 42.236.99.172 42.236.99.173 42.236.99.174 42.236.99.175 42.236.99.176 42.236.99.177 42.236.99.178 42.236.99.179 42.236.99.180 42.236.99.181 42.236.99.182 42.236.99.183 42.236.99.184 42.236.99.185 42.236.99.186 42.236.99.187 42.236.99.188 42.236.99.189 42.236.99.190 42.236.99.194 42.236.99.195 42.236.99.196 42.236.99.197 42.236.99.198 42.236.99.199 42.236.99.200 42.236.99.201 42.236.99.202 42.236.99.203 42.236.99.204 42.236.99.205 42.236.99.206 42.236.99.207 42.236.99.208 42.236.99.209 42.236.99.210 42.236.99.211 42.236.99.212 42.236.99.213 42.236.99.214 42.236.99.215 42.236.99.216 42.236.99.217 42.236.99.218 42.236.99.219 42.236.99.220 42.236.99.221 42.236.99.222 42.236.99.223 42.236.99.224 42.236.99.225 42.236.99.226 42.236.99.227 42.236.99.228 42.236.99.229 42.236.99.230 42.236.99.231 42.236.99.232 42.236.99.233 42.236.99.234 42.236.99.235 42.236.99.236 42.236.99.237 42.236.99.238 42.236.99.239 42.236.99.240 42.236.99.241 42.236.99.242 42.236.99.243 42.236.99.244 42.236.99.245 42.236.99.246 42.236.99.247 42.236.99.248 42.236.99.249 42.236.99.250 42.236.99.251 42.236.99.252 42.236.99.253 42.236.99.254 180.153.236.11 180.153.236.12 180.153.236.13 180.153.236.14 180.153.236.15 180.153.236.16 180.153.236.17 180.153.236.18 180.153.236.19 180.153.236.20 180.153.236.21 180.153.236.22 180.153.236.23 180.153.236.24 180.153.236.25 180.153.236.26 80.153.236.35 80.153.236.36 80.153.236.37 80.153.236.38 80.153.236.39 80.153.236.40 80.153.236.41 80.153.236.42 180.153.236.43 180.153.236.44 180.153.236.45 180.153.236.46 180.153.236.47 180.153.236.48 180.153.236.49 180.153.236.50 180.153.236.51 180.153.236.52 180.153.236.53 180.153.236.54 180.153.236.55 180.153.236.56 180.153.236.57 180.153.236.58 180.153.236.59 180.153.236.60 180.153.236.61 180.153.236.62 180.153.236.63 180.153.236.64 180.153.236.65 180.153.236.66 180.153.236.67 180.153.236.68 180.153.236.69 180.153.236.70 180.153.236.71 180.153.236.72 180.153.236.73 180.153.236.74 180.153.236.101 180.153.236.102 180.153.236.103 180.153.236.104 180.153.236.105 180.153.236.106 180.153.236.107 180.153.236.108 180.153.236.109 180.153.236.110 180.153.236.111 180.153.236.112 180.153.236.113 180.153.236.114 180.153.236.115 180.153.236.116 180.153.236.117 180.153.236.118 180.153.236.119 180.153.236.120 180.153.236.121 180.153.236.122 180.153.236.123 180.153.236.124 180.153.236.125 180.153.236.126 180.153.236.127 180.153.236.128 180.153.236.129 180.153.236.130 180.153.236.131 180.153.236.132 180.153.236.133 180.153.236.134 180.153.236.135 180.153.236.136 180.153.236.137 180.153.236.138 180.153.236.139 180.153.236.140 180.153.236.149 180.153.236.150 180.153.236.151 180.153.236.152 180.153.236.153 180.153.236.154 180.153.236.155 180.153.236.156 180.153.236.157 180.153.236.158 180.153.236.159 180.153.236.160 180.153.236.161 180.153.236.162 180.153.236.163 180.153.236.164 180.153.236.165 180.153.236.166 180.153.236.167 180.153.236.168 180.153.236.169 180.153.236.170 180.153.236.171 180.153.236.172 180.153.236.173 180.153.236.174 180.153.236.175 180.153.236.176 180.153.236.177 180.153.236.178 180.153.236.179 180.153.236.180 180.153.236.181 180.153.236.182 180.153.236.183 180.153.236.184 180.153.236.185 180.153.236.186 180.153.236.187 180.153.236.188 180.153.236.189 180.153.236.190 180.153.236.191 180.153.236.192 180.153.236.193 180.153.236.194 180.153.236.195 180.153.236.196 180.153.232.170 180.153.232.171 180.153.232.172 180.153.232.173 180.153.232.174 180.153.232.175 180.153.232.176 180.153.232.177 180.153.234.145 180.153.234.146 180.153.234.147 180.153.234.148 180.153.234.149 180.153.234.150 180.153.234.151 180.153.234.152
下面是百度搜索引擎的蜘蛛段:
下面这些ip段是百度蜘蛛IP的造访,准备来抓取你网站的网页蜘蛛。
60.172.229.61
61.129.45.72
61.135.162.*
下面这些ip段是百度竞价蜘蛛。
61.135.165.134
117.34.74.66
118.122.188.194
119.63.196.9
125.39.78.185
下面这个ip段是百度联盟蜘蛛爬虫,其实就是百度统计的蜘蛛。
61.135.186.*
下面这几个ip段是站长工具上的模仿百度蜘蛛。
61.147.98.146
61.188.39.16
113.98.254.245
117.21.220.245
117.28.255.42
下面这个ip是搜外站长工具的模仿百度蜘蛛。
124.248.34.52
下面这个ip和ip段是114站长工具箱的蜘蛛,在你网站不是很稳定的情况下会经常过来的。
119.147.114.213
121.10.141.*
这个ip段是百度图片蜘蛛的。
123.15.**.**
这个ip段是抓取网站内页收录的,但是由于文章权重比较低,被爬过的内页文章暂时不会放出来,需要考察一段时间,因为不是原创的文章。(百度图片爬虫)
123.125.71.*
下面这个ip段是属于百度蜘蛛IP,是你经常用一些站长工具检测后造成的,基本是没有多大用的。
125.90.88.*
下面这些ip段为百度考察期蜘蛛,也有可能是降权蜘蛛,因为有人说过他网站被K的时候网站全是这个蜘蛛,或者是百度人工。
159.226.50.*
180.76.5.*
180.76.5.87
220.181.158.107
这个是伪装百度蜘蛛的一个IP段。
180.149.130.*
这个ip段出现在新站及站点有不正常现象后的时候。
183.91.40.144
203.208.60.*
这个ip段不间断巡逻各站,就是路过一下,是来打酱油的,不用担心啥。
210.72.225.*
如果发现下面这几个ip段每天只增不减的话,那就很危险了,很有可能会进入沙盒或者有被K站的现象。
123.125.68.*
218.30.118.102
220.181.68.*
这个ip段主要是抓取首页占80%,内页占30%,此ip爬过的文章或首页,绝对24小时内放出来和隔夜快照的!一般成功抓取返回代码都是 200 0 0返回304 0 0代表网站没更新,蜘蛛来过,如果是 200 0 64别担心这不是K站,可能是网站是动态的,所以返回就是这个代码。
220.181.108.*
下面的ip段代表百度蜘蛛IP来过了,准备抓取你网站上的东西!
123.125.66.*
220.181.7.*
这个ip段是百度蜘蛛作为度过新站考察期的一个ip段。
121.14.89.*
这个是百度抓取首页的专用IP如是220.181.108段的ip来的话基本来说网站会天天隔夜快照,一般是不会出错的!偷偷的笑吧!
220.181.108.95
下面这个ip是98%抓取首页可能还会抓取其他(不是指内页)属于百度的权重IP段,此ip段爬过的文章或首页正常情况下基本在24小时都会放出来,偷偷的笑吧!
220.181.108.92
下面这个ip属于综合的,主要是用来抓取首页和内页或者其它页面的,也是属于一个权重IP,基本被抓过的文章或首页24小时就会放出来。
220.181.108.91
下面这个ip是重点抓取更新文章的,内页达到90%,首页抓取达到8%,2%其他权重ip段,基本被抓过的文章或首页24小时就会放出来。
220.181.108.75
下面这些ip是抓取内页收录的,权重相对比较低,爬过此段的内页文章不会很快被放出来,因它怀疑不是原创文章或者怀疑是采集来的文章。
123.125.71.95
123.125.71.97
123.181.108.77
123.125.71.106
下面这些ip是专用抓取网站首页的,也属于权重段,一般返回代码304 0 0就代表网站未更新。
220.181.108.89
220.181.108.94
220.181.108.97
220.181.108.80
220.181.108.77
220.181.108.83
220.181.108.86