다양한 robot 의 세계

검색엔진에서 방문하는 다양한 bot 을 정리해봤습니다.

A
Mozilla/5.0 (Linux; CentOS Linux release 7.3.1611) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.115 Safari/537.36 (compatible; AdsBot-Naver/1.0; +http://searchad.naver.com)
AhrefsBot/5.0
AhrefsBot/5.1
Mozilla/5.0 (compatible; AhrefsBot/5.2; +http://ahrefs.com/robot/)

B
Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
Baiduspider/2.0
BLEXBot/1.0

C


D
Mozilla/5.0 (compatible; Daum/4.1; +http://cs.daum.net/faq/15/4118.html?faqId=28966)
Digincore bot
DotBot/1.1
DuckDuckGo-Favicons-Bot/1.0

E
Exabot/3.0

F


G
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
Googlebot-Mobile/2.1

H


I
IDBot/1.1
linkdexbot/2.2

J


K
KisaBotD/2.0

L


M
meanpathbot/1.0
MJ12bot/v1.4.5
MJ12bot/v1.4.6
MJ12bot/v1.4.7
Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/)

N
Naverbot

O
oBot/2.3.1

P
Mozilla/5.0 (compatible; PageAnalyzer/1.5;)
Perviibot/1.0
PrivacyAwareBot/1.1

Q
 

R
RankvalBot/1.0

S
SemrushBot/0.98~bl
SemrushBot/0.99~bl
SemrushBot/1~bl
SemrushBot/1.1~bl
spbot/5.0
spbot/5.0.2
spbot/5.0.3
SMTBot/1.0

T


U
Uptimebot/0.1.73
Uptimebot/0.2.42
Uptimebot/0.2.43
Uptimebot/1.0

V


W
WBSearchBot/1.1
WebHistoryBot/1.2.1 IS NOT SE bot like Googlebot/2.1
WoTBoT

X
XoviBot/2.0

Y
YandexBot/3.0
Mozilla/5.0 (compatible; Yeti/1.1; +http://naver.me/bot)

Z
ZumBot/1.0