Определение web crawler в Английский Язык Английский Язык словарь
{i} (Computers, Internet) program used to search through the Internet for documents that include a specific subject or word/phrase and downloads their contents in an automatic manner for indexing