???????????? ????? ??????????, ??? ??????? ??? ?????????? ?? ?? ????????? ??? ???? ?????????????? ?? ???? ??????????.Generate robots.txt file to authenticate and quit crawler from crawling just about anything besides your own home web site.By increasing an internet site's CTR, companies can increase their organic and natural website traffic and eve