Форум Поисковые системы Яндекс

Помощь в фильтрации ботов через .htaccess

S
На сайте с 12.10.2012
Offline
206
sagamorr
1290

Многие в последнее время столкнулись с наплывом поведенческих ботов на своих сайтах.

На каких то сайтах доля спам-трафика с прямых заходов, уже перекрывает по количеству другие источники.

Есть рабочий вариант - установка CloudFlare. На форуме есть отдельная тема с вариантами настройки и обсуждением эффективности разных правил.

На одном из сайтов CF не подходит (клиент не хочет ставить), поэтому остается только блокировка через .htaccess.

Бото-траф с прямых заходов примерно 20% от всех других источников.

Через .htaccess хочу полностью заблокировать Битерику и спам, который идет через подмену utm меток и определяется в Метрике как - Другая реклама: определено по меткам.

Для блокировки спама через utm в соседних темах выкладывали правила:

RewriteCond %{QUERY_STRING} utm [NC]

RewriteRule .* - [F]

и

RewriteCond %{QUERY_STRING} \b(?:utm_|yandex-source)

RewriteRule ^.*$ - [F]

Но они не работают.

Так же на форуме кто то выкладывал диапазоны ip битерики, но не получилось найти.

Думаю данная тема актуальна и информация будет многим полезна.


X
На сайте с 04.12.2018
Offline
280
Xubart
#1
Order Deny,Allow
Deny from 192.144.31.0/24
Deny from 46.8.193.0/24
Deny from 2a0e:cd40::/32
Deny from 45.89.16.0/23
Deny from 45.145.116.0/23
Deny from 185.181.245.0/24
Deny from 45.15.237.0/24
Deny from 2a07:ca07::/32
Deny from 188.130.137.0/24
Deny from 188.130.211.0/24
Deny from 45.81.136.0/24
Deny from 188.130.128.0/24
Deny from 45.140.54.0/23
Deny from 109.248.138.0/23
Deny from 46.8.212.0/23
Deny from 45.84.177.0/24
Deny from 2a0e:cd45::/32
Deny from 77.83.148.0/24
Deny from 109.248.54.0/23
Deny from 2a0f:d002::/32
Deny from 95.182.126.0/23
Deny from 46.8.14.0/23
Deny from 2a0e:8141::/32
Deny from 188.130.187.0/24
Deny from 109.248.142.0/24
Deny from 46.8.111.0/24
Deny from 109.248.166.0/23
Deny from 84.54.53.0/24
Deny from 194.156.123.0/24
Deny from 2a0e:cd47::/32
Deny from 46.8.106.0/23
Deny from 46.8.222.0/23
Deny from 95.182.124.0/23
Deny from 45.87.253.0/24
Deny from 45.89.16.0/22
Deny from 109.248.54.0/24
Deny from 212.115.49.0/24
Deny from 2a06:d647:8000::/33
Deny from 109.248.142.0/23
Deny from 46.8.212.0/24
Deny from 185.181.247.0/24
Deny from 2a0e:cd44::/32
Deny from 2a0f:d000::/32
Deny from 46.8.157.0/24
Deny from 45.139.176.0/24
Deny from 194.34.248.0/24
Deny from 109.248.128.0/24
Deny from 45.135.32.0/23
Deny from 92.119.193.0/24
Deny from 109.248.205.0/24
Deny from 2a0e:cd43::/32
Deny from 2a0e:cd46::/32
Deny from 2a07:ca07::/33
Deny from 109.248.129.0/24
Deny from 2a0f:d000::/29
Deny from 46.8.56.0/23
Deny from 45.134.252.0/23
Deny from 45.15.73.0/24
Deny from 2a0e:cd42::/32
Deny from 45.81.136.0/23
Deny from 2a0e:cd41::/32
Deny from 194.156.96.0/23
Deny from 45.15.72.0/24
Deny from 193.58.169.0/24
Deny from 45.147.193.0/24
Deny from 45.87.252.0/24
Deny from 45.139.125.0/24
Deny from 46.8.156.0/24
Deny from 193.58.168.0/23
Deny from 2a0e:8147::/32
Deny from 2a0a:5684::/32
Deny from 45.145.118.0/23
Deny from 45.147.192.0/23
Deny from 109.248.14.0/24
Deny from 194.32.229.0/24
Deny from 45.147.192.0/24
Deny from 193.58.168.0/24
Deny from 109.248.55.0/24
Deny from 109.248.143.0/24
Deny from 2a0e:8142::/32
Deny from 95.182.126.0/24
Deny from 2a0e:8140::/32
Deny from 109.248.13.0/24
Deny from 188.130.136.0/23
Deny from 45.86.1.0/24
Deny from 2a0e:8146::/32
Deny from 46.8.16.0/23
Deny from 109.248.204.0/24
Deny from 2a0e:cd40::/29
Deny from 45.11.21.0/24
Deny from 45.135.33.0/24
Deny from 188.130.219.0/24
Deny from 46.8.192.0/24
Deny from 45.90.196.0/24
Deny from 46.8.11.0/24
Deny from 5.183.130.0/24
Deny from 45.142.253.0/24
Deny from 45.11.20.0/24
Deny from 188.130.143.0/24
Deny from 77.83.148.0/23
Deny from 45.134.253.0/24
Deny from 77.83.84.0/24
Deny from 31.40.203.0/24
Deny from 46.8.156.0/23
Deny from 188.130.186.0/23
Deny from 45.135.32.0/24
Deny from 193.53.168.0/24
Deny from 46.8.56.0/24
Deny from 188.130.218.0/24
Deny from 45.84.176.0/24
Deny from 45.134.252.0/24
Deny from 194.32.237.0/24
Deny from 185.181.246.0/23
Deny from 194.35.113.0/24
Deny from 2a07:ca07:8000::/33
Deny from 188.130.184.0/23
Deny from 45.139.177.0/24
Deny from 109.248.204.0/23
Deny from 188.130.142.0/24
Deny from 2a0a:b387::/33
Deny from 188.130.210.0/23
Deny from 185.181.244.0/24
Deny from 109.248.48.0/24
Deny from 2a06:d647::/33
Deny from 45.15.236.0/23
Deny from 46.8.15.0/24
Deny from 176.53.186.0/24
Deny from 194.156.92.0/24
Deny from 188.130.185.0/24
Deny from 188.130.220.0/24
Deny from 91.188.244.0/24
Deny from 46.8.10.0/24
Deny from 46.8.192.0/23
Deny from 94.158.190.0/24
Deny from 2a0b:2d87::/33
Deny from 46.8.17.0/24
Deny from 77.94.1.0/24
Deny from 45.140.52.0/23
Deny from 45.142.252.0/24
Deny from 188.130.220.0/23
Deny from 188.130.188.0/24
Deny from 2a0f:d005::/32
Deny from 109.248.15.0/24
Deny from 46.8.110.0/24
Deny from 109.248.139.0/24
Deny from 2a0b:2d87:8000::/33
Deny from 2a0f:d001::/32
Deny from 2a0a:5686::/32
Deny from 109.248.48.0/23
Deny from 46.8.154.0/23
Deny from 45.134.180.0/23
Deny from 2a0f:d003::/32
Deny from 2a0e:8144::/32
Deny from 2.59.50.0/24
Deny from 188.130.184.0/24
Deny from 45.139.176.0/23
Deny from 46.8.22.0/24
Deny from 109.248.49.0/24
Deny from 109.248.12.0/23
Deny from 109.248.138.0/24
Deny from 45.11.20.0/23
Deny from 2a0f:d004::/32
Deny from 188.130.129.0/24
Deny from 46.8.57.0/24
Deny from 45.86.0.0/23
Deny from 2a0e:8140::/29
Deny from 2a06:d647::/32
Deny from 46.8.23.0/24
Deny from 45.145.116.0/22
Deny from 188.130.128.0/23
Deny from 45.134.180.0/22
Deny from 185.181.244.0/23
Deny from 2a0e:8143::/32
Deny from 2a0a:5685::/32
Deny from 46.8.10.0/23
Deny from 46.8.107.0/24
Deny from 46.8.222.0/24
Deny from 109.248.128.0/23
Deny from 95.182.124.0/24
Deny from 2a0a:5680::/32
Deny from 2a0f:d006::/32
Deny from 45.142.252.0/23
Deny from 188.130.189.0/24
Deny from 188.130.136.0/24
Deny from 46.8.14.0/24
Deny from 46.8.106.0/24
Deny from 46.8.22.0/23
Deny from 46.8.16.0/24
Deny from 188.130.188.0/23
Deny from 185.181.246.0/24
Deny from 45.15.72.0/23
Deny from 45.151.145.0/24
Deny from 45.81.137.0/24
Deny from 2a0a:b387:8000::/33
Deny from 194.156.96.0/24
Deny from 46.8.154.0/24
Deny from 46.8.223.0/24
Deny from 109.248.167.0/24
Deny from 77.83.149.0/24
Deny from 46.8.213.0/24
Deny from 95.182.125.0/24
Deny from 2a0a:5680::/29
Deny from 45.86.0.0/24
Deny from 109.248.12.0/24
Deny from 2a0a:5687::/32
Deny from 188.130.221.0/24
Deny from 45.84.176.0/23
Deny from 188.130.186.0/24
Deny from 2a0e:8145::/32
Deny from 45.144.36.0/24
Deny from 188.130.218.0/23
Deny from 188.130.142.0/23
Deny from 46.8.155.0/24
Deny from 2a0a:b387::/32
Deny from 45.140.52.0/22
Deny from 188.130.210.0/24
Deny from 109.248.166.0/24
Deny from 2a0f:d007::/32
Deny from 194.156.97.0/24
Deny from 109.248.14.0/23
Deny from 2a0b:2d87::/32
Deny from 95.182.127.0/24
Deny from 213.226.101.0/24
Deny from 45.134.182.0/23
Deny from 45.15.236.0/24
Deny from 45.87.252.0/23

Удобный съем позиций (http://allpositions.ru/redirect/58277)
Реально ли запретить доступ Помощь в фильтрации ботов Переходы по ссылкам на
S
На сайте с 12.10.2012
Offline
206
sagamorr
#2
Xubart #:
Order Deny,Allow
Deny from 192.144.31.0/24
Deny from 46.8.193.0/24
Deny from 2a0e:cd40::/32
Deny from 45.89.16.0/23
Deny from 45.145.116.0/23
Deny from 185.181.245.0/24
Deny from 45.15.237.0/24
Deny from 2a07:ca07::/32
Deny from 188.130.137.0/24
Deny from 188.130.211.0/24
Deny from 45.81.136.0/24
Deny from 188.130.128.0/24
Deny from 45.140.54.0/23
Deny from 109.248.138.0/23
Deny from 46.8.212.0/23
Deny from 45.84.177.0/24
Deny from 2a0e:cd45::/32
Deny from 77.83.148.0/24
Deny from 109.248.54.0/23
Deny from 2a0f:d002::/32
Deny from 95.182.126.0/23
Deny from 46.8.14.0/23
Deny from 2a0e:8141::/32
Deny from 188.130.187.0/24
Deny from 109.248.142.0/24
Deny from 46.8.111.0/24
Deny from 109.248.166.0/23
Deny from 84.54.53.0/24
Deny from 194.156.123.0/24
Deny from 2a0e:cd47::/32
Deny from 46.8.106.0/23
Deny from 46.8.222.0/23
Deny from 95.182.124.0/23
Deny from 45.87.253.0/24
Deny from 45.89.16.0/22
Deny from 109.248.54.0/24
Deny from 212.115.49.0/24
Deny from 2a06:d647:8000::/33
Deny from 109.248.142.0/23
Deny from 46.8.212.0/24
Deny from 185.181.247.0/24
Deny from 2a0e:cd44::/32
Deny from 2a0f:d000::/32
Deny from 46.8.157.0/24
Deny from 45.139.176.0/24
Deny from 194.34.248.0/24
Deny from 109.248.128.0/24
Deny from 45.135.32.0/23
Deny from 92.119.193.0/24
Deny from 109.248.205.0/24
Deny from 2a0e:cd43::/32
Deny from 2a0e:cd46::/32
Deny from 2a07:ca07::/33
Deny from 109.248.129.0/24
Deny from 2a0f:d000::/29
Deny from 46.8.56.0/23
Deny from 45.134.252.0/23
Deny from 45.15.73.0/24
Deny from 2a0e:cd42::/32
Deny from 45.81.136.0/23
Deny from 2a0e:cd41::/32
Deny from 194.156.96.0/23
Deny from 45.15.72.0/24
Deny from 193.58.169.0/24
Deny from 45.147.193.0/24
Deny from 45.87.252.0/24
Deny from 45.139.125.0/24
Deny from 46.8.156.0/24
Deny from 193.58.168.0/23
Deny from 2a0e:8147::/32
Deny from 2a0a:5684::/32
Deny from 45.145.118.0/23
Deny from 45.147.192.0/23
Deny from 109.248.14.0/24
Deny from 194.32.229.0/24
Deny from 45.147.192.0/24
Deny from 193.58.168.0/24
Deny from 109.248.55.0/24
Deny from 109.248.143.0/24
Deny from 2a0e:8142::/32
Deny from 95.182.126.0/24
Deny from 2a0e:8140::/32
Deny from 109.248.13.0/24
Deny from 188.130.136.0/23
Deny from 45.86.1.0/24
Deny from 2a0e:8146::/32
Deny from 46.8.16.0/23
Deny from 109.248.204.0/24
Deny from 2a0e:cd40::/29
Deny from 45.11.21.0/24
Deny from 45.135.33.0/24
Deny from 188.130.219.0/24
Deny from 46.8.192.0/24
Deny from 45.90.196.0/24
Deny from 46.8.11.0/24
Deny from 5.183.130.0/24
Deny from 45.142.253.0/24
Deny from 45.11.20.0/24
Deny from 188.130.143.0/24
Deny from 77.83.148.0/23
Deny from 45.134.253.0/24
Deny from 77.83.84.0/24
Deny from 31.40.203.0/24
Deny from 46.8.156.0/23
Deny from 188.130.186.0/23
Deny from 45.135.32.0/24
Deny from 193.53.168.0/24
Deny from 46.8.56.0/24
Deny from 188.130.218.0/24
Deny from 45.84.176.0/24
Deny from 45.134.252.0/24
Deny from 194.32.237.0/24
Deny from 185.181.246.0/23
Deny from 194.35.113.0/24
Deny from 2a07:ca07:8000::/33
Deny from 188.130.184.0/23
Deny from 45.139.177.0/24
Deny from 109.248.204.0/23
Deny from 188.130.142.0/24
Deny from 2a0a:b387::/33
Deny from 188.130.210.0/23
Deny from 185.181.244.0/24
Deny from 109.248.48.0/24
Deny from 2a06:d647::/33
Deny from 45.15.236.0/23
Deny from 46.8.15.0/24
Deny from 176.53.186.0/24
Deny from 194.156.92.0/24
Deny from 188.130.185.0/24
Deny from 188.130.220.0/24
Deny from 91.188.244.0/24
Deny from 46.8.10.0/24
Deny from 46.8.192.0/23
Deny from 94.158.190.0/24
Deny from 2a0b:2d87::/33
Deny from 46.8.17.0/24
Deny from 77.94.1.0/24
Deny from 45.140.52.0/23
Deny from 45.142.252.0/24
Deny from 188.130.220.0/23
Deny from 188.130.188.0/24
Deny from 2a0f:d005::/32
Deny from 109.248.15.0/24
Deny from 46.8.110.0/24
Deny from 109.248.139.0/24
Deny from 2a0b:2d87:8000::/33
Deny from 2a0f:d001::/32
Deny from 2a0a:5686::/32
Deny from 109.248.48.0/23
Deny from 46.8.154.0/23
Deny from 45.134.180.0/23
Deny from 2a0f:d003::/32
Deny from 2a0e:8144::/32
Deny from 2.59.50.0/24
Deny from 188.130.184.0/24
Deny from 45.139.176.0/23
Deny from 46.8.22.0/24
Deny from 109.248.49.0/24
Deny from 109.248.12.0/23
Deny from 109.248.138.0/24
Deny from 45.11.20.0/23
Deny from 2a0f:d004::/32
Deny from 188.130.129.0/24
Deny from 46.8.57.0/24
Deny from 45.86.0.0/23
Deny from 2a0e:8140::/29
Deny from 2a06:d647::/32
Deny from 46.8.23.0/24
Deny from 45.145.116.0/22
Deny from 188.130.128.0/23
Deny from 45.134.180.0/22
Deny from 185.181.244.0/23
Deny from 2a0e:8143::/32
Deny from 2a0a:5685::/32
Deny from 46.8.10.0/23
Deny from 46.8.107.0/24
Deny from 46.8.222.0/24
Deny from 109.248.128.0/23
Deny from 95.182.124.0/24
Deny from 2a0a:5680::/32
Deny from 2a0f:d006::/32
Deny from 45.142.252.0/23
Deny from 188.130.189.0/24
Deny from 188.130.136.0/24
Deny from 46.8.14.0/24
Deny from 46.8.106.0/24
Deny from 46.8.22.0/23
Deny from 46.8.16.0/24
Deny from 188.130.188.0/23
Deny from 185.181.246.0/24
Deny from 45.15.72.0/23
Deny from 45.151.145.0/24
Deny from 45.81.137.0/24
Deny from 2a0a:b387:8000::/33
Deny from 194.156.96.0/24
Deny from 46.8.154.0/24
Deny from 46.8.223.0/24
Deny from 109.248.167.0/24
Deny from 77.83.149.0/24
Deny from 46.8.213.0/24
Deny from 95.182.125.0/24
Deny from 2a0a:5680::/29
Deny from 45.86.0.0/24
Deny from 109.248.12.0/24
Deny from 2a0a:5687::/32
Deny from 188.130.221.0/24
Deny from 45.84.176.0/23
Deny from 188.130.186.0/24
Deny from 2a0e:8145::/32
Deny from 45.144.36.0/24
Deny from 188.130.218.0/23
Deny from 188.130.142.0/23
Deny from 46.8.155.0/24
Deny from 2a0a:b387::/32
Deny from 45.140.52.0/22
Deny from 188.130.210.0/24
Deny from 109.248.166.0/24
Deny from 2a0f:d007::/32
Deny from 194.156.97.0/24
Deny from 109.248.14.0/23
Deny from 2a0b:2d87::/32
Deny from 95.182.127.0/24
Deny from 213.226.101.0/24
Deny from 45.134.182.0/23
Deny from 45.15.236.0/24
Deny from 45.87.252.0/23

Это Битерика?
fillonon
На сайте с 24.12.2009
Offline
132
fillonon
#3
Что это за списки?) надо как то поподробнее, а то так и нужное можно заблокировать 
Сайт знакомств - который скоро переплюнет Мамбу ( https://naytiparu.ru/ ), лучший массажер простаты ( https://happymans-xxl.ru/prostata-massager.html ) , Если нужно SEO продвижение ( https://seouspeh.ru/ )
S
На сайте с 12.10.2012
Offline
206
sagamorr
#4
fillonon #:
Что это за списки?) надо как то поподробнее, а то так и нужное можно заблокировать 

Это видимо список спам IP, который собрал Xubart.

В этой ветке есть список Битерики, но он покороче - https://searchengines.guru/ru/forum/1048352/page4

# Biterika - AS35048
Deny from 2.59.50.0/24
Deny from 5.183.130.0/24
Deny from 31.40.203.0/24
Deny from 45.11.20.0/23
Deny from 45.15.72.0/23
Deny from 45.15.236.0/23
Deny from 45.81.136.0/23
Deny from 45.84.176.0/23
Deny from 45.86.0.0/23
Deny from 45.87.252.0/23
Deny from 45.89.16.0/22
Deny from 45.90.196.0/24
Deny from 45.134.180.0/22
Deny from 45.134.252.0/23
Deny from 45.135.32.0/23
Deny from 45.139.125.0/24
Deny from 45.139.176.0/23
Deny from 45.140.52.0/22
Deny from 45.142.252.0/23
Deny from 45.144.36.0/24
Deny from 45.145.116.0/22
Deny from 45.147.192.0/23
Deny from 45.151.145.0/24
Deny from 46.8.10.0/23
Deny from 46.8.14.0/23
Deny from 46.8.16.0/23
Deny from 46.8.22.0/23
Deny from 46.8.56.0/23
Deny from 46.8.106.0/23
Deny from 46.8.110.0/23
Deny from 46.8.154.0/23
Deny from 46.8.156.0/23
Deny from 46.8.192.0/23
Deny from 46.8.212.0/23
Deny from 46.8.222.0/23
Deny from 77.83.84.0/24
Deny from 77.83.148.0/23
Deny from 77.94.1.0/24
Deny from 84.54.53.0/24
Deny from 91.188.244.0/24
Deny from 92.119.193.0/24
Deny from 94.158.190.0/24
Deny from 95.182.124.0/22
Deny from 109.248.12.0/22
Deny from 109.248.48.0/23
Deny from 109.248.54.0/23
Deny from 109.248.128.0/23
Deny from 109.248.138.0/23
Deny from 109.248.142.0/23
Deny from 109.248.166.0/23
Deny from 109.248.204.0/23
Deny from 176.53.186.0/24
Deny from 185.181.244.0/22
Deny from 185.181.247.0/24
Deny from 188.130.128.0/23
Deny from 188.130.136.0/23
Deny from 188.130.142.0/23
Deny from 188.130.184.0/22
Deny from 188.130.188.0/23
Deny from 188.130.210.0/23
Deny from 188.130.218.0/23
Deny from 188.130.220.0/23
Deny from 192.144.31.0/24
Deny from 193.53.168.0/24
Deny from 193.58.168.0/23
Deny from 194.32.229.0/24
Deny from 194.32.237.0/24
Deny from 194.34.248.0/24
Deny from 194.35.113.0/24
Deny from 194.156.92.0/24
Deny from 194.156.96.0/23
Deny from 194.156.123.0/24
Deny from 212.115.49.0/24
Deny from 213.226.101.0/24
Вставил в файл Htaccess список подсетей для блокировки Битерики - Веб-строительство - Сайтостроение
Вставил в файл Htaccess список подсетей для блокировки Битерики - Веб-строительство - Сайтостроение
  • 2023.09.14
  • searchengines.guru
не война и мир а то то что апач его постоянно читает при обращении к каждому файлу сайта. хоть к фавиконке - это тоже может начать создавать нагрузку. А как узнать задело реальных посетителей или не задело
MI
На сайте с 18.08.2021
Offline
44
MihailIsmailov2021
#5
Ну фильтровать ботов через .htacces не очень идея, хотябы потому, что там могут попадаться и живые юзеры
Защита сайта от прямых заходов, ботов, накрутки пф https://clck.ru/33hqox
X
На сайте с 04.12.2018
Offline
280
Xubart
#6
Это список битерики с того самого сайта. Рандомно проверил - битерика. 
S
На сайте с 12.10.2012
Offline
206
sagamorr
#7
MihailIsmailov2021 #:
Ну фильтровать ботов через .htacces не очень идея, хотябы потому, что там могут попадаться и живые юзеры

В Битерики нет живых юзеров.

Так же нет живых юзеров с подмены utm меток (если конечно ваш сайт не рекламируется).

frank_82
На сайте с 09.12.2011
Offline
247
frank_82
#8
нормально стало при таком отсечении, ботов нет уже неделю, прямых заходов: было 22%, стало 4%
softerra
На сайте с 02.10.2023
Offline
46
softerra
#9
frank_82 #:
нормально стало при таком отсечении, ботов нет уже неделю, прямых заходов: было 22%, стало 4%

Racktech тоже можно сразу блокировать всю полностью.

https://asn.ipinfo.app/api/text/htaccess/AS204916

Авторизуйтесь или зарегистрируйтесь, чтобы оставить комментарий