Software Development:
Individual Programming

How can I block undesirable bot visits?

Question: 

Searching …

 

Unfortunately nothing found on "".

Premium support for Bitpalace web hosting customers only!

 from Fiji: +49 30 32 70 18 92, Fax (in Germany) +49 30 32 70 18 91

service@bitpalast.net 

Skype: bitpalast

One moment please … your browser is loading the page.

 

 

Symptom

My website is frequently being visited by undesireable bots. The access_log shows that sources like Majestic12, HTTrack, Semrush and more request the same files over and over again.

 

Solution

The requesting services are “bad bots”, meaning programs and website systems that check and analyze other websites. Visits of such bots are mostly useless for website owners. They only cause CPU load and decrease the speed of your server. A special software on the Bitpalace hosts recognizes many of these bots and automatically blocks them. But you can also add security to your site by adding these lines to the beginning of your .htaccess file:

RewriteEngine On
RewriteBase /
RewriteCond %{HTTP_USER_AGENT} (seobility|PetalBot|UptimeRobot|seocompany|LieBaoFast|SEOkicks| Uptimebot|Cliqzbot|ssearch_bot|domaincrawler|AhrefsBot|spot|DigExt|Sogou| MegaIndex.ru|majestic12|80legs|SISTRIX|HTTrack|Semrush|MJ12|MJ12bot|MJ12Bot|Ezooms|CCBot|TalkTalk|Ahrefs|BLEXBot) [NC]
RewriteRule .* - [F]

This will block all frequently found bad bots from visiting your website.

Please note that the line containing the Bad Bot names (SEOkicks|Uptimebot|...) must be written in a single line without spaces. Copies from this article may contain space characters due to line breaks. Remove these spaces before saving.

 

Overview of frequently asked questions 

 

 

 


 

Additional Services

Cheap web space for less than 1 US$/month 

Starter Server: Affordable web server from  2.18 US$ () /month with PHP, database and many more 

Online Reservation System: Occupancy & vacancy schedule for any ressources (vehicles, sports facilities …) & guest houses, holiday apartments …  1.02 US$ () /month 

 

FAQ – frequently asked questions 

 

Software development (programming, programmers) in selected countries

Cuba

Austria

Kenya

Guyana

Panama

Lesotho

Liberia

Antigua and Barbuda

Paraguay

Peru

Cameroon

Argentina

Costa Rica

Australia

Germany

Bahamas

Madagascar

Barbados

Belize

Uganda

India

Philippines

Malta

Bolivia

Botswana

Marshall Islands

Chile

Puerto Rico

Ireland

Mauritius

Rwanda

Saint Kitts and Nevis

Saint Vincent and the Grenadines

Saint Lucia

Mexico

Zambia

Samoa

Jordan

Micronesia, Federated States of

Switzerland

Dominican Republic

Malawi

Seychelles

Namibia

Kiribati

Dominican Republic

Nauru

Sierra Leone

New Zealand

Ecuador

Singapore

El Salvador

Gambia

Solomon Islands

Ghana

Spain

Nicaragua

Sudan

Nigeria

Swaziland

South Africa

Pakistan

Palau

Tanzania, United Republic of

Colombia

Grenada

Tonga

Trinidad and Tobago

Honduras

Tuvalu

Uruguay

Papua New Guinea

Venezuela

United States

Jamaica

Canada

Guatemala

Guinea

United Kingdom

Zimbabwe

 

"software development": programmer, programming, database design, interface, software developers, outsourcing, insourcing, off shore, program development, documentation, software manual, optimization, optimizing, scripting, script, revise program, revision, document software, prices for programming, Windows, Unix (z.B. Solaris, Linux, FreeBSD), Assembler, C, C++, JAVA, PHP, JavaScript & AJAX, VisualBasic, Cobol, Informix 4GL, SQL/MySQL, ADABAS, MS Access, Oracle, ARIS, Prozess 2000, Visio, MS Office (Word, Excel PowerPoint, MS Project), Automation mit VisualBasic, MS Windows Server und Clients, SAP R/3, Macromedia MX Studio, MS Frontpage, MS Expression Web, Smarty Template Engine, Joomla, Redaxo, osCommerce, OXID eSales Community Edition, OrgaMAX Web Export.

  from Fiji: +49 30 32 70 18 92 •  GmbH, Sensburger Allee 27, D-14055 Berlin (Germany)
Your purchase is tax-free, because you order from a non-EU country. © 2024  GmbH. All rights reserved. and the logo are registered trademarks of GmbH. For photo credits see imprint.

Imprint Privacy policy Sitemap