{"id":6305,"date":"2018-08-14T15:44:47","date_gmt":"2018-08-14T13:44:47","guid":{"rendered":"https:\/\/nprofit.net\/pl\/?page_id=6305"},"modified":"2026-03-03T13:25:28","modified_gmt":"2026-03-03T12:25:28","slug":"robots-txt-seo","status":"publish","type":"post","link":"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/","title":{"rendered":"Kompendium wiedzy o robots.txt: blokowanie bot\u00f3w, wskazanie map stron, SEO"},"content":{"rendered":"\n\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_81 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Spis tre\u015bci<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Prze\u0142\u0105cznik Spisu Tre\u015bci\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #003366;color:#003366\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #003366;color:#003366\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-1'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#Kompendium_wiedzy_o_robotstxt_blokowanie_botow_wskazanie_map_stron_SEO\" >Kompendium wiedzy o robots.txt: blokowanie bot\u00f3w, wskazanie map stron, SEO<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#i\" >&nbsp;<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#i-2\" >&nbsp;<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#1_Czym_jest_plik_robotstxt\" >1. Czym jest plik robots.txt?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#i-3\" >&nbsp;<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#2_Gdzie_znajde_robotstxt\" >2. Gdzie znajd\u0119 robots.txt?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#i-4\" >&nbsp;<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#3_Zawartosc_pliku_robotstxt\" >3. Zawarto\u015b\u0107 pliku robots.txt<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#i-5\" >&nbsp;<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#4_Jak_stworzyc_plik_robotstxt\" >4. Jak stworzy\u0107 plik robots.txt?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#i-6\" >&nbsp;<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#5_Zastosowanie_pliku_robotstxt_w_SEO\" >5. Zastosowanie pliku robots.txt w SEO<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-13\" href=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#i-7\" >&nbsp;<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-14\" href=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#6_Robotstxt_a_meta_robots\" >6. Robots.txt, a meta robots<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-15\" href=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#7_Jak_wykluczyc_wszystkie_boty_poza_GoogleBotem\" >7. Jak wykluczy\u0107 wszystkie boty poza GoogleBotem?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-16\" href=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#i-8\" >&nbsp;<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-17\" href=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#8_Ograniczenia\" >8. Ograniczenia<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-18\" href=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#i-9\" >&nbsp;<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-19\" href=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#9_Kontrola_poprawnosci_pliku\" >9. Kontrola poprawno\u015bci pliku<\/a><\/li><\/ul><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n<h1><span class=\"ez-toc-section\" id=\"Kompendium_wiedzy_o_robotstxt_blokowanie_botow_wskazanie_map_stron_SEO\"><\/span>Kompendium wiedzy o robots.txt: blokowanie bot\u00f3w, wskazanie map stron, SEO<span class=\"ez-toc-section-end\"><\/span><\/h1>\n<h3><span class=\"ez-toc-section\" id=\"i\"><\/span>&nbsp;<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<div class=\"col-md-6\">\n<div style=\"padding: 15px; display: table; border: 1px solid #a2a9b1;\" align=\"left\"><center><strong>Spis tre\u015bci<\/strong><\/center><br \/>\n1. <a href=\"#1\">Czym jest plik robots.txt?<\/a><br \/>\n2. <a href=\"#2\">Gdzie znajd\u0119 robots.txt?<\/a><br \/>\n3. <a href=\"#3\">Zawarto\u015b\u0107 pliku robots.txt<\/a><br \/>\n4. <a href=\"#4\">Jak stworzy\u0107 plik robots.txt?<\/a><br \/>\n5. <a href=\"#5\">Zastosowanie robots.txt w SEO<\/a><br \/>\n6. <a href=\"#6\">Robots.txt, a meta robots<\/a><br \/>\n7. <a href=\"#7\">Jak wykluczy\u0107 wszystkie boty poza GoogleBotem?<\/a><br \/>\n8. <a href=\"#8\">Ograniczenia<\/a><br \/>\n9. <a href=\"#9\">Kontrola poprawno\u015bci pliku<\/a><\/div>\n<\/div>\n<div class=\"col-md-6\">\n<div style=\"display: table; border: 1px solid #a2a9b1;\" align=\"left\"><center><strong>Najcz\u0119\u015bciej u\u017cywane<\/strong><\/center><\/p>\n<blockquote><p><code>User-agent: *<\/code><\/p>\n<p><code># odm\u00f3wienie dost\u0119pu do folderu<br \/>\nDisallow: \/folder1<\/code><\/p>\n<p><code># przyzwolenie na dost\u0119p do podstrony<br \/>\nAllow: \/folder1\/waznastrona<\/code><\/p>\n<p><code># wskazanie mapy strony<br \/>\nSitemap: http:\/\/domena.pl\/pelnyadresmapy.xml<\/code><\/p><\/blockquote>\n<\/div>\n<\/div>\n<h3><span class=\"ez-toc-section\" id=\"i-2\"><\/span>&nbsp;<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<h3 id=\"1\"><span class=\"ez-toc-section\" id=\"1_Czym_jest_plik_robotstxt\"><\/span>1. Czym jest plik robots.txt?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Plik robots.txt zarz\u0105dza dost\u0119pem robot\u00f3w indeksuj\u0105cych do strony. Wykorzystuje protok\u00f3\u0142 Robots Exclusion Protocol, powsta\u0142y ju\u017c w 1994 roku, kt\u00f3ry jest standardowo interpretowany przez wi\u0119kszo\u015b\u0107 bot\u00f3w. Podstawowy cel zastosowania robots.txt to ograniczenie zu\u017cycia zasob\u00f3w po stronie serwera oraz po stronie robota, dzi\u0119ki wskazaniu sekcji, kt\u00f3rych odpytywanie nie jest warto\u015bciowe &#8211; przyk\u0142adowo sekcji z wynikami wewn\u0119trznej wyszukiwarki.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"i-3\"><\/span>&nbsp;<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<h3 id=\"2\"><span class=\"ez-toc-section\" id=\"2_Gdzie_znajde_robotstxt\"><\/span>2. Gdzie znajd\u0119 robots.txt?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Plik powinien znajdowa\u0107 si\u0119 w g\u0142\u00f3wnym katalogu domeny i by\u0107 dost\u0119pny pod adresem domena.pl\/robots.txt. Ten adres jest odpytywany przez robota indeksuj\u0105cego Google jeszcze przed wej\u015bciem na jakiekolwiek adresy w obr\u0119bie domeny.<\/p>\n<p>Przyk\u0142ad dost\u0119pu do <a href=\"https:\/\/www.google.pl\/robots.txt\">https:\/\/www.google.pl\/robots.txt<\/a> \u2013 w przegl\u0105darce widoczna jest jego zawarto\u015b\u0107:<\/p>\n<blockquote><p>\n<code>User-agent: *<br \/>\nDisallow: \/search<br \/>\nAllow: \/search\/about<br \/>\nAllow: \/search\/static<br \/>\nAllow: \/search\/howsearchworks<br \/>\nDisallow: \/sdch<br \/>\nDisallow: \/groups<br \/>\nDisallow: \/index.html?<br \/>\n(...)<br \/>\nSitemap: http:\/\/www.gstatic.com\/s2\/sitemaps\/profiles-sitemap.xml<br \/>\nSitemap: https:\/\/www.google.com\/sitemap.xml<\/code><\/p><\/blockquote>\n<h3><span class=\"ez-toc-section\" id=\"i-4\"><\/span>&nbsp;<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<h3 id=\"3\"><span class=\"ez-toc-section\" id=\"3_Zawartosc_pliku_robotstxt\"><\/span>3. Zawarto\u015b\u0107 pliku robots.txt<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p><em>User-agent: *<\/em> &#8211; linia, kt\u00f3ra definiuje roboty indeksuj\u0105ce, kt\u00f3rych b\u0119d\u0105 dotyczy\u0107 dalsze polecenia. Obowi\u0105zuje do kolejnego polecenia <em>User-agent<\/em>. Gwiazdka * to symbol wszystkich bot\u00f3w.<\/p>\n<p><em>Disallow: \/search <\/em>&#8211; linia odmawiaj\u0105ca dost\u0119pu do okre\u015blonych adres\u00f3w. Podany ci\u0105g znak\u00f3w jest traktowany jest przedrostek, st\u0105d podanie \/search blokuje dost\u0119p nie tylko do katalogu, ale r\u00f3wnie\u017c do podkatalog\u00f3w, a tak\u017ce podstron w tym katalogu. U\u017cycie <em>Disallow: \/<\/em> blokuje dost\u0119p do ca\u0142ej witryny. U\u017cycie pustego <em>Disallow:<\/em> nie blokuje dost\u0119pu do \u017cadnego adresu w witrynie.<\/p>\n<p><em>Allow: \/search\/about<\/em> &#8211; linia pozwalaj\u0105ca na dost\u0119p do okre\u015blonych adres\u00f3w. Zazwyczaj jest u\u017cywana w po\u0142\u0105czeniu z <em>Disallow<\/em>, gdzie po komendzie wykluczenia, mo\u017cliwe jest doprecyzowanie specyficznych miejsc, kt\u00f3re s\u0105 dost\u0119pne. W podanym przyk\u0142adzie, wykluczony zosta\u0142 katalog \/search, jednak pracownicy firmy Google zezwolili na dost\u0119p do podkatalogu \/search\/about.<\/p>\n<p><em>Noindex: <\/em>&#8211; rzadko u\u017cywana komenda, nieobecna w standardowym protokole, ale uznawana przez roboty indeksuj\u0105ce Google. Nakazuje wy\u0142\u0105czenie z indeksu wskazanego adresu. Mo\u017ce by\u0107 stosowana zamiennie z <em>Disallow<\/em>.<\/p>\n<p><em>Sitemap:<\/em> &#8211; wskazuje lokalizacj\u0119 mapy strony za pomoc\u0105 pe\u0142nego adresu.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"i-5\"><\/span>&nbsp;<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<h3 id=\"4\"><span class=\"ez-toc-section\" id=\"4_Jak_stworzyc_plik_robotstxt\"><\/span>4. Jak stworzy\u0107 plik robots.txt?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Wystarczy utworzenie pliku tekstowego w Notatniku z odpowiednimi regu\u0142ami, kt\u00f3ry zostanie umieszczony na serwerze w miejscu dost\u0119pnym z domena.pl\/robots.txt (zazwyczaj w katalogu &#8222;public_html&#8221;). Nale\u017cy odnotowa\u0107, \u017ce niekt\u00f3re systemy zarz\u0105dzania tre\u015bci\u0105 s\u0105 w stanie nadpisywa\u0107 plik robots.txt w trakcie aktualizacji lub po instalacji okre\u015blonych wtyczek.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"i-6\"><\/span>&nbsp;<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<h3 id=\"5\"><span class=\"ez-toc-section\" id=\"5_Zastosowanie_pliku_robotstxt_w_SEO\"><\/span>5. Zastosowanie pliku robots.txt w SEO<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Najcz\u0119stsze zastosowanie Robots Exclusion Protocol dotyczy licznych adres\u00f3w, kt\u00f3re nie s\u0105 istotne dla robot\u00f3w indeksuj\u0105cych &#8211; sortowania i filtrowania list (na przyk\u0142ad podstrona kategorii sortowanej po najwy\u017cszej cenie), a tak\u017ce wewn\u0119trznych rozwi\u0105za\u0144 (na przyk\u0142ad \u015bcie\u017cek do plugin\u00f3w, logowania, rejestracji). Adresy podawane w komendzie Disallow stosuj\u0105 si\u0119 do poni\u017cszych wytycznych:<\/p>\n<ul>\n<li>brak nazwy domeny (&#8222;\/&#8221; zamiast &#8222;domena.pl\/&#8221;),<\/li>\n<li>pocz\u0105tkowy uko\u015bnik nie ma znaczenia je\u015bli jest podawany adres inny ni\u017c strona g\u0142\u00f3wna (&#8222;\/podstrona&#8221; = &#8222;podstrona&#8221;), w przypadku strony g\u0142\u00f3wnej konieczny jest uko\u015bnik (&#8222;\/&#8221; nie r\u00f3wna si\u0119 pustemu &#8221; &#8222;),<\/li>\n<li>podany ci\u0105g znak\u00f3w zawsze musi si\u0119 znajdowa\u0107 w adresie, kt\u00f3rego dotyczy (&#8222;\/podstrona&#8221; b\u0119dzie dotyczy\u0107 domena.pl\/podstrona, ale nie b\u0119dzie dotyczy\u0107 domena.pl\/innapodstrona),<\/li>\n<li>wewn\u0105trz adresu mo\u017cliwe jest u\u017cycie symbolu dowolnego ci\u0105gu znak\u00f3w &#8211; gwiazdki &#8222;*&#8221; (&#8222;\/kategoria-*\/produkt&#8221; b\u0119dzie dotyczy\u0107 zar\u00f3wno domena.pl\/kategoria-1\/produkt jak i domena.pl\/kategoria-600\/produkt),<\/li>\n<li>komenda dotyczy wszystkich adres\u00f3w z dowolnymi dopisanymi znakami (&#8222;\/podstrona&#8221; b\u0119dzie dotyczy\u0107 r\u00f3wnie\u017c domena.pl\/podstrona\/druga, domena.pl\/podstrona12345 i pozosta\u0142ych),<\/li>\n<li>symbol dowolnego ci\u0105gu znak\u00f3w nie ma znaczenia w ostatniej pozycji (zar\u00f3wno z &#8222;*&#8221; jak i bez &#8222;*&#8221; na ko\u0144cu, komenda dotyczy wszystkich mo\u017cliwych ko\u0144c\u00f3wek).<\/li>\n<\/ul>\n<p>Przyk\u0142adowo, je\u015bli kategorie mog\u0105 by\u0107 filtrowane za pomoc\u0105 parametru price, mo\u017cna go wykluczy\u0107 za pomoc\u0105 komendy:<\/p>\n<blockquote><p><code>Disallow: \/*price<\/code><\/p><\/blockquote>\n<p>Dzi\u0119ki temu roboty indeksuj\u0105ce nie b\u0119d\u0105 odpytywa\u0107 adres\u00f3w takich jak \/kategoria?price=highest, \/innakategoria?price=lowest, \/wyszukiwarka?price=lowest itd.<\/p>\n<p>Z tak zdefiniowanych wyklucze\u0144 mo\u017cna wyr\u00f3\u017cni\u0107 wyj\u0105tki:<\/p>\n<blockquote><p><code>Disallow: \/*price<br \/>\nAllow: \/*price=lowest<\/code><\/p><\/blockquote>\n<p>Powy\u017csze komendy wyklucz\u0105 adresy takie jak \/kategoria?price=highest, ale umo\u017cliwi\u0105 robotom dost\u0119p do \/kategoria?price=lowest.<\/p>\n<p>R\u00f3\u017cne wykluczenia mo\u017cna zastosowa\u0107 w stosunku do r\u00f3\u017cnych robotow. Pozwala to na zarz\u0105dzanie ruchem w osobnej wersji mobilnej:<\/p>\n<blockquote><p><code>User-agent: *<br \/>\nDisallow: \/m\/<\/code><br \/>\n&nbsp;<br \/>\n<code>User-agent: Googlebot-Mobile<br \/>\nAllow: \/m\/<\/code><\/p><\/blockquote>\n<h3><span class=\"ez-toc-section\" id=\"i-7\"><\/span>&nbsp;<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<h3 id=\"6\"><span class=\"ez-toc-section\" id=\"6_Robotstxt_a_meta_robots\"><\/span>6. Robots.txt, a meta robots<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Zachowanie robot\u00f3w indeksuj\u0105cych Google mo\u017ce by\u0107 regulowane zar\u00f3wno za pomoc\u0105 komend w robots.txt jak i w kodzie strony za po\u015brednictwem znacznik\u00f3w meta robots. Zawsze jako pierwszy jest sprawdzany plik robots.txt &#8211; instrukcje w nim decyduj\u0105 o tym, czy dany adres b\u0119dzie odwiedzony. Je\u015bli dost\u0119p do adresu jest uniemo\u017cliwiony za po\u015brednictwem robots.txt, kod strony oraz ewentualne znaczniki meta robots nie zostan\u0105 odczytane.<\/p>\n<p>Zdarza si\u0119, \u017ce wyszukiwarka ju\u017c posiada w indeksie adres, kt\u00f3ry zosta\u0142 w p\u00f3\u017aniejszym czasie zablokowany w pliku robots.txt. Jest to widoczne w wynikach wyszukiwania jako:<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/nprofit.net\/pl\/wp-content\/uploads\/2018\/08\/adres-w-indeksie-zablokowany-przez-robots-txt.png\"><\/p>\n<p>U\u017cycie <em>Disallow<\/em> po zaindeksowaniu adresu, nie usuwa go z indeksu, a jedynie zmienia wygl\u0105d na powy\u017cszy. By usun\u0105\u0107 adres ju\u017c obecny w indeksie, nale\u017cy zmieni\u0107 komend\u0119 <em>Disallow<\/em> na <em>Noindex<\/em>.<\/p>\n<p>Interesuj\u0105cy przyk\u0142ad wykorzystania tego mechanizmu jest widoczny po wpisaniu <a href=\"https:\/\/www.google.com\/search?q=world%27s+greatest+seo\">&#8222;world&#8217;s greatest seo&#8221;<\/a> w wyszukiwark\u0119:<br \/>\n<img decoding=\"async\" src=\"https:\/\/nprofit.net\/pl\/wp-content\/uploads\/2018\/08\/worlds-greatest-seo.png\" \/><br \/>\nWiele lat temu Darren Slatten podlinkowa\u0142 z zewn\u0105trz widoczny wy\u017cej adres obcej domeny MattCutts.com (domena nale\u017cy do by\u0142ego kierownika dzia\u0142u zwalczaj\u0105cego spam w wyszukiwarce). Z powodu du\u017cej ilo\u015bci link\u00f3w (z anchorami, kt\u00f3re da\u0142y tytu\u0142 powy\u017cszego wyniku), wyszukiwarka Google doda\u0142a adres do indeksu. Mimo zaindeksowania, roboty nie s\u0105 w stanie do odczyta\u0107 adresu, poniewa\u017c jest on zablokowany w pliku robots.txt domeny MattCutts.com:<\/p>\n<blockquote><p><code>User-agent: *<br \/>\nDisallow: \/files<\/code><\/p><\/blockquote>\n<p>St\u0105d mimo nieistnienia podstrony, pozostaje w wynikach wyszukiwania ju\u017c od ponad 9 lat.<\/p>\n<h3 id=\"7\"><span class=\"ez-toc-section\" id=\"7_Jak_wykluczyc_wszystkie_boty_poza_GoogleBotem\"><\/span>7. Jak wykluczy\u0107 wszystkie boty poza GoogleBotem?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>W internecie spotykane s\u0105 d\u0142ugie listy bot\u00f3w nale\u017c\u0105cych do r\u00f3\u017cnorodnych narz\u0119dzi (Ahrefs, Majestic itd.), jednak wstawianie setek linii wykluczaj\u0105cych boty nie jest potrzebne. Je\u015bli administrator serwera chce ograniczy\u0107 zu\u017cycie zasob\u00f3w na rzecz wszystkich bot\u00f3w poza GoogleBotem, wystarczy wstawienie:<\/p>\n<blockquote><p><code>User-agent: Google<br \/>\nDisallow:<\/code><\/p>\n<p><code>User-agent: *<br \/>\nDisallow: \/<\/code><\/p><\/blockquote>\n<h3><span class=\"ez-toc-section\" id=\"i-8\"><\/span>&nbsp;<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<h3 id=\"8\"><span class=\"ez-toc-section\" id=\"8_Ograniczenia\"><\/span>8. Ograniczenia<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Niekt\u00f3re roboty nie stosuj\u0105 si\u0119 do polece\u0144 zawartych w omawianym pliku, st\u0105d blokowanie dost\u0119pu warto wesprze\u0107 dodatkowymi metodami &#8211; na przyk\u0142ad przekierowaniami lub has\u0142ami chroni\u0105cymi dost\u0119p do katalogu.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"i-9\"><\/span>&nbsp;<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<h3 id=\"9\"><span class=\"ez-toc-section\" id=\"9_Kontrola_poprawnosci_pliku\"><\/span>9. Kontrola poprawno\u015bci pliku<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Po dodaniu strony do Google Search Console, mo\u017cna skontrolowa\u0107 poprawno\u015b\u0107 przygotowanego pliku robots.txt za pomoc\u0105 testera dost\u0119pnego pod adresem: <a href=\"https:\/\/www.google.com\/webmasters\/tools\/robots-testing-tool\">https:\/\/www.google.com\/webmasters\/tools\/robots-testing-tool<\/a>.<br \/>\n[\/vc_column_text][\/vc_column][\/vc_row]<\/p>\n\n\n\n\n\n<div style=\"margin-bottom:-20px\">[rev_slider alias=&#8221;pozycjonowanie&#8221;]<\/div>\n","protected":false},"excerpt":{"rendered":"<p>[rev_slider alias=&#8221;pozycjonowanie&#8221;]<\/p>\n","protected":false},"author":11,"featured_media":43806,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[13],"tags":[],"class_list":["post-6305","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-wiedza-seo"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.0 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Kompendium wiedzy o robots.txt: blokowanie bot\u00f3w, wskazanie map stron, SEO - Blog NPROFIT<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/\" \/>\n<meta property=\"og:locale\" content=\"pl_PL\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Kompendium wiedzy o robots.txt: blokowanie bot\u00f3w, wskazanie map stron, SEO - Blog NPROFIT\" \/>\n<meta property=\"og:description\" content=\"[rev_slider alias=&#8221;pozycjonowanie&#8221;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/\" \/>\n<meta property=\"og:site_name\" content=\"NPROFIT\" \/>\n<meta property=\"article:published_time\" content=\"2018-08-14T13:44:47+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-03-03T12:25:28+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/nprofit.net\/pl\/wp-content\/uploads\/2018\/08\/2151675043-1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1500\" \/>\n\t<meta property=\"og:image:height\" content=\"844\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Kamil Rybicki\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Napisane przez\" \/>\n\t<meta name=\"twitter:data1\" content=\"Kamil Rybicki\" \/>\n\t<meta name=\"twitter:label2\" content=\"Szacowany czas czytania\" \/>\n\t<meta name=\"twitter:data2\" content=\"7 minut\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/\"},\"author\":{\"name\":\"Kamil Rybicki\",\"@id\":\"https:\/\/nprofit.net\/pl\/#\/schema\/person\/92bf22c8ebd1c7b18dbf148defacd529\"},\"headline\":\"Kompendium wiedzy o robots.txt: blokowanie bot\u00f3w, wskazanie map stron, SEO\",\"datePublished\":\"2018-08-14T13:44:47+00:00\",\"dateModified\":\"2026-03-03T12:25:28+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/\"},\"wordCount\":1200,\"publisher\":{\"@id\":\"https:\/\/nprofit.net\/pl\/#organization\"},\"image\":{\"@id\":\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/nprofit.net\/pl\/wp-content\/uploads\/2018\/08\/2151675043-1.jpg\",\"articleSection\":[\"Wiedza SEO\"],\"inLanguage\":\"pl-PL\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/\",\"url\":\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/\",\"name\":\"Kompendium wiedzy o robots.txt: blokowanie bot\u00f3w, wskazanie map stron, SEO - Blog NPROFIT\",\"isPartOf\":{\"@id\":\"https:\/\/nprofit.net\/pl\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/nprofit.net\/pl\/wp-content\/uploads\/2018\/08\/2151675043-1.jpg\",\"datePublished\":\"2018-08-14T13:44:47+00:00\",\"dateModified\":\"2026-03-03T12:25:28+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#breadcrumb\"},\"inLanguage\":\"pl-PL\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"pl-PL\",\"@id\":\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#primaryimage\",\"url\":\"https:\/\/nprofit.net\/pl\/wp-content\/uploads\/2018\/08\/2151675043-1.jpg\",\"contentUrl\":\"https:\/\/nprofit.net\/pl\/wp-content\/uploads\/2018\/08\/2151675043-1.jpg\",\"width\":1500,\"height\":844},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Strona g\u0142\u00f3wna\",\"item\":\"https:\/\/nprofit.net\/pl\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Kompendium wiedzy o robots.txt: blokowanie bot\u00f3w, wskazanie map stron, SEO\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/nprofit.net\/pl\/#website\",\"url\":\"https:\/\/nprofit.net\/pl\/\",\"name\":\"NPROFIT\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/nprofit.net\/pl\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/nprofit.net\/pl\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"pl-PL\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/nprofit.net\/pl\/#organization\",\"name\":\"NPROFIT\",\"url\":\"https:\/\/nprofit.net\/pl\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"pl-PL\",\"@id\":\"https:\/\/nprofit.net\/pl\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/nprofit.net\/pl\/wp-content\/uploads\/2025\/07\/bigLogo.png\",\"contentUrl\":\"https:\/\/nprofit.net\/pl\/wp-content\/uploads\/2025\/07\/bigLogo.png\",\"width\":323,\"height\":50,\"caption\":\"NPROFIT\"},\"image\":{\"@id\":\"https:\/\/nprofit.net\/pl\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/nprofit.net\/pl\/#\/schema\/person\/92bf22c8ebd1c7b18dbf148defacd529\",\"name\":\"Kamil Rybicki\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"pl-PL\",\"@id\":\"https:\/\/nprofit.net\/pl\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/ee333759a7a67c04958b79fed2e66cdd446f429179aeef588293e00f5a67dd27?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/ee333759a7a67c04958b79fed2e66cdd446f429179aeef588293e00f5a67dd27?s=96&d=mm&r=g\",\"caption\":\"Kamil Rybicki\"},\"url\":\"https:\/\/nprofit.net\/pl\/blog\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Kompendium wiedzy o robots.txt: blokowanie bot\u00f3w, wskazanie map stron, SEO - Blog NPROFIT","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/","og_locale":"pl_PL","og_type":"article","og_title":"Kompendium wiedzy o robots.txt: blokowanie bot\u00f3w, wskazanie map stron, SEO - Blog NPROFIT","og_description":"[rev_slider alias=&#8221;pozycjonowanie&#8221;]","og_url":"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/","og_site_name":"NPROFIT","article_published_time":"2018-08-14T13:44:47+00:00","article_modified_time":"2026-03-03T12:25:28+00:00","og_image":[{"width":1500,"height":844,"url":"https:\/\/nprofit.net\/pl\/wp-content\/uploads\/2018\/08\/2151675043-1.jpg","type":"image\/jpeg"}],"author":"Kamil Rybicki","twitter_card":"summary_large_image","twitter_misc":{"Napisane przez":"Kamil Rybicki","Szacowany czas czytania":"7 minut"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#article","isPartOf":{"@id":"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/"},"author":{"name":"Kamil Rybicki","@id":"https:\/\/nprofit.net\/pl\/#\/schema\/person\/92bf22c8ebd1c7b18dbf148defacd529"},"headline":"Kompendium wiedzy o robots.txt: blokowanie bot\u00f3w, wskazanie map stron, SEO","datePublished":"2018-08-14T13:44:47+00:00","dateModified":"2026-03-03T12:25:28+00:00","mainEntityOfPage":{"@id":"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/"},"wordCount":1200,"publisher":{"@id":"https:\/\/nprofit.net\/pl\/#organization"},"image":{"@id":"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#primaryimage"},"thumbnailUrl":"https:\/\/nprofit.net\/pl\/wp-content\/uploads\/2018\/08\/2151675043-1.jpg","articleSection":["Wiedza SEO"],"inLanguage":"pl-PL"},{"@type":"WebPage","@id":"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/","url":"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/","name":"Kompendium wiedzy o robots.txt: blokowanie bot\u00f3w, wskazanie map stron, SEO - Blog NPROFIT","isPartOf":{"@id":"https:\/\/nprofit.net\/pl\/#website"},"primaryImageOfPage":{"@id":"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#primaryimage"},"image":{"@id":"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#primaryimage"},"thumbnailUrl":"https:\/\/nprofit.net\/pl\/wp-content\/uploads\/2018\/08\/2151675043-1.jpg","datePublished":"2018-08-14T13:44:47+00:00","dateModified":"2026-03-03T12:25:28+00:00","breadcrumb":{"@id":"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#breadcrumb"},"inLanguage":"pl-PL","potentialAction":[{"@type":"ReadAction","target":["https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/"]}]},{"@type":"ImageObject","inLanguage":"pl-PL","@id":"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#primaryimage","url":"https:\/\/nprofit.net\/pl\/wp-content\/uploads\/2018\/08\/2151675043-1.jpg","contentUrl":"https:\/\/nprofit.net\/pl\/wp-content\/uploads\/2018\/08\/2151675043-1.jpg","width":1500,"height":844},{"@type":"BreadcrumbList","@id":"https:\/\/nprofit.net\/pl\/blog\/robots-txt-seo\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Strona g\u0142\u00f3wna","item":"https:\/\/nprofit.net\/pl\/"},{"@type":"ListItem","position":2,"name":"Kompendium wiedzy o robots.txt: blokowanie bot\u00f3w, wskazanie map stron, SEO"}]},{"@type":"WebSite","@id":"https:\/\/nprofit.net\/pl\/#website","url":"https:\/\/nprofit.net\/pl\/","name":"NPROFIT","description":"","publisher":{"@id":"https:\/\/nprofit.net\/pl\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/nprofit.net\/pl\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"pl-PL"},{"@type":"Organization","@id":"https:\/\/nprofit.net\/pl\/#organization","name":"NPROFIT","url":"https:\/\/nprofit.net\/pl\/","logo":{"@type":"ImageObject","inLanguage":"pl-PL","@id":"https:\/\/nprofit.net\/pl\/#\/schema\/logo\/image\/","url":"https:\/\/nprofit.net\/pl\/wp-content\/uploads\/2025\/07\/bigLogo.png","contentUrl":"https:\/\/nprofit.net\/pl\/wp-content\/uploads\/2025\/07\/bigLogo.png","width":323,"height":50,"caption":"NPROFIT"},"image":{"@id":"https:\/\/nprofit.net\/pl\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/nprofit.net\/pl\/#\/schema\/person\/92bf22c8ebd1c7b18dbf148defacd529","name":"Kamil Rybicki","image":{"@type":"ImageObject","inLanguage":"pl-PL","@id":"https:\/\/nprofit.net\/pl\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/ee333759a7a67c04958b79fed2e66cdd446f429179aeef588293e00f5a67dd27?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/ee333759a7a67c04958b79fed2e66cdd446f429179aeef588293e00f5a67dd27?s=96&d=mm&r=g","caption":"Kamil Rybicki"},"url":"https:\/\/nprofit.net\/pl\/blog\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/nprofit.net\/pl\/wp-json\/wp\/v2\/posts\/6305","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/nprofit.net\/pl\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nprofit.net\/pl\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nprofit.net\/pl\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"https:\/\/nprofit.net\/pl\/wp-json\/wp\/v2\/comments?post=6305"}],"version-history":[{"count":1,"href":"https:\/\/nprofit.net\/pl\/wp-json\/wp\/v2\/posts\/6305\/revisions"}],"predecessor-version":[{"id":44521,"href":"https:\/\/nprofit.net\/pl\/wp-json\/wp\/v2\/posts\/6305\/revisions\/44521"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/nprofit.net\/pl\/wp-json\/wp\/v2\/media\/43806"}],"wp:attachment":[{"href":"https:\/\/nprofit.net\/pl\/wp-json\/wp\/v2\/media?parent=6305"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nprofit.net\/pl\/wp-json\/wp\/v2\/categories?post=6305"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nprofit.net\/pl\/wp-json\/wp\/v2\/tags?post=6305"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}