robots.txt產生器
開發者工具使用者代理規則、AI爬蟲限制與網站地圖設定
答案速覽
robots.txt Generator: UA rules + AI bots + Sitemap. robots.txt Generator uses standard developer formulas to compute accurate results instantly.
robots.txt
User-agent: * Disallow: /admin/ Disallow: /api/ Disallow: /tmp/ Sitemap: https://example.com/sitemap.xml
語法速查
| User-agent: * | Applies to all crawlers |
| Disallow: /admin/ | Block path prefix |
| Disallow:(留空) | Empty = allow all |
| Allow: /public/ | Exception inside a disallow |
| Disallow: /*? | Wildcard support |
| Disallow: /*.pdf$ | End anchor |
| Crawl-delay: 10 | Politeness delay |
| Sitemap: https://… | Sitemap location |
robots.txt 是公開約定而非存取控制——惡意爬蟲根本不理會,且所有人都能存取 /robots.txt 查看內容(別把敏感路徑寫進去,等於廣而告之)。真正需要保護的內容請用鑑權。注意:被 robots.txt 禁止的頁面若被外鏈引用,仍可能以「無摘要」形式出現在搜尋結果中;想徹底移出索引要用 noindex meta。Google 忽略 Crawl-delay,其抓取速率需在 Search Console 中設定。
這個工具對你有幫助嗎?
怎麼用
- Paste or type content: drop code/text into the robots.txt Generator or fill the parameters.
- Choose mode/options: switch format, rules or processing as needed.
- Live output: results appear instantly — nothing is submitted, data stays in your browser.
- One-click copy: copy the output straight into your development environment.
核心要點
- robots.txt Generator is a free online developer tool — open and use, no sign-up.
- All calculations run locally in your browser; your data never leaves the device.
- Key capability: UA rules + AI bots + Sitemap.
- Results come with formulas and reference tables so you can verify every number.
原理與公式
robots.txt Generator formula
robots.txt Generator uses standard developer formulas to compute accurate results instantly.
常見問題
How do I use the robots.txt Generator?
Open the page and fill in the input fields — results update automatically. UA rules + AI bots + Sitemap.
Are the results accurate?
Yes. Standard formulas and conversion factors are used and verified.
Is it free? Do I need to sign up?
Completely free. No registration, login or download required.
Does it work on mobile?
Yes. The responsive design works on phones, tablets and desktops.
Is my data saved?
No. Everything runs locally in your browser.
相關工具
相關指南
來源與更新
Based on RFC 4648, ECMA-262 and related specifications. Last updated: 2025-07
最近更新:
本頁公式與內容經YiJianSuan團隊覆核,僅供學習參考,實際業務請以官方口徑為準。
內容由YiJianSuan編輯團隊維護並定期覆核,更新與審核流程詳見編輯規範.
引用本頁: YiJianSuan. robots.txt產生器[EB/OL]. https://www.yijiansuan.com/zh-TW/c/dev/robots-txt
本工具提供的結果僅供參考,不構成任何專業建議,請以官方核算為準。