Skip to main content

aiguiderpro.com

Start the conversation

Glossary

Crawl Budget

Crawl budget is the number of pages a crawler will fetch from a site in a given period. Unlike index coverage, it constrains discovery rather than inclusion.

Crawl budget is the number of pages a crawler will fetch from a site in a given period. Unlike index coverage, it constrains discovery rather than inclusion.