---
metadata:
  - name: generator
    content: Diplodoc Platform v5.54.2
alternate:
  - https://www.yandex.com/support/webmaster/en/robot-workings/crawl-delay.md
  - https://www.yandex.com/support/webmaster/tr/robot-workings/crawl-delay.md
  - href: en/robot-workings/crawl-delay.md
    type: text/markdown
    title: Markdown version
  - href: ../llms.txt
    type: text/markdown
    title: llms.txt
---
> **Documentation Index:** Fetch the complete configuration index at https://www.yandex.com/support/webmaster/en/llms.txt


# The Crawl-delay directive

From February 22, 2018, Yandex doesn't take into account the Crawl-delay directive.

To set the rate at which the indexing bots should access your site's pages, use the [site crawl rate](https://www.yandex.com/support/webmaster/en/service/crawl-rate.md) setting in Yandex Webmaster.


<div class="cut-button">

{% cut "Contact support" %}




<div style="padding: 15px;
      margin: 10px 0;
      background: #FFFFFF;
      border-radius: 10px;
      border: 1px solid var(--yc-color-line-generic);">
<iframe style="background: #FFFFFF;"
      height="700"
      width="100%"
      frameborder="0"
      src="https://forms.yandex.com/surveys/4547/?&iframe=1&lang=en">
</iframe>
</div>




{% endcut %}

</div>


<!-- source: en/_includes/cut-button-style.md -->

<!-- endsource: en/_includes/cut-button-style.md -->

<!-- source: en/_includes/footer.md -->
<div width="100%" align="center" class="main-footer"> 
<br><br><br>
You can also go to 
<br><br>




[![](../_assets/logo/logo-pic.svg)](https://webmaster.yandex.com/) [![](../_assets/logo/logo-en.svg)](https://webmaster.yandex.com/)



</div>


<!-- source: en/_includes/styles/footer-style.md -->

<!-- endsource: en/_includes/styles/footer-style.md -->
<!-- endsource: en/_includes/footer.md -->