Robots: what search engines may crawl

Sep 27, 2026 1 min read

The robots.txt file tells search engines which parts of your site they may crawl. On this screen you edit its content directly.

The usual setup

For most sites it is enough to allow everything and point to the sitemap:

User-agent: *
Allow: /

Sitemap: https://www.mycompany.com/sitemap.xml

The Sitemap: line is added automatically when you generate the sitemap.

Be careful

Disallow: / blocks your whole site on Google. Do not use it unless you want it hidden.
Blocking a page in robots.txt does not make it private: it only asks search engines not to crawl it.

Click Generate to save your changes.

← Back to the help center

OTHER ARTICLES

Category: Help

Setup wizard: your site ready in a few steps

The setup wizard guides you through the essentials to get a site with content. It opens when you create a site, and you can come back to it any time from the menu. Each step saves and moves on to the next by itself.The stepsStart: languages, default language, logo, white logo, favicon and site...

Category: Help

Billing: your edeck.me plan

Billing is what edeck.me charges you for your site. It has nothing to do with what your store charges your customers, which is set up in Payment methods.Getting startedYou can create and edit your site as much as you like without a plan.To publish it, choose a plan and click Start 30-day...