---
title: How do I update a robots.txt file in a Webflow Project?
description: This SOP outlines the step-by-step process for updating the robots.txt file in a Webflow project.
---

[Skip to content](https://grow.dentalmarketing.com/university/how-do-i-update-a-robots-txt-file-in-webflow#main-content)

English

Show submenu for translations

[Customer portal](https://grow.dentalmarketing.com/tickets-view?hsLang=en)

![DentalMarketing-Logo2-White copy-1.png\]](https://grow.dentalmarketing.com/hs-fs/hubfs/DentalMarketing-Logo2-White%20copy-1.png?height=40&name=DentalMarketing-Logo2-White%20copy-1.png)

Open main navigation

Close main navigation

- English
  
  Show submenu for translations
- [Customer portal](https://grow.dentalmarketing.com/tickets-view)
- [Don't see the SOP you're looking for? Submit your suggestion here.](https://share.hsforms.com/1Fk5_GHeGTTqeJyg4BwR0CAdihez)

[Don't see the SOP you're looking for? Submit your suggestion here.](https://share.hsforms.com/1Fk5_GHeGTTqeJyg4BwR0CAdihez)

 Welcome! What article can we help you find?

- There are no suggestions because the search field is empty.

1. [Internal](https://grow.dentalmarketing.com/university?hsLang=en)
2. [Creative Team SOPs](https://grow.dentalmarketing.com/university/creative-team-sops?hsLang=en)

# How do I update a robots.txt file in a Webflow Project?

## This SOP outlines the step-by-step process for updating the robots.txt file in a Webflow project.

### Overview

⚠️ This SOP is under construction, if you don't find the step-by-step for your scenario, please reach out to the Creative Lead for support.

- Required Technology
- Step-by-step 
    - Status: Buildout 
          - [Home Page LP](https://grow.dentalmarketing.com/university/how-do-i-update-a-robots-txt-file-in-webflow#buildout-home-lp)
    - Status: Post Launch 
          - [Full Site](https://grow.dentalmarketing.com/university/how-do-i-update-a-robots-txt-file-in-webflow#post-launch-full)

### Required Technology

1. Webflow Access 
     1. To update the settings in the project.

### Step-by-step

1. Login into Webflow.
2. Locate the project you need to update.
3. Go to settings "SEO" tab.
4. Make sure the "Sitemap" for the option "Auto-generate sitemap" is turned on, if not, turn on and republish into "Staging" and "Production".
5. Access the sitemap via the domain.com/sitemap.xml
6. By default, all robots.txt should include the following rules:

```
User-agent: * Disallow: /*?*Disallow: /*utm_*Disallow: /utility-pages/Disallow: /thank-you-flexbookDisallow: /thank-youDisallow: /no-insurance
```

7\. Determine the scenario, project type and stage of each project:

#### Status: Buildout

 

| **Project Type** | Home Page LP |
| --- | --- |
| **Status** | Home Page LP Buildout |
| **Live Projects** | - Coming Soon LP |

 

1. Add [default values](https://grow.dentalmarketing.com/university/how-do-i-update-a-robots-txt-file-in-webflow#default-values) to robots.txt file
2. Disallow the following URLs:

```
Disallow: /HOME-PAGE-LP-URLDisallow: /ada-accessibilityDisallow: /privacy-policyDisallow: /disclaimer
```

 

#### Status: Post Launch

 

| **Project Type** | Full Site |
| --- | --- |
| **Status** | Full Site Launched |
| **Live Projects** | None |

No additional action needed, only default rules are required.

 

- [Paid Media SOPs](https://grow.dentalmarketing.com/university/paid-media-sops?hsLang=en#main-content)

    - [Account Management & Updates](https://grow.dentalmarketing.com/university/paid-media-sops?hsLang=en#account-management-updates)
    - [Facebook Ads](https://grow.dentalmarketing.com/university/paid-media-sops?hsLang=en#facebook-ads)
    - [Google Ads](https://grow.dentalmarketing.com/university/paid-media-sops?hsLang=en#google-ads)
    - [Microsoft Ads](https://grow.dentalmarketing.com/university/paid-media-sops?hsLang=en#microsoft-ads)
    - [GMB](https://grow.dentalmarketing.com/university/paid-media-sops?hsLang=en#gmb)
    - [SEO](https://grow.dentalmarketing.com/university/paid-media-sops?hsLang=en#seo)
    - [Optmyzr](https://grow.dentalmarketing.com/university/paid-media-sops?hsLang=en#optmyzr)
    - [Google Analytics](https://grow.dentalmarketing.com/university/paid-media-sops?hsLang=en#google-analytics)
    - [Google Tag Manager](https://grow.dentalmarketing.com/university/paid-media-sops?hsLang=en#google-tag-manager)
    - [Google Ads Editor](https://grow.dentalmarketing.com/university/paid-media-sops?hsLang=en#google-ads-editor)
- [Creative Team SOPs](https://grow.dentalmarketing.com/university/creative-team-sops?hsLang=en#main-content)

    - [Mail LP](https://grow.dentalmarketing.com/university/creative-team-sops?hsLang=en#mail-lp)
    - [Lost Client](https://grow.dentalmarketing.com/university/creative-team-sops?hsLang=en#lost-client)
- [Client Success SOPs](https://grow.dentalmarketing.com/university/client-success-sops?hsLang=en#main-content)

    - [Photoshoot](https://grow.dentalmarketing.com/university/client-success-sops?hsLang=en#photoshoot)
    - [Claude Design Landing Pages](https://grow.dentalmarketing.com/university/client-success-sops?hsLang=en#claude-design-landing-pages)
- [Technology SOPs](https://grow.dentalmarketing.com/university/technology-sops?hsLang=en#main-content)

    - [Dashboard](https://grow.dentalmarketing.com/university/technology-sops?hsLang=en#dashboard)
    - [ChatGPT](https://grow.dentalmarketing.com/university/technology-sops?hsLang=en#chatgpt)
    - [HubSpot](https://grow.dentalmarketing.com/university/technology-sops?hsLang=en#hubspot)
    - [Other](https://grow.dentalmarketing.com/university/technology-sops?hsLang=en#other)
- [Company Information SOPs](https://grow.dentalmarketing.com/university/company-information-sops?hsLang=en)
- [Direct Mail SOPs](https://grow.dentalmarketing.com/university/direct-mail-sops?hsLang=en)
- [Organic Social Media SOPs](https://grow.dentalmarketing.com/university/organic-social-media-sops?hsLang=en#main-content)

    - [Content Creation](https://grow.dentalmarketing.com/university/organic-social-media-sops?hsLang=en#content-creation)
    - [OB Process](https://grow.dentalmarketing.com/university/organic-social-media-sops?hsLang=en#ob-process)
- [Compliance Team SOPs](https://grow.dentalmarketing.com/university/compliance-team-sops?hsLang=en#main-content)

    - [WhatConverts](https://grow.dentalmarketing.com/university/compliance-team-sops?hsLang=en#whatconverts)
    - [Tickets](https://grow.dentalmarketing.com/university/compliance-team-sops?hsLang=en#tickets)
    - [Edits](https://grow.dentalmarketing.com/university/compliance-team-sops?hsLang=en#edits)
    - [Websites](https://grow.dentalmarketing.com/university/compliance-team-sops?hsLang=en#websites)
- [Onboarding SOPs](https://grow.dentalmarketing.com/university/onboarding-sops?hsLang=en)
- [Content Creation SOPs](https://grow.dentalmarketing.com/university/content-creation-sops?hsLang=en)
- [Creative Support](https://grow.dentalmarketing.com/university/creative-support?hsLang=en#main-content)

    - [Ticket Creation](https://grow.dentalmarketing.com/university/creative-support?hsLang=en#ticket-creation)

# Dentalmarketing.com

dentalmarketing.com Help Center

Copyright © 2026, Dentalmarketing.com