Yes. If you wish to block files in your file manager, such as a PDF document, from being indexed by search engines, you will need to select a connected subdomain for the file(s) and use the file URL to be blocked from crawlers.
The default file URL looks like this. Notice 'CDN' as the subdomain:
Selecting a connected subdomain looks like this:
To select a connected subdomain:
- Go to Content > File Manager
- Locate the file you wish to block from crawlers > Click the gear > Get File URL
- Click the dropdown to select a connected subdomain. A connected subdomain will display your company's domain, such as www.your-company.com or info.your-company.org
- You may use this new file URL containing your company's connected subdomain when blocking the file from being indexed by search engines via a Robots.txt file. To install a Robots.txt file, click here to learn more.