mirror of
https://codeberg.org/forgejo/forgejo.git
synced 2024-09-07 15:33:26 +00:00
More extensive robots.txt docs (#9566)
This commit is contained in:
parent
5749b26cdd
commit
143f88d975
2 changed files with 39 additions and 6 deletions
|
@ -44,12 +44,6 @@ environment variable; this can be used to override the default path to something
|
||||||
|
|
||||||
**Note:** Gitea must perform a full restart to see configuration changes.
|
**Note:** Gitea must perform a full restart to see configuration changes.
|
||||||
|
|
||||||
## Customizing /robots.txt
|
|
||||||
|
|
||||||
To make Gitea serve a custom `/robots.txt` (default: empty 404), create a file called
|
|
||||||
`robots.txt` in the `custom` folder (or `CustomPath`) with
|
|
||||||
[expected contents](http://www.robotstxt.org/).
|
|
||||||
|
|
||||||
## Serving custom public files
|
## Serving custom public files
|
||||||
|
|
||||||
To make Gitea serve custom public files (like pages and images), use the folder
|
To make Gitea serve custom public files (like pages and images), use the folder
|
||||||
|
|
39
docs/content/doc/advanced/search-engines-indexation.en-us.md
Normal file
39
docs/content/doc/advanced/search-engines-indexation.en-us.md
Normal file
|
@ -0,0 +1,39 @@
|
||||||
|
---
|
||||||
|
date: "2019-12-31T13:55:00+05:00"
|
||||||
|
title: "Advanced: Search Engines Indexation"
|
||||||
|
slug: "search-engines-indexation"
|
||||||
|
weight: 30
|
||||||
|
toc: true
|
||||||
|
draft: false
|
||||||
|
menu:
|
||||||
|
sidebar:
|
||||||
|
parent: "advanced"
|
||||||
|
name: "Search Engines Indexation"
|
||||||
|
weight: 60
|
||||||
|
identifier: "search-engines-indexation"
|
||||||
|
---
|
||||||
|
|
||||||
|
# Search engines indexation of your Gitea installation
|
||||||
|
|
||||||
|
By default your Gitea installation will be indexed by search engines.
|
||||||
|
If you don't want your repository to be visible for search engines read further.
|
||||||
|
|
||||||
|
## Block search engines indexation using robots.txt
|
||||||
|
|
||||||
|
To make Gitea serve a custom `robots.txt` (default: empty 404) for top level installations,
|
||||||
|
create a file called `robots.txt` in the [`custom` folder or `CustomPath`]({{< relref "doc/advanced/customizing-gitea.en-us.md" >}})
|
||||||
|
|
||||||
|
Examples on how to configure the `robots.txt` can be found at [https://moz.com/learn/seo/robotstxt](https://moz.com/learn/seo/robotstxt).
|
||||||
|
|
||||||
|
|
||||||
|
```txt
|
||||||
|
User-agent: *
|
||||||
|
Disallow: /
|
||||||
|
```
|
||||||
|
|
||||||
|
If you installed Gitea in a subdirectory, you will need to create or edit the `robots.txt` in the top level directory.
|
||||||
|
|
||||||
|
```txt
|
||||||
|
User-agent: *
|
||||||
|
Disallow: /gitea/
|
||||||
|
```
|
Loading…
Reference in a new issue