starred/headscale
1
0
Fork 0
mirror of https://github.com/juanfont/headscale.git synced 2026-01-11 20:00:28 +01:00
Code Issues 98 Packages Projects Releases 10 Wiki Activity

[Feature] add robots.txt to headscale #1001

New Issue
Closed
opened 2025-12-29 02:27:16 +01:00 by adam · 1 comment
adam commented 2025-12-29 02:27:16 +01:00
Owner
Copy Link

Originally created by @ykuksenko on GitHub (Apr 16, 2025).

Use case

Tailscale derp servers serve a robots.txt to avoid being hit by crawlers. Headscale should probably do this too.

see derp servers list or this derp server /robots.txt to verify my claim.

Description

$HEADSCALE_URL/robots.txt should be populated with:

User-agent: *
Disallow: /

Contribution

  • I can write the design doc for this feature
  • I can contribute this feature

How can it be implemented?

No response

edit: This may be needed for the server itself vs just derp - not sure where the line is for that with headscale.
edit2: I think I can submit a PR for this from a quick glance at the code.

Originally created by @ykuksenko on GitHub (Apr 16, 2025). ### Use case Tailscale derp servers serve a `robots.txt` to avoid being hit by crawlers. Headscale should probably do this too. see [derp servers list](https://login.tailscale.com/derpmap/default) or [this derp server /robots.txt](https://derp1g.tailscale.com/robots.txt) to verify my claim. ### Description $HEADSCALE_URL/robots.txt should be populated with: ``` User-agent: * Disallow: / ``` ### Contribution - [ ] I can write the design doc for this feature - [ ] I can contribute this feature ### How can it be implemented? _No response_ edit: This may be needed for the server itself vs just derp - not sure where the line is for that with headscale. edit2: I think I can submit a PR for this from a quick glance at the code.
adam added the enhancementgood first issueno-stale-bot labels 2025-12-29 02:27:16 +01:00
adam closed this issue 2025-12-29 02:27:16 +01:00
adam commented 2025-12-29 02:27:17 +01:00
Author
Owner
Copy Link

@kradalby commented on GitHub (May 5, 2025):

Good idea, PR would be appreciated!

@kradalby commented on GitHub (May 5, 2025): Good idea, PR would be appreciated!
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
CLI
DERP
DNS
Nix
OIDC
SSH
bug
database
documentation
duplicate
enhancement
faq
good first issue
grants
help wanted
might-come
needs design doc
needs investigation
no-stale-bot
out of scope
performance
policy 📝
pull-request
Mirrored from GitHub Pull Request
 question
regression
routes
stale
tags
tailscale-feature-gap
well described ❤️
wontfix
No Label enhancement good first issue no-stale-bot
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
adam
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: starred/headscale#1001
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?