Nodes drop from map poll. #527

New Issue

adam · 2025-12-29T02:19:33+01:00

adam commented

2025-12-29 02:19:33 +01:00

Originally created by @gbraad on GitHub (Jul 2, 2023).

Bug description

They register correctly, but drop from map poll.
These nodes work without issues when using the TS coordination server.

Environment

OS: F38
Headscale version: RPM reports dev :-/
Tailscale version: 0.44.1
Headscale is behind a (reverse) proxy
Headscale runs in a container

To Reproduce

register nodes to headscale
systemctl restart tailscaled
tailscale status

$ tailscale status         
fd7a:115c:a1e0::3 t460p-debsys         spotsnel     linux   -
fd7a:115c:a1e0::1 t460p-devsys         spotsnel     linux   -
$ tailscale status
fd7a:115c:a1e0::3 t460p-debsys         spotsnel     linux   offline
fd7a:115c:a1e0::1 t460p-devsys         spotsnel     linux   -
$ tailscale status
fd7a:115c:a1e0::3 t460p-debsys         spotsnel     linux   offline
fd7a:115c:a1e0::1 t460p-devsys         spotsnel     linux   -

# Health check:
#     - not in map poll

$ journalctl -u tailscaled
...
Jul 02 12:45:50 t460p-debsys tailscaled[956]: health("overall"): ok
Jul 02 12:46:20 t460p-debsys tailscaled[956]: health("overall"): error: not in map poll

Jul 02 12:44:56 t460p-devsys tailscaled[3520]: health("overall"): ok
Jul 02 12:45:30 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ...
Jul 02 12:45:35 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ...
Jul 02 12:45:40 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ...
Jul 02 12:45:45 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ...
Jul 02 12:45:50 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ...
Jul 02 12:45:52 t460p-devsys tailscaled[3520]: health("overall"): error: not in map poll
Jul 02 12:45:55 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ...
Jul 02 12:46:00 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ...
Jul 02 12:46:01 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ...

$ headscale nodes list
ID | Hostname     | Name         | MachineKey | NodeKey | User     | IP addresses                  | Ephemeral | Last seen           | Expiration          | Online | Expired
3  | t460p-debsys | t460p-debsys | [g2o9T]    | [/2tfD] | spotsnel | 100.64.0.3, fd7a:115c:a1e0::3 | false     | 2023-07-02 13:03:49 | 0001-01-01 00:00:00 | online | no
4  | t460p-devsys | t460p-devsys | [hgvC8]    | [HZpg7] | spotsnel | 100.64.0.1, fd7a:115c:a1e0::1 | false     | 2023-07-02 13:03:47 | 0001-01-01 00:00:00 | online | no

Originally created by @gbraad on GitHub (Jul 2, 2023). ## Bug description They register correctly, but drop from map poll. These nodes work without issues when using the TS coordination server. ## Environment - OS: F38 - Headscale version: RPM reports `dev` :-/ - Tailscale version: 0.44.1 - [ ] Headscale is behind a (reverse) proxy - [ ] Headscale runs in a container ## To Reproduce * register nodes to headscale * `systemctl restart tailscaled` * `tailscale status` ``` $ tailscale status fd7a:115c:a1e0::3 t460p-debsys spotsnel linux - fd7a:115c:a1e0::1 t460p-devsys spotsnel linux - $ tailscale status fd7a:115c:a1e0::3 t460p-debsys spotsnel linux offline fd7a:115c:a1e0::1 t460p-devsys spotsnel linux - $ tailscale status fd7a:115c:a1e0::3 t460p-debsys spotsnel linux offline fd7a:115c:a1e0::1 t460p-devsys spotsnel linux - # Health check: # - not in map poll ``` ``` $ journalctl -u tailscaled ... Jul 02 12:45:50 t460p-debsys tailscaled[956]: health("overall"): ok Jul 02 12:46:20 t460p-debsys tailscaled[956]: health("overall"): error: not in map poll ``` ``` Jul 02 12:44:56 t460p-devsys tailscaled[3520]: health("overall"): ok Jul 02 12:45:30 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ... Jul 02 12:45:35 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ... Jul 02 12:45:40 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ... Jul 02 12:45:45 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ... Jul 02 12:45:50 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ... Jul 02 12:45:52 t460p-devsys tailscaled[3520]: health("overall"): error: not in map poll Jul 02 12:45:55 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ... Jul 02 12:46:00 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ... Jul 02 12:46:01 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ... ``` ``` $ headscale nodes list ID | Hostname | Name | MachineKey | NodeKey | User | IP addresses | Ephemeral | Last seen | Expiration | Online | Expired 3 | t460p-debsys | t460p-debsys | [g2o9T] | [/2tfD] | spotsnel | 100.64.0.3, fd7a:115c:a1e0::3 | false | 2023-07-02 13:03:49 | 0001-01-01 00:00:00 | online | no 4 | t460p-devsys | t460p-devsys | [hgvC8] | [HZpg7] | spotsnel | 100.64.0.1, fd7a:115c:a1e0::1 | false | 2023-07-02 13:03:47 | 0001-01-01 00:00:00 | online | no ```

adam added the bug label 2025-12-29 02:19:33 +01:00

adam closed this issue

2025-12-29 02:19:33 +01:00

adam commented

2025-12-29 02:19:33 +01:00

@gbraad commented on GitHub (Jul 2, 2023):

I added another node and can ping both VMs without an issue. They also show as online now.

What causes not in map poll ?
Is this related to: #1501 ?

Update: about an hour later, still report as online.

Did notice the following in the logs:

Jul 02 12:45:50 t460p-debsys tailscaled[956]: health("overall"): ok
Jul 02 12:46:20 t460p-debsys tailscaled[956]: health("overall"): error: not in map poll
Jul 02 13:02:46 t460p-debsys tailscaled[956]: Received error: PollNetMap: Post "https://headscale....>
Jul 02 13:02:49 t460p-debsys tailscaled[956]: health("overall"): ok
Jul 02 13:11:50 t460p-debsys tailscaled[956]: wgengine: Reconfig: configuring userspace WireGuard config (with 0/2 pee>
Jul 02 13:11:50 t460p-debsys tailscaled[956]: wgengine: Reconfig: configuring router
Jul 02 13:11:50 t460p-debsys tailscaled[956]: wgengine: Reconfig: configuring DNS

Jul 02 12:46:36 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ...
Jul 02 12:46:41 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ...
Jul 02 12:46:46 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ...
Jul 02 13:01:45 t460p-devsys tailscaled[3520]: Received error: PollNetMap: Post "https://headscale....>
Jul 02 13:01:47 t460p-devsys tailscaled[3520]: health("overall"): ok
Jul 02 13:01:47 t460p-devsys tailscaled[3520]: wgengine: Reconfig: [/2tfD] changed from "discokey:678ffbc9ed2bc06183d0>
Jul 02 13:11:57 t460p-devsys tailscaled[3520]: wgengine: Reconfig: configuring userspace WireGuard config (with 0/2 pe>
Jul 02 13:11:57 t460p-devsys tailscaled[3520]: wgengine: Reconfig: configuring router
Jul 02 13:11:57 t460p-devsys tailscaled[3520]: wgengine: Reconfig: configuring DNS
...

for both of these nodes.

Received error: PollNetMap: Post ...

@gbraad commented on GitHub (Jul 2, 2023): I added another node and can ping both VMs without an issue. They also show as `online` now. What causes `not in map poll` ? Is this related to: #1501 ? --- Update: about an hour later, still report as online. Did notice the following in the logs: ``` Jul 02 12:45:50 t460p-debsys tailscaled[956]: health("overall"): ok Jul 02 12:46:20 t460p-debsys tailscaled[956]: health("overall"): error: not in map poll Jul 02 13:02:46 t460p-debsys tailscaled[956]: Received error: PollNetMap: Post "https://headscale....> Jul 02 13:02:49 t460p-debsys tailscaled[956]: health("overall"): ok Jul 02 13:11:50 t460p-debsys tailscaled[956]: wgengine: Reconfig: configuring userspace WireGuard config (with 0/2 pee> Jul 02 13:11:50 t460p-debsys tailscaled[956]: wgengine: Reconfig: configuring router Jul 02 13:11:50 t460p-debsys tailscaled[956]: wgengine: Reconfig: configuring DNS ``` ``` Jul 02 12:46:36 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ... Jul 02 12:46:41 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ... Jul 02 12:46:46 t460p-devsys tailscaled[3520]: ping(100.64.0.3): sending disco ping to [/2tfD] t460p-debsys ... Jul 02 13:01:45 t460p-devsys tailscaled[3520]: Received error: PollNetMap: Post "https://headscale....> Jul 02 13:01:47 t460p-devsys tailscaled[3520]: health("overall"): ok Jul 02 13:01:47 t460p-devsys tailscaled[3520]: wgengine: Reconfig: [/2tfD] changed from "discokey:678ffbc9ed2bc06183d0> Jul 02 13:11:57 t460p-devsys tailscaled[3520]: wgengine: Reconfig: configuring userspace WireGuard config (with 0/2 pe> Jul 02 13:11:57 t460p-devsys tailscaled[3520]: wgengine: Reconfig: configuring router Jul 02 13:11:57 t460p-devsys tailscaled[3520]: wgengine: Reconfig: configuring DNS ... ``` for both of these nodes. ``` Received error: PollNetMap: Post ... ```

adam commented

2025-12-29 02:19:34 +01:00

@gbraad commented on GitHub (Jul 3, 2023):

Tested in a larger setup, restarted some of the nodes. Not seeing the same problem.
I will close it until this happens again.

@gbraad commented on GitHub (Jul 3, 2023): Tested in a larger setup, restarted some of the nodes. Not seeing the same problem. I will close it until this happens again.

Sign in to join this conversation.

Branches Tags

main

update_flake_lock_action

gh-pages

kradalby/release-v0.27.2

dependabot/go_modules/golang.org/x/crypto-0.45.0

dependabot/go_modules/github.com/opencontainers/runc-1.3.3

copilot/investigate-headscale-issue-2788

copilot/investigate-visibility-issue-2788

copilot/investigate-issue-2833

copilot/debug-issue-2846

copilot/fix-issue-2847

dependabot/go_modules/github.com/go-viper/mapstructure/v2-2.4.0

dependabot/go_modules/github.com/docker/docker-28.3.3incompatible

kradalby/cli-experiement3

doc/0.26.1

doc/0.25.1

doc/0.25.0

doc/0.24.3

doc/0.24.2

doc/0.24.1

doc/0.24.0

kradalby/build-docker-on-pr

topic/docu-versioning

topic/docker-kos

juanfont/fix-crash-node-id

juanfont/better-disclaimer

update-contributors

topic/prettier

revert-1893-add-test-stage-to-docs

add-test-stage-to-docs

remove-node-check-interval

fix-empty-prefix

fix-ephemeral-reusable

bug_report-debuginfo

autogroups

logs-to-stderr

revert-1414-topic/fix_unix_socket

rename-machine-node

port-embedded-derp-tests-v2

port-derp-tests

duplicate-word-linter

update-tailscale-1.36

warn-against-apache

ko-fi-link

more-acl-tests

fix-typo-standalone

parallel-nolint

tparallel-fix

rerouting

ssh-changelog-docs

oidc-cleanup

web-auth-flow-tests

kradalby-gh-runner

fix-proto-lint

remove-funding-links

go-1.19

enable-1.30-in-tests

0.16.x

cosmetic-changes-integration

tmp-fix-integration-docker

fix-integration-docker

configurable-update-interval

show-nodes-online

hs2021

acl-syntax-fixes

ts2021-implementation

fix-spurious-updates

unstable-integration-tests

mandatory-stun

embedded-derp

prtemplate-fix

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: starred/headscale#527