Jul 30 12:56:22 node17 pvestatd[1702]: got timeout Jul 30 12:56:24 node17 pmxcfs[29857]: [status] notice: received log Jul 30 12:56:24 node17 pvestatd[1702]: status update time (11.861 seconds) Jul 30 12:56:39 node17 pmxcfs[29857]: [status] notice: received log Jul 30 12:56:48 node17 pmxcfs[29857]: [status] notice: received log Jul 30 12:56:54 node17 pmxcfs[29857]: [status] notice: received log Jul 30 12:57:00 node17 systemd[1]: Starting Proxmox VE replication runner... Jul 30 12:57:01 node17 systemd[1]: pvesr.service: Succeeded. Jul 30 12:57:01 node17 systemd[1]: Started Proxmox VE replication runner. Jul 30 12:57:09 node17 pmxcfs[29857]: [status] notice: received log Jul 30 12:57:24 node17 pmxcfs[29857]: [status] notice: received log Jul 30 12:57:39 node17 pmxcfs[29857]: [status] notice: received log Jul 30 12:57:41 node17 smartd[1200]: Device: /dev/sdd [SAT], SMART Usage Attribute: 190 Drive_Temperature changed from 77 to 76 Jul 30 12:57:54 node17 pmxcfs[29857]: [status] notice: received log Jul 30 12:58:00 node17 systemd[1]: Starting Proxmox VE replication runner... Jul 30 12:58:01 node17 systemd[1]: pvesr.service: Succeeded. Jul 30 12:58:01 node17 systemd[1]: Started Proxmox VE replication runner. Jul 30 12:58:09 node17 pmxcfs[29857]: [status] notice: received log Jul 30 12:58:09 node17 dhclient[1295]: DHCPDISCOVER on vmbr0 to 255.255.255.255 port 67 interval 7 Jul 30 12:58:16 node17 dhclient[1295]: DHCPDISCOVER on vmbr0 to 255.255.255.255 port 67 interval 13 Jul 30 12:58:24 node17 pmxcfs[29857]: [status] notice: received log Jul 30 12:58:29 node17 dhclient[1295]: DHCPDISCOVER on vmbr0 to 255.255.255.255 port 67 interval 17 Jul 30 12:58:39 node17 pmxcfs[29857]: [status] notice: received log Jul 30 12:58:46 node17 dhclient[1295]: DHCPDISCOVER on vmbr0 to 255.255.255.255 port 67 interval 19 Jul 30 12:58:54 node17 pmxcfs[29857]: [status] notice: received log Jul 30 12:59:00 node17 systemd[1]: Starting Proxmox VE replication runner... Jul 30 12:59:01 node17 systemd[1]: pvesr.service: Succeeded. Jul 30 12:59:01 node17 systemd[1]: Started Proxmox VE replication runner. Jul 30 12:59:05 node17 dhclient[1295]: DHCPDISCOVER on vmbr0 to 255.255.255.255 port 67 interval 5 Jul 30 12:59:09 node17 pmxcfs[29857]: [status] notice: received log Jul 30 12:59:10 node17 dhclient[1295]: No DHCPOFFERS received. Jul 30 12:59:10 node17 dhclient[1295]: No working leases in persistent database - sleeping. Jul 30 12:59:23 node17 pmxcfs[29857]: [dcdb] notice: members: 2/2678, 3/2110, 4/2039, 5/2060, 6/1601652, 7/2078, 8/2464, 9/2044, 10/2000, 11/25251, 12/13205, 13/29857 Jul 30 12:59:23 node17 pmxcfs[29857]: [dcdb] notice: starting data syncronisation Jul 30 12:59:23 node17 pmxcfs[29857]: [status] notice: members: 2/2678, 3/2110, 4/2039, 5/2060, 6/1601652, 7/2078, 8/2464, 9/2044, 10/2000, 11/25251, 12/13205, 13/29857 Jul 30 12:59:23 node17 pmxcfs[29857]: [status] notice: starting data syncronisation Jul 30 12:59:23 node17 pmxcfs[29857]: [dcdb] notice: received sync request (epoch 2/2678/0000001A) Jul 30 12:59:23 node17 pmxcfs[29857]: [status] notice: received sync request (epoch 2/2678/00000017) Jul 30 12:59:23 node17 corosync[29849]: [TOTEM ] A new membership (2.23bf0) was formed. Members left: 1 Jul 30 12:59:23 node17 corosync[29849]: [QUORUM] Members[12]: 2 3 4 5 6 7 8 9 10 11 12 13 Jul 30 12:59:23 node17 corosync[29849]: [MAIN ] Completed service synchronization, ready to provide service. Jul 30 12:59:23 node17 pmxcfs[29857]: [dcdb] notice: received all states Jul 30 12:59:23 node17 pmxcfs[29857]: [dcdb] notice: leader is 2/2678 Jul 30 12:59:23 node17 pmxcfs[29857]: [dcdb] notice: synced members: 2/2678, 3/2110, 4/2039, 5/2060, 6/1601652, 7/2078, 8/2464, 9/2044, 10/2000, 11/25251, 12/13205, 13/29857 Jul 30 12:59:23 node17 pmxcfs[29857]: [dcdb] notice: all data is up to date Jul 30 12:59:23 node17 pmxcfs[29857]: [status] notice: received all states Jul 30 12:59:23 node17 pmxcfs[29857]: [status] notice: all data is up to date Jul 30 12:59:31 node17 corosync[29849]: [TOTEM ] A new membership (1.23bf5) was formed. Members joined: 1 Jul 30 12:59:33 node17 pmxcfs[29857]: [dcdb] notice: cpg_send_message retry 10 Jul 30 12:59:33 node17 corosync[29849]: [KNET ] link: host: 1 link: 0 is down Jul 30 12:59:33 node17 corosync[29849]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1) Jul 30 12:59:33 node17 corosync[29849]: [KNET ] host: host: 1 has no active links Jul 30 12:59:34 node17 pmxcfs[29857]: [dcdb] notice: cpg_send_message retry 20 Jul 30 12:59:35 node17 pmxcfs[29857]: [status] notice: cpg_send_message retry 10 Jul 30 12:59:35 node17 pmxcfs[29857]: [dcdb] notice: cpg_send_message retry 30 Jul 30 12:59:36 node17 pmxcfs[29857]: [status] notice: cpg_send_message retry 20 Jul 30 12:59:36 node17 pmxcfs[29857]: [dcdb] notice: cpg_send_message retry 40 Jul 30 12:59:37 node17 pmxcfs[29857]: [status] notice: cpg_send_message retry 30 Jul 30 12:59:37 node17 corosync[29849]: [TOTEM ] Token has not been received in 292 ms Jul 30 12:59:37 node17 pmxcfs[29857]: [dcdb] notice: cpg_send_message retry 50 Jul 30 12:59:38 node17 pmxcfs[29857]: [status] notice: cpg_send_message retry 40 Jul 30 12:59:38 node17 pmxcfs[29857]: [dcdb] notice: cpg_send_message retry 60 Jul 30 12:59:39 node17 pmxcfs[29857]: [status] notice: cpg_send_message retry 50 Jul 30 12:59:39 node17 pmxcfs[29857]: [dcdb] notice: cpg_send_message retry 70 Jul 30 12:59:40 node17 pmxcfs[29857]: [status] notice: cpg_send_message retry 60 Jul 30 12:59:40 node17 pmxcfs[29857]: [dcdb] notice: cpg_send_message retry 80 Jul 30 12:59:41 node17 pmxcfs[29857]: [status] notice: cpg_send_message retry 70 Jul 30 12:59:41 node17 pmxcfs[29857]: [dcdb] notice: cpg_send_message retry 90 Jul 30 12:59:42 node17 pmxcfs[29857]: [status] notice: cpg_send_message retry 80 Jul 30 12:59:42 node17 pmxcfs[29857]: [dcdb] notice: cpg_send_message retry 100 Jul 30 12:59:42 node17 pmxcfs[29857]: [dcdb] notice: cpg_send_message retried 100 times Jul 30 12:59:42 node17 pmxcfs[29857]: [dcdb] crit: cpg_send_message failed: 6 Jul 30 12:59:42 node17 pve-ha-lrm[1746]: lost lock 'ha_agent_node17_lock - cfs lock update failed - Device or resource busy Jul 30 12:59:42 node17 pve-ha-lrm[1746]: status change active => lost_agent_lock Jul 30 12:59:42 node17 corosync[29849]: [KNET ] rx: host: 1 link: 0 is up Jul 30 12:59:42 node17 corosync[29849]: [KNET ] host: host: 1 (passive) best link: 0 (pri: 1) Jul 30 12:59:42 node17 corosync[29849]: [TOTEM ] A new membership (1.23bf9) was formed. Members Jul 30 12:59:42 node17 pmxcfs[29857]: [dcdb] notice: members: 2/2678, 3/2110, 4/2039, 5/2060, 6/1601652, 7/2078, 8/2464, 9/2044, 10/2000, 11/25251, 12/13205, 13/29857 Jul 30 12:59:42 node17 pmxcfs[29857]: [dcdb] notice: starting data syncronisation Jul 30 12:59:42 node17 pmxcfs[29857]: [status] notice: members: 2/2678, 3/2110, 4/2039, 5/2060, 6/1601652, 7/2078, 8/2464, 9/2044, 10/2000, 11/25251, 12/13205, 13/29857 Jul 30 12:59:42 node17 pmxcfs[29857]: [status] notice: starting data syncronisation Jul 30 12:59:42 node17 corosync[29849]: [QUORUM] Members[13]: 1 2 3 4 5 6 7 8 9 10 11 12 13 Jul 30 12:59:42 node17 corosync[29849]: [MAIN ] Completed service synchronization, ready to provide service. Jul 30 12:59:42 node17 pmxcfs[29857]: [dcdb] notice: members: 1/2458, 2/2678, 3/2110, 4/2039, 5/2060, 6/1601652, 7/2078, 8/2464, 9/2044, 10/2000, 11/25251, 12/13205, 13/29857 Jul 30 12:59:42 node17 pmxcfs[29857]: [dcdb] notice: queue not emtpy - resening 4 messages Jul 30 12:59:42 node17 pmxcfs[29857]: [status] notice: members: 1/2458, 2/2678, 3/2110, 4/2039, 5/2060, 6/1601652, 7/2078, 8/2464, 9/2044, 10/2000, 11/25251, 12/13205, 13/29857 Jul 30 12:59:42 node17 pmxcfs[29857]: [dcdb] notice: members: 1/2458, 1/2502656, 2/2678, 3/2110, 4/2039, 5/2060, 6/1601652, 7/2078, 8/2464, 9/2044, 10/2000, 11/25251, 12/13205, 13/29857 Jul 30 12:59:42 node17 pmxcfs[29857]: [dcdb] notice: queue not emtpy - resening 30 messages Jul 30 12:59:42 node17 pmxcfs[29857]: [dcdb] notice: received sync request (epoch 1/2502656/00000001) Jul 30 12:59:42 node17 pmxcfs[29857]: [status] notice: members: 1/2458, 1/2502656, 2/2678, 3/2110, 4/2039, 5/2060, 6/1601652, 7/2078, 8/2464, 9/2044, 10/2000, 11/25251, 12/13205, 13/29857 Jul 30 12:59:42 node17 pmxcfs[29857]: [status] notice: queue not emtpy - resening 70 messages Jul 30 12:59:42 node17 pmxcfs[29857]: [status] notice: received sync request (epoch 1/2502656/00000001) Jul 30 12:59:42 node17 pmxcfs[29857]: [dcdb] crit: ignore sync request from wrong member 2/2678 Jul 30 12:59:42 node17 pmxcfs[29857]: [dcdb] notice: received sync request (epoch 2/2678/0000001B) Jul 30 12:59:42 node17 pmxcfs[29857]: [status] notice: cpg_send_message retried 85 times Jul 30 12:59:42 node17 pmxcfs[29857]: [status] crit: ignore sync request from wrong member 2/2678 Jul 30 12:59:42 node17 pmxcfs[29857]: [status] notice: received sync request (epoch 2/2678/00000018) Jul 30 12:59:42 node17 pve-firewall[1700]: firewall update time (8.155 seconds) Jul 30 12:59:43 node17 pvestatd[1702]: status update time (8.683 seconds) ^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@^@