BGP Router Crash - Telehouse North
Updates
The BGP router in Telehouse North crashed at 08:51 this morning causing network service interruption for approximately 5 minutes whilst the routes reconverged and the router rebooted itself.
The last lines on the log file prior to it rebooting itself;
Feb 13 08:51:24 ro2.thn netplugd[11297]: eth13: state ACTIVE flags 0x00011043 UP,BROADCAST,RUNNING,MULTICAST,10000 -> 0x00001003 UP,BROADCAST,MULTICAST
Feb 13 08:51:24 ro2.thn netplugd[3534490]: /etc/netplug/netplug eth13 out -> pid 3534490
Feb 13 08:51:25 ro2.thn netplugd[11297]: eth13.3000: state ACTIVE flags 0x00011043 UP,BROADCAST,RUNNING,MULTICAST,10000 -> 0x00001003 UP,BROADCAST,MULTICAST
Feb 13 08:51:25 ro2.thn netplugd[3534495]: /etc/netplug/netplug eth13.3000 out -> pid 3534495
Feb 13 08:51:25 ro2.thn netplugd[11297]: eth13: state OUTING flags 0x00001003 UP,BROADCAST,MULTICAST -> 0x00011043 UP,BROADCAST,RUNNING,MULTICAST,10000
Feb 13 08:51:25 ro2.thn netplugd[11297]: eth13.3000: state OUTING flags 0x00001003 UP,BROADCAST,MULTICAST -> 0x00011043 UP,BROADCAST,RUNNING,MULTICAST,10000
Feb 13 08:51:28 ro2.thn bgpd[2060]: [PXVXG-TFNNT] %ADJCHANGE: neighbor 95.131.87.159(ro2.thw) in vrf default Down BGP Notification send
Feb 13 08:51:28 ro2.thn bgpd[2060]: [HKQ2F-8D0MY][EC 100663315] Thread Starvation: {(thread *)0x7f75f87a9fd0 arg=0x55df8cae5140 timer r=-11.352 update_group_refresh_default_originate_route_map() &bgp->t_rmap_def_originate_eval from ../bgpd/bgp_route.c:3438} was scheduled to pop greater than 4s ago
Feb 13 08:51:30 ro2.thn netplugd[11297]: eth13: state OUTING flags 0x00011043 UP,BROADCAST,RUNNING,MULTICAST,10000 -> 0x00001003 UP,BROADCAST,MULTICAST
Feb 13 08:51:30 ro2.thn netplugd[11297]: eth13.3000: state OUTING flags 0x00011043 UP,BROADCAST,RUNNING,MULTICAST,10000 -> 0x00001003 UP,BROADCAST,MULTICAST
Feb 13 08:51:30 ro2.thn netplugd[11297]: eth13: state OUTING flags 0x00001003 UP,BROADCAST,MULTICAST -> 0x00011043 UP,BROADCAST,RUNNING,MULTICAST,10000
Feb 13 08:51:30 ro2.thn netplugd[11297]: eth13.3000: state OUTING flags 0x00001003 UP,BROADCAST,MULTICAST -> 0x00011043 UP,BROADCAST,RUNNING,MULTICAST,10000
We are investigating the cause of these events and will continue to monitor the network for stability. For the past 10 minute period there have been no further issues.
← Back
1310 Network