Page MenuHomeVyOS Platform

Unexpected kernel related errors
Closed, InvalidPublic

Description

Today I got strange kernel errors which caused temporary network hanging, vyos was not rebooted, during that problem.

Here is part of log output

Apr  6 10:18:12 ow-vpn kernel: [4773027.050384] INFO: rcu_sched detected stalls on CPUs/tasks: { 5} (detected by 3, t=6002 jiffies, g=239023773, c=239023772, q=57388)
Apr  6 10:18:12 ow-vpn kernel: [4773027.053805] NMI backtrace for cpu 3
Apr  6 10:18:12 ow-vpn kernel: [4773027.053809] CPU: 3 PID: 0 Comm: swapper/3 Not tainted 3.13.11-1-amd64-vyos #1
Apr  6 10:18:12 ow-vpn kernel: [4773027.053812] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/30/2013
Apr  6 10:18:12 ow-vpn kernel: [4773027.053815] task: ffff88013aaf4d00 ti: ffff88013ab20000 task.ti: ffff88013ab20000
Apr  6 10:18:12 ow-vpn kernel: [4773027.053818] RIP: 0010:[<ffffffff81037a98>]  [<ffffffff81037a98>] _flat_send_IPI_mask+0x72/0x80
Apr  6 10:18:12 ow-vpn kernel: [4773027.053828] RSP: 0018:ffff88013fcc3e08  EFLAGS: 00000046
Apr  6 10:18:12 ow-vpn kernel: [4773027.053830] RAX: 0000000000000c00 RBX: 00000000ff000000 RCX: 0000000000000007
Apr  6 10:18:12 ow-vpn kernel: [4773027.053833] RDX: ffff88013fcc3df8 RSI: 0000000000000002 RDI: 0000000000000082
Apr  6 10:18:12 ow-vpn kernel: [4773027.053836] RBP: 0000000000000002 R08: 0000000000002c2a R09: ffffffff81764942
Apr  6 10:18:12 ow-vpn kernel: [4773027.053838] R10: 000000000e3f369c R11: 0000000000000000 R12: 0000000000000c00
Apr  6 10:18:12 ow-vpn kernel: [4773027.053840] R13: ffffffff815cdd80 R14: 0000000000000003 R15: ffffffff816205e0
Apr  6 10:18:12 ow-vpn kernel: [4773027.053844] FS:  0000000000000000(0000) GS:ffff88013fcc0000(0000) knlGS:0000000000000000
Apr  6 10:18:12 ow-vpn kernel: [4773027.053846] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Apr  6 10:18:12 ow-vpn kernel: [4773027.053849] CR2: ffffffffff600400 CR3: 00000000b2f26000 CR4: 00000000000007e0
Apr  6 10:18:12 ow-vpn kernel: [4773027.053857] Stack:
Apr  6 10:18:12 ow-vpn kernel: [4773027.053859]  ffff88013fccf970 0000000000000082 0000000000000000 ffff88013fcce290
Apr  6 10:18:12 ow-vpn kernel: [4773027.053863]  0000000000000001 ffffffff81035210 ffffffff815cdd80 ffffffff8108b4d9
Apr  6 10:18:12 ow-vpn kernel: [4773027.053867]  0000000000000000 ffffffff815cdd80 000000000000e02c 0000000000000083
Apr  6 10:18:12 ow-vpn kernel: [4773027.053871] Call Trace:
Apr  6 10:18:12 ow-vpn kernel: [4773027.053873]  <IRQ> 
Apr  6 10:18:12 ow-vpn kernel: [4773027.053876]  [<ffffffff81035210>] ? arch_trigger_all_cpu_backtrace+0x44/0x6c
Apr  6 10:18:12 ow-vpn kernel: [4773027.053886]  [<ffffffff8108b4d9>] ? rcu_check_callbacks+0x465/0x5a0
Apr  6 10:18:12 ow-vpn kernel: [4773027.053893]  [<ffffffff81094068>] ? tick_nohz_handler+0xce/0xce
Apr  6 10:18:12 ow-vpn kernel: [4773027.053897]  [<ffffffff810544d7>] ? update_process_times+0x31/0x56
Apr  6 10:18:12 ow-vpn kernel: [4773027.053901]  [<ffffffff810940dc>] ? tick_sched_timer+0x74/0x90
Apr  6 10:18:12 ow-vpn kernel: [4773027.053907]  [<ffffffff81067c97>] ? __run_hrtimer+0x92/0x11c
Apr  6 10:18:12 ow-vpn kernel: [4773027.053911]  [<ffffffff81067f7e>] ? hrtimer_interrupt+0xde/0x1ec
Apr  6 10:18:12 ow-vpn kernel: [4773027.053917]  [<ffffffff81014f15>] ? read_tsc+0x5/0x16
Apr  6 10:18:12 ow-vpn kernel: [4773027.053921]  [<ffffffff8109432d>] ? tick_check_idle+0x43/0x93
Apr  6 10:18:12 ow-vpn kernel: [4773027.053928]  [<ffffffff810349bc>] ? smp_apic_timer_interrupt+0x1d/0x2d
Apr  6 10:18:12 ow-vpn kernel: [4773027.053935]  [<ffffffff813ef7dd>] ? apic_timer_interrupt+0x6d/0x80
Apr  6 10:18:12 ow-vpn kernel: [4773027.053937]  <EOI> 
Apr  6 10:18:12 ow-vpn kernel: [4773027.053939]  [<ffffffff8103bbc8>] ? native_safe_halt+0x2/0x3
Apr  6 10:18:12 ow-vpn kernel: [4773027.053947]  [<ffffffff8101650b>] ? default_idle+0x1b/0x2c
Apr  6 10:18:12 ow-vpn kernel: [4773027.053953]  [<ffffffff81083b41>] ? cpu_startup_entry+0x132/0x1a9
Apr  6 10:18:12 ow-vpn kernel: [4773027.053958]  [<ffffffff810328be>] ? start_secondary+0x25e/0x263

Details

Difficulty level
Normal (likely a few hours)
Version
1.1.6

Event Timeline

syncer claimed this task.
syncer changed the edit policy from "Public (No Login Required)" to "Custom Policy".
syncer added a subscriber: syncer.

Marking this as invalid
info provided not sufficient