cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
mathmaxsean
Explorer
Explorer
2,395 Views
Registered: ‎05-23-2017

After system crashes how to debug the system?

 

I am running my linux system on the arm cortex.

some times the system will boot successfully and other times it will stop in some stage when booting.

 

Even after boot up successfully, the system will go to a dead loop (system crash) like below:

It will continue to print this information for ever.

How could I debug the system?

[ 3177.720122] INFO: rcu_sched self-detected stall on CPU
[ 3177.725175]  0-...: (774456 ticks this GP) idle=5f9/140000000000001/0 softirq=946/946 fqs=387141
[ 3177.734035]   (t=777738 jiffies g=48 c=47 q=1918)
[ 3177.738714] Task dump for CPU 0:
[ 3177.741926] kworker/u8:2    R  running task        0    32      2 0x00000002
[ 3177.748959] Workqueue: edac-poller edac_device_workq_function
[ 3177.754683] Call trace:
[ 3177.757119] [<ffffff8008088138>] dump_backtrace+0x0/0x198
[ 3177.762502] [<ffffff80080882e4>] show_stack+0x14/0x20
[ 3177.767535] [<ffffff80080c04ac>] sched_show_task+0x94/0xf0
[ 3177.773004] [<ffffff80080c26d8>] dump_cpu_task+0x40/0x50
[ 3177.778299] [<ffffff800812e258>] rcu_dump_cpu_stacks+0xb4/0xe8
[ 3177.784115] [<ffffff80080e8474>] rcu_check_callbacks+0x67c/0x860
[ 3177.790105] [<ffffff80080ebb2c>] update_process_times+0x34/0x60
[ 3177.796006] [<ffffff80080fafe0>] tick_sched_handle.isra.4+0x38/0x48
[ 3177.802256] [<ffffff80080fb034>] tick_sched_timer+0x44/0x90
[ 3177.807812] [<ffffff80080ec5e8>] __hrtimer_run_queues+0xf0/0x178
[ 3177.813801] [<ffffff80080ec978>] hrtimer_interrupt+0x98/0x1c8
[ 3177.819530] [<ffffff80086db8e8>] arch_timer_handler_phys+0x30/0x40
[ 3177.825693] [<ffffff80080dee70>] handle_percpu_devid_irq+0x78/0x128
[ 3177.831942] [<ffffff80080d9b74>] generic_handle_irq+0x24/0x38
[ 3177.837670] [<ffffff80080da1ec>] __handle_domain_irq+0x5c/0xb8
[ 3177.843485] [<ffffff80080814cc>] gic_handle_irq+0x64/0xc0
[ 3177.848866] Exception stack(0xffffffc075a43b90 to 0xffffffc075a43cc0)
[ 3177.855290] 3b80:                                   0000000000000000 ffffff800865ad88
[ 3177.863109] 3ba0: 0000000000000000 0000000000000001 ffffffc077f83598 ffffffc077f83580
[ 3177.870921] 3bc0: 0000000000000000 0000000000000000 ffffffc075a3f360 ffffffc075a40000
[ 3177.878733] 3be0: 0000000000000780 0000000000000000 ffffffc075a24880 0000000000000000
[ 3177.886545] 3c00: ffffffbf00000000 ffffffc0758010a8 ffffffc075801088 ffffffbf01938b70
[ 3177.894357] 3c20: 0000000000000006 0000000000000000 0000000000000000 ffffff800865ad88
[ 3177.902169] 3c40: 0000000000000000 ffffff8009499580 ffffff8009417000 ffffff8009417000
[ 3177.909981] 3c60: ffffffc075a43d48 0000000000000000 0000000000000000 ffffffc075a43cc0
[ 3177.917793] 3c80: ffffff800865afbc ffffffc075a43cc0 ffffff80080ff958 0000000060000145
[ 3177.925605] 3ca0: ffffffc075a43d40 ffffff800886511c ffffffffffffffff ffffff800809a088
[ 3177.933417] [<ffffff80080827b0>] el1_irq+0xb0/0x140
[ 3177.938272] [<ffffff80080ff958>] smp_call_function_single+0x88/0x128
[ 3177.944608] [<ffffff800865afbc>] cortex_arm64_edac_check+0x7c/0xd8
[ 3177.950771] [<ffffff80086571b0>] edac_device_workq_function+0x78/0xc0
[ 3177.957194] [<ffffff80080b0474>] process_one_work+0x1bc/0x380
[ 3177.962923] [<ffffff80080b0680>] worker_thread+0x48/0x4a8
[ 3177.968303] [<ffffff80080b6294>] kthread+0xd4/0xe8
[ 3177.973077] [<ffffff8008082e80>] ret_from_fork+0x10/0x50
[ 3177.978371] INFO: rcu_sched detected stalls on CPUs/tasks:
[ 3177.983840]  0-...: (774458 ticks this GP) idle=5f9/140000000000000/0 softirq=946/946 fqs=387141
[ 3177.992699]  (detected by 2, t=777806 jiffies, g=48, c=47, q=1918)
[ 3177.998855] Task dump for CPU 0:
[ 3178.002065] kworker/u8:2    R  running task        0    32      2 0x00000002
[ 3178.009099] Workqueue: edac-poller edac_device_workq_function
[ 3178.014823] Call trace:
[ 3178.017258] [<ffffff800808530c>] __switch_to+0x8c/0xa0
[ 3178.022379] [<ffffffc07586fc00>] 0xffffffc07586fc00
[ 3240.812122] INFO: rcu_sched self-detected stall on CPU
[ 3240.817179]  0-...: (790166 ticks this GP) idle=5f9/140000000000001/0 softirq=946/946 fqs=394990
[ 3240.826038]   (t=793511 jiffies g=48 c=47 q=1918)
[ 3240.830718] Task dump for CPU 0:
[ 3240.833929] kworker/u8:2    R  running task        0    32      2 0x00000002
[ 3240.840963] Workqueue: edac-poller edac_device_workq_function
[ 3240.846687] Call trace:
[ 3240.849122] [<ffffff8008088138>] dump_backtrace+0x0/0x198
[ 3240.854505] [<ffffff80080882e4>] show_stack+0x14/0x20
[ 3240.859539] [<ffffff80080c04ac>] sched_show_task+0x94/0xf0
[ 3240.865008] [<ffffff80080c26d8>] dump_cpu_task+0x40/0x50
[ 3240.870303] [<ffffff800812e258>] rcu_dump_cpu_stacks+0xb4/0xe8
[ 3240.876118] [<ffffff80080e8474>] rcu_check_callbacks+0x67c/0x860
[ 3240.882108] [<ffffff80080ebb2c>] update_process_times+0x34/0x60
[ 3240.888010] [<ffffff80080fafe0>] tick_sched_handle.isra.4+0x38/0x48
[ 3240.894259] [<ffffff80080fb034>] tick_sched_timer+0x44/0x90
[ 3240.899815] [<ffffff80080ec5e8>] __hrtimer_run_queues+0xf0/0x178
[ 3240.905804] [<ffffff80080ec978>] hrtimer_interrupt+0x98/0x1c8
[ 3240.911533] [<ffffff80086db8e8>] arch_timer_handler_phys+0x30/0x40
[ 3240.917696] [<ffffff80080dee70>] handle_percpu_devid_irq+0x78/0x128
[ 3240.923946] [<ffffff80080d9b74>] generic_handle_irq+0x24/0x38
[ 3240.929673] [<ffffff80080da1ec>] __handle_domain_irq+0x5c/0xb8
[ 3240.935489] [<ffffff80080814cc>] gic_handle_irq+0x64/0xc0
[ 3240.940869] Exception stack(0xffffffc075a43b90 to 0xffffffc075a43cc0)
[ 3240.947293] 3b80:                                   0000000000000000 ffffff800865ad88
[ 3240.955113] 3ba0: 0000000000000000 0000000000000001 ffffffc077f83598 ffffffc077f83580
[ 3240.962924] 3bc0: 0000000000000000 0000000000000000 ffffffc075a3f360 ffffffc075a40000
[ 3240.970736] 3be0: 0000000000000780 0000000000000000 ffffffc075a24880 0000000000000000
[ 3240.978549] 3c00: ffffffbf00000000 ffffffc0758010a8 ffffffc075801088 ffffffbf01938b70
[ 3240.986360] 3c20: 0000000000000006 0000000000000000 0000000000000000 ffffff800865ad88
[ 3240.994173] 3c40: 0000000000000000 ffffff8009499580 ffffff8009417000 ffffff8009417000
[ 3241.001985] 3c60: ffffffc075a43d48 0000000000000000 0000000000000000 ffffffc075a43cc0
[ 3241.009797] 3c80: ffffff800865afbc ffffffc075a43cc0 ffffff80080ff958 0000000060000145
[ 3241.017609] 3ca0: ffffffc075a43d40 ffffff800886511c ffffffffffffffff ffffff800809a088
[ 3241.025420] [<ffffff80080827b0>] el1_irq+0xb0/0x140
[ 3241.030275] [<ffffff80080ff958>] smp_call_function_single+0x88/0x128
[ 3241.036612] [<ffffff800865afbc>] cortex_arm64_edac_check+0x7c/0xd8
[ 3241.042775] [<ffffff80086571b0>] edac_device_workq_function+0x78/0xc0
[ 3241.049198] [<ffffff80080b0474>] process_one_work+0x1bc/0x380
[ 3241.054926] [<ffffff80080b0680>] worker_thread+0x48/0x4a8
[ 3241.060307] [<ffffff80080b6294>] kthread+0xd4/0xe8
[ 3241.065081] [<ffffff8008082e80>] ret_from_fork+0x10/0x50
[ 3241.070375] INFO: rcu_sched detected stalls on CPUs/tasks:
[ 3241.075844]  0-...: (790168 ticks this GP) idle=5f9/140000000000000/0 softirq=946/946 fqs=394991
[ 3241.084703]  (detected by 1, t=793579 jiffies, g=48, c=47, q=1918)
[ 3241.090858] Task dump for CPU 0:
[ 3241.094069] kworker/u8:2    R  running task        0    32      2 0x00000002
[ 3241.101103] Workqueue: edac-poller edac_device_workq_function
[ 3241.106827] Call trace:
[ 3241.109261] [<ffffff800808530c>] __switch_to+0x8c/0xa0
[ 3241.114383] [<ffffffc07586fc00>] 0xffffffc07586fc00

 

 

 

0 Kudos
2 Replies
ottob
Explorer
Explorer
2,151 Views
Registered: ‎05-26-2017

I have the same problem booting Petalinux 2017.1 on a custom ZynqMP board. Did you ever find the solution ? 

 

Thanks, 

 

/Otto

0 Kudos
ottob
Explorer
Explorer
2,147 Views
Registered: ‎05-26-2017