Re: [2.6.13-rc6-git13/sparc64]: Slab corruption (possible stack or buffer-cache corruption)

[Tomasz Kłoczko <kloczek@rudy.mif.pg.gda.pl>]

On Wed, 14 Sep 2005, Tomasz Kłoczko wrote:
[..]
> Dave you touch core of problems .. messages occures constantly but high 
> network activity occures only at night on this interface (backup). In 
> attachment is weekly graph network acivity measured on SNMP agent on switch 
> on this port.
> At day usualaly on this interface activity is is very low (5-40Kb/s in/out).

In attachemnt is filtered kernel log with timestamps which shows all 
"eth0: Happy Meal .." and "hw tcp/udp v4 csum failed" which was occure 
after yesterday boot on kernel 2.6.13-1.1552sp1 (which bases on 
2.6.14-rc1).
Backup was between 1:00 am and 4:00 am.
As you see there is no corelation between messages and high/low network 
activity.

kloczek
--
-----------------------------------------------------------
*Ludzie nie mają problemów, tylko sobie sami je stwarzają*
-----------------------------------------------------------
Tomasz Kłoczko, sys adm @zie.pg.gda.pl|*e-mail: kloczek@rudy.mif.pg.gda.pl*

Sep 13 21:58:22 boss kernel: device eth0 entered promiscuous mode
Sep 13 22:06:53 boss kernel: hw tcp v4 csum failed
Sep 13 22:16:44 boss kernel: eth0: Happy Meal out of receive descriptors, packet dropped.
Sep 13 22:21:00 boss last message repeated 3 times
Sep 13 22:51:10 boss last message repeated 3 times
Sep 13 22:51:11 boss kernel: eth0: Happy Meal out of receive descriptors, packet dropped.
Sep 13 22:58:06 boss kernel: hw tcp v4 csum failed
Sep 13 22:58:07 boss kernel: hw tcp v4 csum failed
Sep 13 22:58:50 boss kernel: eth0: Happy Meal out of receive descriptors, packet dropped.
Sep 13 23:02:16 boss last message repeated 3 times
Sep 13 23:08:02 boss last message repeated 3 times
Sep 13 23:27:03 boss last message repeated 3 times
Sep 13 23:55:45 boss last message repeated 2 times
Sep 14 00:10:58 boss last message repeated 6 times
Sep 14 00:11:08 boss last message repeated 3 times
Sep 14 00:23:09 boss kernel: hw tcp v4 csum failed
Sep 14 00:24:16 boss kernel: eth0: Happy Meal out of receive descriptors, packet dropped.
Sep 14 00:24:26 boss last message repeated 4 times
Sep 14 00:50:31 boss kernel: hw tcp v4 csum failed
Sep 14 00:53:36 boss kernel: hw tcp v4 csum failed
Sep 14 00:53:37 boss kernel: hw tcp v4 csum failed
Sep 14 01:10:31 boss kernel: eth0: Happy Meal out of receive descriptors, packet dropped.
Sep 14 01:12:23 boss kernel: hw tcp v4 csum failed
Sep 14 01:29:22 boss last message repeated 7 times
Sep 14 01:33:22 boss last message repeated 3 times
Sep 14 01:35:18 boss last message repeated 4 times
Sep 14 01:35:37 boss kernel: hw tcp v4 csum failed
Sep 14 01:40:49 boss kernel: eth0: Happy Meal out of receive descriptors, packet dropped.
Sep 14 01:40:51 boss last message repeated 2 times
Sep 14 01:43:16 boss kernel: hw tcp v4 csum failed
Sep 14 01:57:37 boss kernel: hw tcp v4 csum failed
Sep 14 02:06:30 boss kernel: eth0: Happy Meal out of receive descriptors, packet dropped.
Sep 14 02:14:34 boss last message repeated 3 times
Sep 14 02:14:36 boss last message repeated 2 times
Sep 14 02:30:56 boss kernel: hw tcp v4 csum failed
Sep 14 02:36:04 boss kernel: hw tcp v4 csum failed
Sep 14 02:59:06 boss kernel: eth0: Happy Meal out of receive descriptors, packet dropped.
Sep 14 03:12:37 boss last message repeated 2 times
Sep 14 03:49:08 boss last message repeated 3 times
Sep 14 04:43:55 boss last message repeated 3 times
Sep 14 05:10:00 boss last message repeated 3 times
Sep 14 05:44:44 boss last message repeated 3 times
Sep 14 05:52:18 boss last message repeated 3 times
Sep 14 05:56:45 boss last message repeated 3 times
Sep 14 06:09:41 boss last message repeated 3 times
Sep 14 06:09:46 boss last message repeated 4 times
Sep 14 06:24:28 boss kernel: eth0: Happy Meal out of receive descriptors, packet dropped.
Sep 14 06:24:30 boss last message repeated 2 times
Sep 14 07:05:59 boss kernel: eth0: Happy Meal out of receive descriptors, packet dropped.
Sep 14 07:42:16 boss last message repeated 3 times
Sep 14 07:42:18 boss last message repeated 2 times
Sep 14 08:08:38 boss kernel: hw tcp v4 csum failed
Sep 14 09:03:19 boss kernel: eth0: Happy Meal out of receive descriptors, packet dropped.
Sep 14 09:53:58 boss last message repeated 3 times
Sep 14 09:58:48 boss last message repeated 3 times
Sep 14 09:58:50 boss last message repeated 2 times
Sep 14 10:01:21 boss kernel: hw tcp v4 csum failed
Sep 14 10:05:29 boss kernel: hw tcp v4 csum failed
Sep 14 10:25:08 boss kernel: eth0: Happy Meal out of receive descriptors, packet dropped.
Sep 14 10:25:10 boss last message repeated 2 times
Sep 14 10:50:35 boss kernel: hw tcp v4 csum failed
Sep 14 10:53:25 boss kernel: hw tcp v4 csum failed
Sep 14 11:00:53 boss last message repeated 2 times
Sep 14 11:05:49 boss kernel: hw tcp v4 csum failed
Sep 14 11:11:45 boss kernel: eth0: Happy Meal out of receive descriptors, packet dropped.
Sep 14 11:11:47 boss last message repeated 2 times
Sep 14 11:12:04 boss kernel: udp v4 hw csum failure.
Sep 14 11:12:12 boss kernel: hw tcp v4 csum failed
Sep 14 11:26:52 boss kernel: hw tcp v4 csum failed
Sep 14 11:27:52 boss kernel: udp v4 hw csum failure.
Sep 14 11:31:38 boss kernel: hw tcp v4 csum failed
Sep 14 11:37:40 boss kernel: eth0: Happy Meal out of receive descriptors, packet dropped.
Sep 14 11:43:35 boss last message repeated 3 times
Sep 14 11:58:09 boss last message repeated 3 times
Sep 14 11:58:11 boss last message repeated 2 times
Sep 14 12:03:39 boss kernel: hw tcp v4 csum failed
Sep 14 12:10:48 boss kernel: eth0: Happy Meal out of receive descriptors, packet dropped.
Sep 14 12:10:54 boss last message repeated 3 times
Sep 14 12:15:00 boss kernel: hw tcp v4 csum failed
Sep 14 12:19:02 boss kernel: eth0: Happy Meal out of receive descriptors, packet dropped.
Sep 14 12:19:03 boss kernel: eth0: Happy Meal out of receive descriptors, packet dropped.
Sep 14 12:31:39 boss kernel: hw tcp v4 csum failed
Sep 14 12:44:50 boss kernel: eth0: Happy Meal out of receive descriptors, packet dropped.
Sep 14 13:05:27 boss last message repeated 3 times
Sep 14 13:17:06 boss last message repeated 3 times
Sep 14 13:23:17 boss last message repeated 3 times
Sep 14 13:23:19 boss last message repeated 2 times
Sep 14 13:24:34 boss kernel: hw tcp v4 csum failed
Sep 14 13:27:26 boss kernel: eth0: Happy Meal out of receive descriptors, packet dropped.