oops in generic_delete_inode when doing frequent i/o to disk

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



[1] One line Summary of problem: sun java and freenet makes kernel
2.6.16.1 oops and crashes the machine on AMD64.
-------------------------------------------------------------
[2] Full Description

When running a java application which writes to disk constantly for a long
time, an oops is generated.
This oops will crash the machine eventually.
I think the oops will be generated as well with any program which writes
constantly to disc, but I have only one such program:
Freenet running on Sun Java. The versions of the programs are described
below.

Some oops are shown below, with the disassembled functions and code.
I hope you find this useful in finding the bug.

There are some sections in the REPORTING BUGS which I think are not relevant
to the code, so I omited them. These include /proc/ioports, /proc/iomem,
lspci -vvv and /proc/scsi/scsi.
Please contact me if you need any more information.
-------------------------------------------------------------
[3.] Keywords

oops, generic_delete_inode, frequent and continuous i/o to disk
-------------------------------------------------------------
[4.] Kernel version (from /proc/version):
Linux version 2.6.16.1 (root@blackhole) (gcc version 4.0.2 20050808
(prerelease) (Ubuntu 4.0.1-4ubuntu9)) #4 PREEMPT Thu Mar 30 00:07:11 CEST
2006
-------------------------------------------------------------
[5.] Most recent kernel version which did not have the bug:
Kernel 2.6.12-9-amd-generic from Ubuntu 5.2 has the bug as well.
I don't have older kernels, will test if requested.
--------------------------------------------------------------
[6.] Output of Oops.. message (if applicable) with symbolic information
     resolved (see Documentation/oops-tracing.txt)

Oops:

Mar 30 10:21:19 blackhole kernel: [18628.027629] Modules linked in:
snd_rtctimer rfcomm l2cap bluetooth powernow_k8 cpufreq_userspace
cpufreq_stats
freq_table cpufreq_powersave cpufreq_ondemand cpufreq_conservative lp
video thermal processor fan container button battery ac ipv6 mousedev
tsdev ide_cd cdrom parport_pc parport pcspkr psmouse rtc ide_generic
snd_seq_dummy snd_seq_oss snd_seq_midi snd_seq_midi_event snd_seq
snd_via82xx gameport
snd_ac97_codec snd_ac97_bus snd_pcm_oss snd_mixer_oss snd_pcm snd_timer
snd_page_alloc snd_mpu401_uart snd_rawmidi snd_seq_device snd soundcore
i2c_viapro ehci_hcd uhci_hcd generic sata_via libata scsi_mod bt878 tuner
bttv video_buf firmware_class compat_ioctl32 i2c_algo_bit v4l2_common
btcx_risc ir_common tveeprom i2c_core videodev sk98lin skge shpchp
pci_hotplug aes dm_crypt loop dm_mod md_mod unix
Mar 30 10:21:19 blackhole kernel: [18628.027667] Pid: 21039, comm: java
Not tainted 2.6.16.1 #4
Mar 30 10:21:19 blackhole kernel: [18628.027671] RIP:
0010:[generic_delete_inode+283/387]
<ffffffff8017fb8b>{generic_delete_inode+283}
Mar 30 10:21:19 blackhole kernel: [18628.027677] RSP:
0018:ffff8100041fbec8  EFLAGS: 00010246
Mar 30 10:21:19 blackhole kernel: [18628.027681] RAX: 0000000000000000
RBX: ffff810037a93750 RCX: ffff81000ea24870
Mar 30 10:21:19 blackhole kernel: [18628.027687] RDX: ffff800001f7f2b0
RSI: ffff81003ba72680 RDI: ffff81003223f240
Mar 30 10:21:19 blackhole kernel: [18628.027691] RBP: ffffffff801c694e
R08: 0000000000000002 R09: 00000000000000a0
Mar 30 10:21:19 blackhole kernel: [18628.027695] R10: 0000000000000000
R11: 0000000000000000 R12: ffff81003f718ed0
Mar 30 10:21:19 blackhole kernel: [18628.027699] R13: ffff81003e349000
R14: 0000000000000000 R15: 00002aaaab2d7b40
Mar 30 10:21:19 blackhole kernel: [18628.027704] FS: 
0000000044304960(0063) GS:ffffffff803fa000(0000) knlGS:00000000f750d6c0
Mar 30 10:21:19 blackhole kernel: [18628.027708] CS:  0010 DS: 0000 ES:
0000 CR0: 0000000080050033
Mar 30 10:21:19 blackhole kernel: [18628.027712] CR2: ffff800001f7f2b0
CR3: 0000000028507000 CR4: 00000000000006e0
Mar 30 10:21:19 blackhole kernel: [18628.027717] Process java (pid: 21039,
threadinfo ffff8100041fa000, task ffff81003ef5e380)
Mar 30 10:21:19 blackhole kernel: [18628.027720] Stack: ffffffff8017fbf3
0000000000000000 ffff810037a93750 ffffffff80176ba6
Mar 30 10:21:19 blackhole kernel: [18628.027727]        ffff81000b34a7c8
ffff81003dab4080 0000004612bd64da ffff81003e34900b
Mar 30 10:21:19 blackhole kernel: [18628.027733]        0000000000000010
0000000000000000
Mar 30 10:21:19 blackhole kernel: [18628.027736] Call Trace:
<ffffffff8017fbf3>{generic_drop_inode+0}
Mar 30 10:21:19 blackhole kernel: [18628.027744]       
<ffffffff80176ba6>{do_unlinkat+213} <ffffffff8010a76e>{system_call+126}
Mar 30 10:21:19 blackhole kernel: [18628.027771]
Mar 30 10:21:19 blackhole kernel: [18628.027772] Code: 48 89 02 74 04 48
89 50 08 48 c7 03 00 00 00 00 48 c7 43 08
Mar 30 10:21:19 blackhole kernel: [18628.027789]  <6>note: java[21039]
exited with preempt_count 1


gdb /usr/src/linux/vmlinux
gdb> disassemble generic_delete_inode
Dump of assembler code for function generic_delete_inode:
0xffffffff8017fa70 <generic_delete_inode+0>:    push   %rbp
0xffffffff8017fa71 <generic_delete_inode+1>:    push   %rbx
0xffffffff8017fa72 <generic_delete_inode+2>:    mov    %rdi,%rbx
0xffffffff8017fa75 <generic_delete_inode+5>:    push   %rax
0xffffffff8017fa76 <generic_delete_inode+6>:    mov    0x100(%rdi),%rax
0xffffffff8017fa7d <generic_delete_inode+13>:   mov    0x10(%rdi),%rcx
0xffffffff8017fa81 <generic_delete_inode+17>:   mov    0x38(%rax),%rbp
0xffffffff8017fa85 <generic_delete_inode+21>:   lea    0x10(%rdi),%rax
0xffffffff8017fa89 <generic_delete_inode+25>:   mov    0x8(%rax),%rdx
0xffffffff8017fa8d <generic_delete_inode+29>:   mov    %rdx,0x8(%rcx)
0xffffffff8017fa91 <generic_delete_inode+33>:   mov    %rcx,(%rdx)
0xffffffff8017fa94 <generic_delete_inode+36>:   mov    %rax,0x8(%rax)
0xffffffff8017fa98 <generic_delete_inode+40>:   mov    %rax,0x10(%rdi)
0xffffffff8017fa9c <generic_delete_inode+44>:   lea    0x20(%rdi),%rax
0xffffffff8017faa0 <generic_delete_inode+48>:   mov    0x20(%rdi),%rcx
0xffffffff8017faa4 <generic_delete_inode+52>:   mov    0x8(%rax),%rdx
0xffffffff8017faa8 <generic_delete_inode+56>:   mov    %rdx,0x8(%rcx)
0xffffffff8017faac <generic_delete_inode+60>:   mov    %rcx,(%rdx)
0xffffffff8017faaf <generic_delete_inode+63>:   mov    %rax,0x8(%rax)
0xffffffff8017fab3 <generic_delete_inode+67>:   orq    $0x10,0x218(%rdi)
0xffffffff8017fabb <generic_delete_inode+75>:   mov    %rax,0x20(%rdi)
0xffffffff8017fabf <generic_delete_inode+79>:   decl   2426923(%rip)      
 # 0xffffffff803d02f0 <inodes_stat>
0xffffffff8017fac5 <generic_delete_inode+85>:   mov    %gs:0x10,%rax
0xffffffff8017face <generic_delete_inode+94>:   decl  
0xffffffffffffe044(%rax)
0xffffffff8017fad4 <generic_delete_inode+100>:  mov    %gs:0x10,%rax
0xffffffff8017fadd <generic_delete_inode+109>:  mov   
0xffffffffffffe038(%rax),%eax
0xffffffff8017fae3 <generic_delete_inode+115>:  mov    %eax,%eax
0xffffffff8017fae5 <generic_delete_inode+117>:  test   $0x8,%al
0xffffffff8017fae7 <generic_delete_inode+119>:  je     0xffffffff8017faee
<generic_delete_inode+126>
0xffffffff8017fae9 <generic_delete_inode+121>:  callq  0xffffffff802decf9
<preempt_schedule>
0xffffffff8017faee <generic_delete_inode+126>:  testb  $0x2,0x229(%rbx)
0xffffffff8017faf5 <generic_delete_inode+133>:  jne    0xffffffff8017fb07
<generic_delete_inode+151>
0xffffffff8017faf7 <generic_delete_inode+135>:  mov    2463842(%rip),%rax 
      # 0xffffffff803d9360 <security_ops>
0xffffffff8017fafe <generic_delete_inode+142>:  mov    %rbx,%rdi
0xffffffff8017fb01 <generic_delete_inode+145>:  callq  *0x190(%rax)
0xffffffff8017fb07 <generic_delete_inode+151>:  mov    0x38(%rbp),%rbp
0xffffffff8017fb0b <generic_delete_inode+155>:  test   %rbp,%rbp
0xffffffff8017fb0e <generic_delete_inode+158>:  je     0xffffffff8017fb57
<generic_delete_inode+231>
0xffffffff8017fb10 <generic_delete_inode+160>:  mov    %rbx,%rdi
0xffffffff8017fb13 <generic_delete_inode+163>:  callq  0xffffffff801809be
<is_bad_inode>
0xffffffff8017fb18 <generic_delete_inode+168>:  test   %eax,%eax
0xffffffff8017fb1a <generic_delete_inode+170>:  jne    0xffffffff8017fb50
<generic_delete_inode+224>
0xffffffff8017fb1c <generic_delete_inode+172>:  mov    0x100(%rbx),%rax
0xffffffff8017fb23 <generic_delete_inode+179>:  test   %rax,%rax
0xffffffff8017fb26 <generic_delete_inode+182>:  jne    0xffffffff8017fb32
<generic_delete_inode+194>
0xffffffff8017fb28 <generic_delete_inode+184>:  ud2a
0xffffffff8017fb2a <generic_delete_inode+186>:  pushq  $0xffffffff802fec56
0xffffffff8017fb2f <generic_delete_inode+191>:  retq   $0x41
0xffffffff8017fb32 <generic_delete_inode+194>:  testb  $0x3,0x120(%rax)
0xffffffff8017fb39 <generic_delete_inode+201>:  je     0xffffffff8017fb50
<generic_delete_inode+224>
0xffffffff8017fb3b <generic_delete_inode+203>:  testb  $0x20,0x228(%rbx)
0xffffffff8017fb42 <generic_delete_inode+210>:  jne    0xffffffff8017fb50
<generic_delete_inode+224>
---Type <return> to continue, or q <return> to quit---
0xffffffff8017fb44 <generic_delete_inode+212>:  mov    0x40(%rax),%rax
0xffffffff8017fb48 <generic_delete_inode+216>:  or    
$0xffffffffffffffff,%esi
0xffffffff8017fb4b <generic_delete_inode+219>:  mov    %rbx,%rdi
0xffffffff8017fb4e <generic_delete_inode+222>:  callq  *(%rax)
0xffffffff8017fb50 <generic_delete_inode+224>:  mov    %rbx,%rdi
0xffffffff8017fb53 <generic_delete_inode+227>:  callq  *%ebp
0xffffffff8017fb55 <generic_delete_inode+229>:  jmp    0xffffffff8017fb6d
<generic_delete_inode+253>
0xffffffff8017fb57 <generic_delete_inode+231>:  lea    0x118(%rbx),%rdi
0xffffffff8017fb5e <generic_delete_inode+238>:  xor    %esi,%esi
0xffffffff8017fb60 <generic_delete_inode+240>:  callq  0xffffffff80150984
<truncate_inode_pages>
0xffffffff8017fb65 <generic_delete_inode+245>:  mov    %rbx,%rdi
0xffffffff8017fb68 <generic_delete_inode+248>:  callq  0xffffffff8017f483
<clear_inode>
0xffffffff8017fb6d <generic_delete_inode+253>:  mov    %gs:0x10,%rax
0xffffffff8017fb76 <generic_delete_inode+262>:  incl  
0xffffffffffffe044(%rax)
0xffffffff8017fb7c <generic_delete_inode+268>:  mov    0x8(%rbx),%rdx
0xffffffff8017fb80 <generic_delete_inode+272>:  test   %rdx,%rdx
0xffffffff8017fb83 <generic_delete_inode+275>:  je     0xffffffff8017fba3
<generic_delete_inode+307>
0xffffffff8017fb85 <generic_delete_inode+277>:  mov    (%rbx),%rax
0xffffffff8017fb88 <generic_delete_inode+280>:  test   %rax,%rax
0xffffffff8017fb8b <generic_delete_inode+283>:  mov    %rax,(%rdx)
0xffffffff8017fb8e <generic_delete_inode+286>:  je     0xffffffff8017fb94
<generic_delete_inode+292>
0xffffffff8017fb90 <generic_delete_inode+288>:  mov    %rdx,0x8(%rax)
0xffffffff8017fb94 <generic_delete_inode+292>:  movq   $0x0,(%rbx)
0xffffffff8017fb9b <generic_delete_inode+299>:  movq   $0x0,0x8(%rbx)
0xffffffff8017fba3 <generic_delete_inode+307>:  mov    %gs:0x10,%rax
0xffffffff8017fbac <generic_delete_inode+316>:  decl  
0xffffffffffffe044(%rax)
0xffffffff8017fbb2 <generic_delete_inode+322>:  mov    %gs:0x10,%rax
0xffffffff8017fbbb <generic_delete_inode+331>:  mov   
0xffffffffffffe038(%rax),%eax
0xffffffff8017fbc1 <generic_delete_inode+337>:  mov    %eax,%eax
0xffffffff8017fbc3 <generic_delete_inode+339>:  test   $0x8,%al
0xffffffff8017fbc5 <generic_delete_inode+341>:  je     0xffffffff8017fbcc
<generic_delete_inode+348>
0xffffffff8017fbc7 <generic_delete_inode+343>:  callq  0xffffffff802decf9
<preempt_schedule>
0xffffffff8017fbcc <generic_delete_inode+348>:  mov    %rbx,%rdi
0xffffffff8017fbcf <generic_delete_inode+351>:  callq  0xffffffff8017ec70
<wake_up_inode>
0xffffffff8017fbd4 <generic_delete_inode+356>:  cmpq   $0x20,0x218(%rbx)
0xffffffff8017fbdc <generic_delete_inode+364>:  je     0xffffffff8017fbe8
<generic_delete_inode+376>
0xffffffff8017fbde <generic_delete_inode+366>:  ud2a
0xffffffff8017fbe0 <generic_delete_inode+368>:  pushq  $0xffffffff80300d05
0xffffffff8017fbe5 <generic_delete_inode+373>:  retq   $0x422
0xffffffff8017fbe8 <generic_delete_inode+376>:  pop    %rax
0xffffffff8017fbe9 <generic_delete_inode+377>:  mov    %rbx,%rdi
0xffffffff8017fbec <generic_delete_inode+380>:  pop    %rbx
0xffffffff8017fbed <generic_delete_inode+381>:  pop    %rbp
0xffffffff8017fbee <generic_delete_inode+382>:  jmpq   0xffffffff8017eb2e
<destroy_inode>
End of assembler dump.
(gdb)

cat bug.c
char str[] =
"\x48\x89\x02\x74\x04\x48\x89\x50\x08\x48\xc7\x03\x00\x00\x00\x00\x48\xc7\x43\x08";
main(){}

(gdb) disassemble str
Dump of assembler code for function str:
0x0000000000500820 <str+0>:     mov    %rax,(%rdx)
0x0000000000500823 <str+3>:     je     0x500829 <str+9>
0x0000000000500825 <str+5>:     mov    %rdx,0x8(%rax)
0x0000000000500829 <str+9>:     movq   $0x0,(%rbx)
0x0000000000500830 <str+16>:    movq   $0x0,0x8(%rbx)
End of assembler dump.
(gdb)

The code doesn't seem to be corrupt.

I have some other oops with the same code and different stack:

-----------Begin oops -------------

Mar 30 02:23:12 blackhole kernel: [ 4290.494412] Modules linked in:
snd_rtctimer rfcomm l2cap bluetooth powernow_k8 cpufreq_userspace
cpufreq_stats freq_table cpufreq_powersave cpufreq_ondemand
cpufreq_conservative lp video thermal processor fan container button
battery ac ipv6 mousedev tsdev ide_cd cdrom parport_pc parport pcspkr
psmouse rtc ide_generic snd_seq_dummy snd_seq_oss snd_seq_midi
snd_seq_midi_event snd_seq snd_via82xx gameport snd_ac97_codec
snd_ac97_bus
snd_pcm_oss snd_mixer_oss snd_pcm snd_timer snd_page_alloc snd_mpu401_uart
snd_rawmidi snd_seq_device snd soundcore i2c_viapro ehci_hcd uhci_hcd
generic sata_via libata scsi_mod bt878 tuner bttv video_buf firmware_class
compat_ioctl32 i2c_algo_bit v4l2_common btcx_risc ir_common tveeprom
i2c_core videodev sk98lin skge shpchp pci_hotplug aes dm_crypt loop dm_mod
md_mod unix
Mar 30 02:23:12 blackhole kernel: [ 4290.494450] Pid: 12645, comm: java
Not tainted 2.6.16.1 #4
Mar 30 02:23:12 blackhole kernel: [ 4290.494453] RIP:
0010:[generic_delete_inode+283/387]
<ffffffff8017fb8b>{generic_delete_inode+283}
Mar 30 02:23:12 blackhole kernel: [ 4290.494460] RSP:
0018:ffff810027d21ec8  EFLAGS: 00010246
Mar 30 02:23:12 blackhole kernel: [ 4290.494464] RAX: 0000000000000000
RBX: ffff81003b055690 RCX: ffff81000ea24870
Mar 30 02:23:12 blackhole kernel: [ 4290.494469] RDX: ffff800001fa50d0
RSI: ffff81003ba72680 RDI: ffff81002aafab88
Mar 30 02:23:12 blackhole kernel: [ 4290.494474] RBP: ffffffff801c694e
R08: 0000000000000002 R09: 0000000000000340
Mar 30 02:23:12 blackhole kernel: [ 4290.494477] R10: 0000000000000000
R11: 0000000000000000 R12: ffff81003f9e1c38
Mar 30 02:23:12 blackhole kernel: [ 4290.494482] R13: ffff81003e2fb000
R14: 0000000000000000 R15: 00002aaab019f410
Mar 30 02:23:12 blackhole kernel: [ 4290.494487] FS: 
0000000047f40960(0063) GS:ffffffff803fa000(0000) knlGS:00000000f5bc2bb0
Mar 30 02:23:12 blackhole kernel: [ 4290.494491] CS:  0010 DS: 0000 ES:
0000 CR0: 0000000080050033
Mar 30 02:23:12 blackhole kernel: [ 4290.494495] CR2: ffff800001fa50d0
CR3: 000000000e3c3000 CR4: 00000000000006e0
Mar 30 02:23:12 blackhole kernel: [ 4290.494500] Process java (pid: 12645,
threadinfo ffff810027d20000, task ffff810021d82340)
Mar 30 02:23:12 blackhole kernel: [ 4290.494503] Stack: ffffffff8017fbf3
0000000000000000 ffff81003b055690 ffffffff80176ba6
Mar 30 02:23:12 blackhole kernel: [ 4290.494510]        ffff810010fde468
ffff81003dab4080 00000009ca093089 ffff81003e2fb006
Mar 30 02:23:12 blackhole kernel: [ 4290.494516]        0000000000000010
ffffffff00000000
Mar 30 02:23:12 blackhole kernel: [ 4290.494520] Call Trace:
<ffffffff8017fbf3>{generic_drop_inode+0}
Mar 30 02:23:12 blackhole kernel: [ 4290.494527]       
<ffffffff80176ba6>{do_unlinkat+213}
<ffffffff801816c5>{mntput_no_expire+23}
Mar 30 02:23:12 blackhole kernel: [ 4290.494540]       
<ffffffff80165a73>{filp_close+89} <ffffffff8010a76e>{system_call+126}
Mar 30 02:23:12 blackhole kernel: [ 4290.494560]
Mar 30 02:23:12 blackhole kernel: [ 4290.494561] Code: 48 89 02 74 04 48
89 50 08 48 c7 03 00 00 00 00 48 c7 43 08
Mar 30 02:23:12 blackhole kernel: [ 4290.494578]  <6>note: java[12645]
exited with preempt_count 1

----------End oops -----------
----------Begin oops ---------
Mar 30 14:35:00 blackhole kernel: [26295.049536] Modules linked in:
snd_rtctimer rfcomm l2cap bluetooth powernow_k8 cpufreq_userspace
cpufreq_stats freq_table cpufreq_powersave cpufreq_ondemand
cpufreq_conservative lp video thermal processor fan container button
battery ac ipv6 mousedev tsdev ide_cd cdrom parport_pc parport pcspkr
psmouse rtc ide_generic snd_seq_dummy snd_seq_oss snd_seq_midi
snd_seq_midi_event snd_seq snd_via82xx gameport snd_ac97_codec
snd_ac97_bus
snd_pcm_oss snd_mixer_oss snd_pcm snd_timer snd_page_alloc snd_mpu401_uart
snd_rawmidi snd_seq_device snd soundcore i2c_viapro ehci_hcd uhci_hcd
generic sata_via libata scsi_mod bt878 tuner bttv video_buf firmware_class
compat_ioctl32 i2c_algo_bit v4l2_common btcx_risc ir_common tveeprom
i2c_core videodev sk98lin skge shpchp pci_hotplug aes dm_crypt loop dm_mod
md_mod unix
Mar 30 14:35:00 blackhole kernel: [26295.049699] Pid: 140, comm: kswapd0
Not tainted 2.6.16.1 #4
Mar 30 14:35:00 blackhole kernel: [26295.049711] RIP:
0010:[dispose_list+114/319] <ffffffff8017f5ff>{dispose_list+114}Mar 30
14:35:00 blackhole kernel: [26295.049727] RSP: 0018:ffff81003fdd7d78 
EFLAGS: 00010246
Mar 30 14:35:00 blackhole kernel: [26295.049743] RAX: 0000000000000000
RBX: ffff81003487a760 RCX: 0000000000000036
Mar 30 14:35:00 blackhole kernel: [26295.049757] RDX: ffff800001f64870
RSI: ffff81003487a8d8 RDI: ffffffffffffffff
Mar 30 14:35:00 blackhole kernel: [26295.049770] RBP: ffff81003487a750
R08: ffff810001cd4228 R09: 0000000000000006
Mar 30 14:35:00 blackhole kernel: [26295.049783] R10: 0000000000000006
R11: ffffffff801b4912 R12: 000000000000001b
Mar 30 14:35:00 blackhole kernel: [26295.049795] R13: ffff81003fdd7da8
R14: 0000000000000080 R15: 0000000000000080
Mar 30 14:35:00 blackhole kernel: [26295.049809] FS: 
00000000424e6960(0000) GS:ffffffff803fa000(0000) knlGS:000000007c355bb0
Mar 30 14:35:00 blackhole kernel: [26295.049827] CS:  0010 DS: 0018 ES:
0018 CR0: 000000008005003b
Mar 30 14:35:00 blackhole kernel: [26295.049838] CR2: ffff800001f64870
CR3: 0000000028507000 CR4: 00000000000006e0
Mar 30 14:35:00 blackhole kernel: [26295.049852] Process kswapd0 (pid:
140, threadinfo ffff81003fdd6000, task ffff81003fd0f040)
Mar 30 14:35:00 blackhole kernel: [26295.049869] Stack: 0000000000000000
ffff810027f21438 ffff810027f21448 0000000000000080
Mar 30 14:35:00 blackhole kernel: [26295.049885]        0000000000000000
ffffffff8017f8b3 ffff8100286199f8 ffff81002944fa78
Mar 30 14:35:00 blackhole kernel: [26295.049906]        ffff81003fdd7db8
ffff81003ffa84c0
Mar 30 14:35:00 blackhole kernel: [26295.049919] Call Trace:
<ffffffff8017f8b3>{shrink_icache_memory+487}
Mar 30 14:35:00 blackhole kernel: [26295.049944]       
<ffffffff80150b4b>{shrink_slab+223} <ffffffff80151f19>{balance_pgdat+568}
Mar 30 14:35:00 blackhole kernel: [26295.049982]       
<ffffffff80152150>{kswapd+255}
<ffffffff8013aa0c>{autoremove_wake_function+0}
Mar 30 14:35:00 blackhole kernel: [26295.050012]       
<ffffffff8010b286>{child_rip+8} <ffffffff80152051>{kswapd+0}
Mar 30 14:35:00 blackhole kernel: [26295.050042]       
<ffffffff8010b27e>{child_rip+0}
Mar 30 14:35:00 blackhole kernel: [26295.050061]
Mar 30 14:35:00 blackhole kernel: [26295.050062] Code: 48 89 02 74 04 48
89 50 08 48 c7 43 f0 00 00 00 00 48 c7 43
Mar 30 14:35:00 blackhole kernel: [26295.050303]  <6>note: kswapd0[140]
exited with preempt_count 1
-----------end oops------------
-----------begin oops----------
Mar 30 18:19:38 blackhole kernel: [33029.714304] Modules linked in:
snd_rtctimer rfcomm l2cap bluetooth powernow_k8 cpufreq_userspace
cpufreq_stats freq_table cpufreq_powersave cpufreq_ondemand
cpufreq_conservative lp video thermal processor fan container button
battery ac ipv6 mousedev tsdev ide_cd cdrom parport_pc parport pcspkr
psmouse rtc ide_generic snd_seq_dummy snd_seq_oss snd_seq_midi
snd_seq_midi_event snd_seq snd_via82xx gameport snd_ac97_codec
snd_ac97_bus
snd_pcm_oss snd_mixer_oss snd_pcm snd_timer snd_page_alloc snd_mpu401_uart
snd_rawmidi snd_seq_device snd soundcore i2c_viapro ehci_hcd uhci_hcd
generic sata_via libata scsi_mod bt878 tuner bttv video_buf firmware_class
compat_ioctl32 i2c_algo_bit v4l2_common btcx_risc ir_common tveeprom
i2c_core videodev sk98lin skge shpchp pci_hotplug aes dm_crypt loop dm_mod
md_mod unix
Mar 30 18:19:38 blackhole kernel: [33029.714467] Pid: 10977, comm: java
Not tainted 2.6.16.1 #4
Mar 30 18:19:38 blackhole kernel: [33029.714478] RIP:
0010:[generic_delete_inode+283/387]
<ffffffff8017fb8b>{generic_delete_inode+283}
Mar 30 18:19:38 blackhole kernel: [33029.714494] RSP:
0018:ffff81003b049ec8  EFLAGS: 00010246
Mar 30 18:19:38 blackhole kernel: [33029.714511] RAX: 0000000000000000
RBX: ffff810027c396d0 RCX: ffff8100016dedf8
Mar 30 18:19:38 blackhole kernel: [33029.714524] RDX: ffff800001f78520
RSI: 0000000000000004 RDI: ffff81002ade5fa8
Mar 30 18:19:38 blackhole kernel: [33029.714538] RBP: ffffffff801c694e
R08: ffff8100016dedf8 R09: 00000000fffffffa
Mar 30 18:19:38 blackhole kernel: [33029.714550] R10: 0000000000000004
R11: 0000000000000004 R12: ffff810009b1f080
Mar 30 18:19:38 blackhole kernel: [33029.714563] R13: ffff81003e2ff000
R14: 0000000000000000 R15: 00002aaaad255a00
Mar 30 18:19:38 blackhole kernel: [33029.714577] FS: 
0000000041bdd960(0063) GS:ffffffff803fa000(0000) knlGS:000000007c85abb0
Mar 30 18:19:38 blackhole kernel: [33029.714594] CS:  0010 DS: 0000 ES:
0000 CR0: 0000000080050033
Mar 30 18:19:38 blackhole kernel: [33029.714606] CR2: ffff800001f78520
CR3: 0000000002eda000 CR4: 00000000000006e0
Mar 30 18:19:38 blackhole kernel: [33029.714620] Process java (pid: 10977,
threadinfo ffff81003b048000, task ffff810018582760)
Mar 30 18:19:38 blackhole kernel: [33029.714636] Stack: ffffffff8017fbf3
0000000000000000 ffff810027c396d0 ffffffff80176ba6
Mar 30 18:19:38 blackhole kernel: [33029.714653]        ffff81000ed304a8
ffff81003dab4080 00000012b838aae8 ffff81003e2ff000
Mar 30 18:19:38 blackhole kernel: [33029.714675]        0000000000000010
0000000000000000
Mar 30 18:19:38 blackhole kernel: [33029.714686] Call Trace:
<ffffffff8017fbf3>{generic_drop_inode+0}
Mar 30 18:19:38 blackhole kernel: [33029.714704]       
<ffffffff80176ba6>{do_unlinkat+213} <ffffffff8010a76e>{system_call+126}
Mar 30 18:19:38 blackhole kernel: [33029.714750]
Mar 30 18:19:38 blackhole kernel: [33029.714751] Code: 48 89 02 74 04 48
89 50 08 48 c7 03 00 00 00 00 48 c7 43 08
Mar 30 18:19:38 blackhole kernel: [33029.714997]  <6>note: java[10977]
exited with preempt_count 1
-----------end oops----------

----------------------------------------------------------------------------------------------------
[7.] A small shell script or example program which triggers the
     problem (if possible)

How to recreate:
-AMD64
-kernel 2.6.16.1
-java version "1.5.0_06"
-freenet Build 5106 (http://freenet.sourceforge.net/)

Run freenet with this java version in 64 bit mode for a few
hours. I have one oops every 6 hours, more or less.

---------------------------------------------------------------------------------

[8.] Environment

[8.1.] Software (add the output of the ver_linux script here)

./ver_linux
If some fields are empty or look unusual you may have an old version.
Compare to the current minimal requirements in Documentation/Changes.

Linux blackhole 2.6.16.1 #4 PREEMPT Thu Mar 30 00:07:11 CEST 2006 x86_64
GNU/Linux

Gnu C                  4.0.2
Gnu make               3.80
binutils               2.16.1
util-linux             2.12p
mount                  2.12p
module-init-tools      3.2-pre7
e2fsprogs              1.38
jfsutils               1.1.8
reiserfsprogs          3.6.19
reiser4progs           1.0.4
xfsprogs               2.6.28
PPP                    2.4.3
Linux C Library        2.3.5
Dynamic linker (ldd)   2.3.5
Procps                 3.2.5
Net-tools              1.60
Console-tools          0.2.3
Sh-utils               5.2.1
udev                   060
Modules Loaded         rfcomm l2cap bluetooth powernow_k8
cpufreq_userspace cpufreq_stats freq_table cpufreq_powersave
cpufreq_ondemand cpufreq_conservative lp video thermal processor fan
container button battery ac ipv6 mousedev tsdev ide_cd cdrom parport_pc
parport pcspkr psmouse rtc ide_generic snd_seq_dummy snd_seq_oss
snd_seq_midi snd_seq_midi_event snd_seq snd_via82xx gameport
snd_ac97_codec snd_ac97_bus snd_pcm_oss snd_mixer_oss snd_pcm snd_timer
snd_page_alloc snd_mpu401_uart snd_rawmidi snd_seq_device snd soundcore
i2c_viapro ehci_hcd uhci_hcd generic sata_via libata scsi_mod bt878 tuner
bttv video_buf firmware_class compat_ioctl32 i2c_algo_bit v4l2_common
btcx_risc ir_common tveeprom i2c_core videodev sk98lin skge shpchp
pci_hotplug aes dm_crypt loop dm_mod md_mod unix

[8.2.] Processor information (from /proc/cpuinfo):

$cat /proc/cpuinfo
processor       : 0
vendor_id       : AuthenticAMD
cpu family      : 15
model           : 47
model name      : AMD Athlon(tm) 64 Processor 3200+
stepping        : 2
cpu MHz         : 1000.000
cache size      : 512 KB
fpu             : yes
fpu_exception   : yes
cpuid level     : 1
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca
cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt lm
3dnowext 3dnow pni lahf_lm
bogomips        : 2007.70
TLB size        : 1024 4K pages
clflush size    : 64
cache_alignment : 64
address sizes   : 40 bits physical, 48 bits virtual
power management: ts fid vid ttp tm stc

[8.3.] Module information (from /proc/modules):

cat /proc/modules
rfcomm 38824 0 - Live 0xffffffff882d8000
l2cap 27016 5 rfcomm, Live 0xffffffff882d0000
bluetooth 51620 4 rfcomm,l2cap, Live 0xffffffff882c2000
powernow_k8 10384 0 - Live 0xffffffff882be000
cpufreq_userspace 4884 1 - Live 0xffffffff882bb000
cpufreq_stats 6024 0 - Live 0xffffffff882b8000
freq_table 5256 2 powernow_k8,cpufreq_stats, Live 0xffffffff882b5000
cpufreq_powersave 2432 0 - Live 0xffffffff882b3000
cpufreq_ondemand 7084 0 - Live 0xffffffff882b0000
cpufreq_conservative 7980 0 - Live 0xffffffff882ad000
lp 13056 0 - Live 0xffffffff882a8000
video 17800 0 - Live 0xffffffff882a2000
thermal 15500 0 - Live 0xffffffff8829d000
processor 26456 2 powernow_k8,thermal, Live 0xffffffff88295000
fan 5512 0 - Live 0xffffffff88292000
container 5376 0 - Live 0xffffffff8828f000
button 7968 0 - Live 0xffffffff8828c000
battery 10888 0 - Live 0xffffffff88288000
ac 5896 0 - Live 0xffffffff88285000
ipv6 267680 251 - Live 0xffffffff88242000
mousedev 12928 1 - Live 0xffffffff8823d000
tsdev 8960 0 - Live 0xffffffff88239000
ide_cd 40864 0 - Live 0xffffffff8822e000
cdrom 36792 1 ide_cd, Live 0xffffffff88224000
parport_pc 37488 1 - Live 0xffffffff88219000
parport 40588 2 lp,parport_pc, Live 0xffffffff8820e000
pcspkr 4104 0 - Live 0xffffffff8820b000
psmouse 39564 0 - Live 0xffffffff88200000
rtc 15352 0 - Live 0xffffffff881fb000
ide_generic 1792 0 [permanent], Live 0xffffffff881f6000
snd_seq_dummy 4484 0 - Live 0xffffffff881f8000
snd_seq_oss 32868 0 - Live 0xffffffff881ec000
snd_seq_midi 9536 0 - Live 0xffffffff881e8000
snd_seq_midi_event 8320 2 snd_seq_oss,snd_seq_midi, Live 0xffffffff881e4000
snd_seq 54552 6 snd_seq_dummy,snd_seq_oss,snd_seq_midi,snd_seq_midi_event,
Live 0xffffffff881d5000
snd_via82xx 30120 1 - Live 0xffffffff881cc000
gameport 16784 1 snd_via82xx, Live 0xffffffff881c6000
snd_ac97_codec 102588 1 snd_via82xx, Live 0xffffffff881ab000
snd_ac97_bus 3072 1 snd_ac97_codec, Live 0xffffffff881a9000
snd_pcm_oss 52256 0 - Live 0xffffffff8819b000
snd_mixer_oss 17920 1 snd_pcm_oss, Live 0xffffffff88195000
snd_pcm 95372 3 snd_via82xx,snd_ac97_codec,snd_pcm_oss, Live
0xffffffff8817c000
snd_timer 26120 2 snd_seq,snd_pcm, Live 0xffffffff88174000
snd_page_alloc 11536 2 snd_via82xx,snd_pcm, Live 0xffffffff88170000
snd_mpu401_uart 8576 1 snd_via82xx, Live 0xffffffff8816c000
snd_rawmidi 28064 2 snd_seq_midi,snd_mpu401_uart, Live 0xffffffff88164000
snd_seq_device 9872 5
snd_seq_dummy,snd_seq_oss,snd_seq_midi,snd_seq,snd_rawmidi, Live
0xffffffff88160000
snd 60928 13
snd_seq_oss,snd_seq,snd_via82xx,snd_ac97_codec,snd_pcm_oss,snd_mixer_oss,snd_pcm,snd_timer,snd_mpu401_uart,snd_rawmidi,snd_seq_device,
Live 0xffffffff88150000
soundcore 11680 1 snd, Live 0xffffffff8814c000
i2c_viapro 9880 0 - Live 0xffffffff88148000
ehci_hcd 32136 0 - Live 0xffffffff8813f000
uhci_hcd 32544 0 - Live 0xffffffff88136000
generic 5764 0 [permanent], Live 0xffffffff88133000
sata_via 9988 0 - Live 0xffffffff8812f000
libata 61720 1 sata_via, Live 0xffffffff8811e000
scsi_mod 147992 1 libata, Live 0xffffffff880f8000
bt878 12620 0 - Live 0xffffffff880f3000
tuner 52780 0 - Live 0xffffffff880e5000
bttv 194620 1 bt878, Live 0xffffffff880b4000
video_buf 23812 1 bttv, Live 0xffffffff880ad000
firmware_class 11904 1 bttv, Live 0xffffffff880a9000
compat_ioctl32 9088 1 bttv, Live 0xffffffff880a5000
i2c_algo_bit 9608 1 bttv, Live 0xffffffff880a1000
v4l2_common 9984 3 tuner,bttv,compat_ioctl32, Live 0xffffffff8809d000
btcx_risc 5512 1 bttv, Live 0xffffffff8809a000
ir_common 10884 1 bttv, Live 0xffffffff88096000
tveeprom 17040 1 bttv, Live 0xffffffff88090000
i2c_core 23832 5 i2c_viapro,tuner,bttv,i2c_algo_bit,tveeprom, Live
0xffffffff88089000
videodev 12032 1 bttv, Live 0xffffffff88085000
sk98lin 146016 0 - Live 0xffffffff88060000
skge 39056 0 - Live 0xffffffff88055000
shpchp 45440 0 - Live 0xffffffff88048000
pci_hotplug 29672 1 shpchp, Live 0xffffffff8803f000
aes 27304 2 - Live 0xffffffff88037000
dm_crypt 12560 1 - Live 0xffffffff88032000
loop 16656 2 - Live 0xffffffff8802c000
dm_mod 55144 3 dm_crypt, Live 0xffffffff8801d000
md_mod 76056 0 - Live 0xffffffff88009000
unix 31160 657 - Live 0xffffffff88000000

[8.4.] Loaded driver and hardware information (/proc/ioports, /proc/iomem)

I don't think it is relevant, will post if asked

[8.5.] PCI information ('lspci -vvv' as root)

I don't think it is relevant, will post if asked

[8.6.] SCSI information (from /proc/scsi/scsi)

I don't think it is relevant, will post if asked

[8.7.] Other information that might be relevant to the problem
       (please look in /proc and include all information that you
       think to be relevant):


[X.] Other notes, patches, fixes, workarounds:

Will post if I find a way to make the oops go away.






-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to [email protected]
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

[Index of Archives]     [Kernel Newbies]     [Netfilter]     [Bugtraq]     [Photo]     [Stuff]     [Gimp]     [Yosemite News]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux RAID]     [Video 4 Linux]     [Linux for the blind]     [Linux Resources]
  Powered by Linux