On Fri, Jan 20, 2006 at 10:43:44PM -0500, Jon Smirl wrote:
> 100 users at 500K each is 50MB of read ahead, that's not a huge amount of
> memory
The system might be overrunning the number of requests the disk elevator
has, which would result in the sort of disk seek storm you're seeing.
Also, what filesystem is being used? XFS would likely do substantially
better than ext3 because of its use of extents vs indirect blocks.
> Does using sendfile() set MADV_SEQUENTIAL and MADV_DONTNEED implicitly?
> If not would setting these help?
No. Readahead should be doing the right thing. Rik van Riel did some
work on drop behind for exactly this sort of case.
> I was following with you until this part. I thought sendfile() worked
> using mmap'd files and that readahead was done into the global page
> cache.
sendfile() uses the page cache directly, so it's like an mmap(), but it
does not carry the overhead associated with tlb manipulation.
> But this makes me think that read ahead is instead going into another
> pool. How large is this pool? The user space scheme is using 50MB of
> readahead cache, will the kernel do that much readahead if needed?
The kernel performs readahead using the system memory pool, which means
the VM gets involved and performs page reclaim to free up previously
cached pages.
> Does this scenario illustrate a problem with the current sendfile()
> implementation? I thought the goal of sendfile() was to always be the
> best way to send complete files. This is a case where user space is
> clearly beating sendfile().
Yes, this would be called a bug. =-)
-ben
--
"You know, I've seen some crystals do some pretty trippy shit, man."
Don't Email: <[email protected]>.
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
[Index of Archives]
[Kernel Newbies]
[Netfilter]
[Bugtraq]
[Photo]
[Stuff]
[Gimp]
[Yosemite News]
[MIPS Linux]
[ARM Linux]
[Linux Security]
[Linux RAID]
[Video 4 Linux]
[Linux for the blind]
[Linux Resources]
