Re: [PATCH][RFC][0/4] InfiniBand userspace verbs implementation

Andrew Morton wrote:

The way we expect get_user_pages() to be used is that the kernel will use
get_user_pages() once per application I/O request.

Are you saying that RDMA clients will semi-permanently own pages which were
pinned by get_user_pages()?  That those pages will be used for multiple
separate I/O operations?

Yes, absolutely!

The memory buffer is allocated by the process (usually just via malloc) and registed/pinned by the driver. It then stays pinned for the life of the process (typically).

If so, then that's a significant design departure and it would be good to
hear why it is necessary.

That's just how RMDA works. Once the memory is pinned, if the app wants to send data to another node, it does two things:

1) Puts the data into its buffer

2) Sends a "work request" to the driver with (among other things) the offset and length of the data.

This is a time-critical operation. It must occurs as fast as possible, which means the memory must have already been pinned.

--
Timur Tabi
Staff Software Engineer
[email protected]

One thing a Southern boy will never say is,
"I don't think duct tape will fix it."
     -- Ed Smylie, NASA engineer for Apollo 13
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to [email protected]
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

---

• Follow-Ups:
  • Re: [PATCH][RFC][0/4] InfiniBand userspace verbs implementation
    • From: Andrew Morton <[email protected]>

• References:
  • [PATCH][RFC][0/4] InfiniBand userspace verbs implementation
    • From: Roland Dreier <[email protected]>
  • Re: [PATCH][RFC][0/4] InfiniBand userspace verbs implementation
    • From: Troy Benjegerdes <[email protected]>
  • Re: [PATCH][RFC][0/4] InfiniBand userspace verbs implementation
    • From: Roland Dreier <[email protected]>
  • Re: [PATCH][RFC][0/4] InfiniBand userspace verbs implementation
    • From: Troy Benjegerdes <[email protected]>
  • Re: [PATCH][RFC][0/4] InfiniBand userspace verbs implementation
    • From: Roland Dreier <[email protected]>
  • Re: [PATCH][RFC][0/4] InfiniBand userspace verbs implementation
    • From: Troy Benjegerdes <[email protected]>
  • Re: [PATCH][RFC][0/4] InfiniBand userspace verbs implementation
    • From: Roland Dreier <[email protected]>
  • Re: [PATCH][RFC][0/4] InfiniBand userspace verbs implementation
    • From: Andrew Morton <[email protected]>
  • Re: [PATCH][RFC][0/4] InfiniBand userspace verbs implementation
    • From: Timur Tabi <[email protected]>
  • Re: [PATCH][RFC][0/4] InfiniBand userspace verbs implementation
    • From: Christoph Hellwig <[email protected]>
  • Re: [PATCH][RFC][0/4] InfiniBand userspace verbs implementation
    • From: Timur Tabi <[email protected]>
  • Re: [PATCH][RFC][0/4] InfiniBand userspace verbs implementation
    • From: Andrew Morton <[email protected]>
  • Re: [PATCH][RFC][0/4] InfiniBand userspace verbs implementation
    • From: Roland Dreier <[email protected]>
  • Re: [PATCH][RFC][0/4] InfiniBand userspace verbs implementation
    • From: Andrew Morton <[email protected]>
  • Re: [PATCH][RFC][0/4] InfiniBand userspace verbs implementation
    • From: Roland Dreier <[email protected]>
  • Re: [PATCH][RFC][0/4] InfiniBand userspace verbs implementation
    • From: Andrew Morton <[email protected]>

• Prev by Date: Re: tcp_sendpage and page allocation lifetime vs. iscsi
• Next by Date: Re: [PATCH][RFC][0/4] InfiniBand userspace verbs implementation
• Previous by thread: Re: [PATCH][RFC][0/4] InfiniBand userspace verbs implementation
• Next by thread: Re: [PATCH][RFC][0/4] InfiniBand userspace verbs implementation
• Index(es):
  • Date
  • Thread

[Index of Archives]     [Kernel Newbies]     [Netfilter]     [Bugtraq]     [Photo]     [Stuff]     [Gimp]     [Yosemite News]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux RAID]     [Video 4 Linux]     [Linux for the blind]     [Linux Resources]