Re: Opinion on ordering of writel vs. stores to RAM

[Linus Torvalds <torvalds@osdl.org>]

On Sat, 9 Sep 2006, Paul Mackerras wrote:
> 
> Do you have an opinion about whether the MMIO write in writel() should
> be ordered with respect to preceding writes to normal memory?

It shouldn't. It's too expensive. The fact that PC's have nice memory 
consistency models means that most of the testing is going to be with the 
PC memory ordering, but the same way we have "smp_wmb()" (which is also a 
no-op on x86) we should probably have a "mmiowb()" there.

Gaah. Right now, mmiowb() is actually broken on x86 (it's an empty define, 
so it may cause compiler warnings about statements with no effects or 
something).

I don't think anyting but a few SCSI drivers that are used on some ia64 
boxes use mmiowb(). And it's currently a no-op not only on x86 but also on 
powerpc. Probably because it's defined to be a barrier between _two_ MMIO 
operations, while we should probably have things like

 a)
	.. regular mem store ..
	mem_to_io_barrier();
	.. IOMEM store ..

 b)
	.. IOMEM store ..
	io_to_mem_barrier();
	.. regular mem store ..

although it's quite possible that (a) never makes any sense at all.

That said, it's also entirely possible that what you _should_ do is to 
just make sure that the	"sync" is always _before_ the IO op. But that 
would require that you have one before an IO load too. Do you? I'm too 
lazy to check.

(Keeping it inside a spinlock, I don't know. Spinlocks aren't _supposed_ 
to order IO, so I don't _think_ that's necessarily an argument for doing 
so. So your rationale seems strange. Even on x86, a spinlock release by 
_no_ means would mean that an IO write would be "done").

		Linus
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/