Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?

Liste des GroupesRevenir à c arch 
Sujet : Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?
De : mitchalsup (at) *nospam* aol.com (MitchAlsup1)
Groupes : comp.arch
Date : 19. May 2025, 01:18:23
Autres entêtes
Organisation : Rocksolid Light
Message-ID : <91c8a31fc5d04a1fadf210b2dd6d4875@www.novabbs.org>
References : 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
User-Agent : Rocksolid Light
On Sun, 18 May 2025 1:35:54 +0000, Lawrence D'Oliveiro wrote:

On Tue, 13 May 2025 17:49:17 -0700, Stephen Fuld wrote:
>
On 5/13/2025 5:18 PM, Lawrence D'Oliveiro wrote:
>
You can tell that’s wrong because the drive cache is slower than the OS
filesystem cache.
>
I don't think that proves anything.  I gave you an example of where the
drive cache speeded up the sequence of two reads to where it was faster
than two reads into the file cache.
>
Think of what a cache is for in the first place. The only reason they
work
is because of the “principle of locality”. This can also be expressed as
saying that typical patterns of data access by application programs
follow
a Pareto distribution, less formally known by monikers like the “80/20
rule” or the “90/10 rule”.
>
Let’s use the “90/10 rule” name just to put some concrete numbers on the
whole idea: this says that 90% of (recent) data accesses will be to just
10% of the data.
>
For “recent”, let’s say “within the last 10 seconds”.
Principle is reasonable, specified time is not.
A 4MB cache can be filled in 1ms when memory performs at (only) 4GB/s
(and the memory systems are up in the 40GB/s peak territory while
caches remain rather small (several GB at most).)

So the OS cache
should be big enough to hold that 10% of the data that the app accessed
in
about the last 10 seconds. Of course the precise set of frequently-
accessed data (the “working set”) will drift over time. So anything
beyond
this last-10-seconds’ worth will require hitting the actual disk device,
which will happen eventually.
Just change 10 seconds to 10 milliseconds and I have nothing to complain
about.

At that point, the cache on the disk device is going to come into play.
Trouble is it’s nowhere near this kind of size: it can only hold enough
data for, say, about the last 1 second’s worth of accesses. So by the
time
the OS cache experiences a miss like this, the disk cache isn’t going to
be able to help much, since it is more likely than not going to miss as
well. To be useful, it needs to be about 10 times the size of the OS
cache, so it can hold more of the 90% of the data that the app wants to
access less frequently.
>
But you can’t get drives like that.

Date Sujet#  Auteur
10 May 25 * Is Parallel Programming Hard, And, If So, What Can You Do About It?195Thomas Koenig
11 May 25 +* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?164MitchAlsup1
11 May 25 i`* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?163Al Kossow
12 May 25 i `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?162Lawrence D'Oliveiro
12 May 25 i  `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?161MitchAlsup1
12 May 25 i   `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?160Lawrence D'Oliveiro
12 May 25 i    +* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?2MitchAlsup1
12 May 25 i    i`- Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?1Lawrence D'Oliveiro
12 May 25 i    `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?157Terje Mathisen
12 May 25 i     +* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?3Anton Ertl
12 May 25 i     i+- Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?1Lawrence D'Oliveiro
13 May 25 i     i`- Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?1Stephen Fuld
12 May 25 i     `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?153Lawrence D'Oliveiro
13 May 25 i      +* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?4Stefan Monnier
13 May 25 i      i`* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?3Lawrence D'Oliveiro
13 May 25 i      i +- Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?1Stefan Monnier
13 May 25 i      i `- Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?1Stephen Fuld
13 May 25 i      +* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?147Anton Ertl
13 May 25 i      i`* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?146Lawrence D'Oliveiro
13 May 25 i      i `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?145Stephen Fuld
14 May 25 i      i  +* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?62Lawrence D'Oliveiro
14 May 25 i      i  i+* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?59Stephen Fuld
18 May 25 i      i  ii`* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?58Lawrence D'Oliveiro
19 May 25 i      i  ii +* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?6Lynn Wheeler
19 May 25 i      i  ii i`* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?5Vir Campestris
19 May 25 i      i  ii i `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?4Stephen Fuld
20 May 25 i      i  ii i  +- Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?1Vir Campestris
21 May 25 i      i  ii i  `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?2Lynn Wheeler
21 May 25 i      i  ii i   `- Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?1Stephen Fuld
19 May 25 i      i  ii `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?51MitchAlsup1
20 May 25 i      i  ii  `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?50MitchAlsup1
20 May 25 i      i  ii   `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?49Lawrence D'Oliveiro
20 May 25 i      i  ii    `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?48BGB
20 May 25 i      i  ii     +* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?46Stefan Monnier
20 May 25 i      i  ii     i+* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?2BGB
20 May 25 i      i  ii     ii`- Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?1Stephen Fuld
21 May 25 i      i  ii     i`* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?43Lawrence D'Oliveiro
21 May 25 i      i  ii     i +* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?38BGB
21 May 25 i      i  ii     i i`* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?37Lawrence D'Oliveiro
21 May 25 i      i  ii     i i `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?36Stephen Fuld
21 May 25 i      i  ii     i i  `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?35Anton Ertl
22 May 25 i      i  ii     i i   +* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?33George Neuner
22 May 25 i      i  ii     i i   i`* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?32BGB
22 May 25 i      i  ii     i i   i `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?31Torbjorn Lindgren
22 May 25 i      i  ii     i i   i  `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?30BGB
22 May 25 i      i  ii     i i   i   `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?29Lawrence D'Oliveiro
23 May 25 i      i  ii     i i   i    `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?28BGB
23 May 25 i      i  ii     i i   i     +* Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?25John Levine
23 May 25 i      i  ii     i i   i     i+* Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?17MitchAlsup1
23 May 25 i      i  ii     i i   i     ii`* Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?16Stephen Fuld
23 May 25 i      i  ii     i i   i     ii `* Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?15MitchAlsup1
24 May 25 i      i  ii     i i   i     ii  +* Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?12BGB
24 May 25 i      i  ii     i i   i     ii  i`* Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?11BGB
24 May 25 i      i  ii     i i   i     ii  i +* Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?4John Levine
24 May 25 i      i  ii     i i   i     ii  i i`* Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?3Michael S
24 May 25 i      i  ii     i i   i     ii  i i `* Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?2BGB
26 May 25 i      i  ii     i i   i     ii  i i  `- Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?1Terje Mathisen
24 May 25 i      i  ii     i i   i     ii  i +* Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?2MitchAlsup1
24 May 25 i      i  ii     i i   i     ii  i i`- Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?1BGB
25 May 25 i      i  ii     i i   i     ii  i `* Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?4Lars Poulsen
25 May 25 i      i  ii     i i   i     ii  i  +- Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?1John Levine
25 May 25 i      i  ii     i i   i     ii  i  +- Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?1BGB
26 May 25 i      i  ii     i i   i     ii  i  `- Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?1MitchAlsup1
24 May 25 i      i  ii     i i   i     ii  `* Re: recycling2Brian G. Lucas
25 May 25 i      i  ii     i i   i     ii   `- Re: recycling1George Neuner
23 May 25 i      i  ii     i i   i     i`* Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?7BGB
23 May 25 i      i  ii     i i   i     i `* Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?6BGB
24 May 25 i      i  ii     i i   i     i  `* Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?5BGB
24 May 25 i      i  ii     i i   i     i   +* Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?3MitchAlsup1
24 May 25 i      i  ii     i i   i     i   i+- Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?1BGB
30 May 25 i      i  ii     i i   i     i   i`- Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?1Thomas Koenig
24 May 25 i      i  ii     i i   i     i   `- Re: the power of junk, Is Parallel Programming Hard, And, If So, What Can You Do About It?1BGB
23 May 25 i      i  ii     i i   i     `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?2jseigh
23 May 25 i      i  ii     i i   i      `- Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?1BGB
22 May 25 i      i  ii     i i   `- Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?1Dan Cross
21 May 25 i      i  ii     i `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?4Stephen Fuld
21 May 25 i      i  ii     i  `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?3Lawrence D'Oliveiro
21 May 25 i      i  ii     i   +- Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?1Stephen Fuld
21 May 25 i      i  ii     i   `- Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?1BGB
21 May 25 i      i  ii     `- Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?1Lawrence D'Oliveiro
14 May 25 i      i  i`* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?2John Levine
14 May 25 i      i  i `- Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?1Thomas Koenig
23 May 25 i      i  `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?82Waldek Hebisch
23 May 25 i      i   +* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?5Lawrence D'Oliveiro
23 May 25 i      i   i`* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?4BGB
23 May 25 i      i   i `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?3MitchAlsup1
23 May 25 i      i   i  `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?2BGB
24 May 25 i      i   i   `- Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?1Lawrence D'Oliveiro
23 May 25 i      i   `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?76Stephen Fuld
23 May 25 i      i    +* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?74Stefan Monnier
24 May 25 i      i    i+* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?69Stephen Fuld
25 May 25 i      i    ii`* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?68Waldek Hebisch
25 May 25 i      i    ii +* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?45Stephen Fuld
25 May 25 i      i    ii i+* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?28MitchAlsup1
26 May 25 i      i    ii ii`* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?27Chris M. Thomasson
26 May 25 i      i    ii ii `* Re: fuzzy disks, Is Parallel Programming Hard, And, If So, What Can You Do About It?26John Levine
26 May 25 i      i    ii ii  `* Re: fuzzy disks, Is Parallel Programming Hard, And, If So, What Can You Do About It?25Stephen Fuld
26 May 25 i      i    ii ii   +* Re: fuzzy disks, Is Parallel Programming Hard, And, If So, What Can You Do About It?23Stefan Monnier
26 May 25 i      i    ii ii   i+* Re: fuzzy disks, Is Parallel Programming Hard, And, If So, What Can You Do About It?21John Levine
27 May 25 i      i    ii ii   ii+* Re: fuzzy disks, Is Parallel Programming Hard, And, If So, What Can You Do About It?19Stephen Fuld
27 May 25 i      i    ii ii   iii`* Re: fuzzy disks, Is Parallel Programming Hard, And, If So, What Can You Do About It?18Anton Ertl
28 May 25 i      i    ii ii   ii`- Re: fuzzy disks, Is Parallel Programming Hard, And, If So, What Can You Do About It?1Stefan Monnier
26 May 25 i      i    ii ii   i`- Re: fuzzy disks, Is Parallel Programming Hard, And, If So, What Can You Do About It?1Stephen Fuld
26 May 25 i      i    ii ii   `- Re: fuzzy disks, Is Parallel Programming Hard, And, If So, What Can You Do About It?1Stephen Fuld
26 May 25 i      i    ii i+* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?6Stefan Monnier
26 May 25 i      i    ii i+* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?2Lawrence D'Oliveiro
26 May 25 i      i    ii i`* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?8Waldek Hebisch
25 May 25 i      i    ii +- Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?1BGB
26 May 25 i      i    ii `* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?21Anton Ertl
25 May 25 i      i    i`* Drive Caches (Re: Is Parallel Programming Hard, ...)4Lars Poulsen
23 May 25 i      i    `- Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?1Lawrence D'Oliveiro
18 May 25 i      `- Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?1Lawrence D'Oliveiro
19 May 25 +* Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?29quadibloc
21 May 25 `- Re: Is Parallel Programming Hard, And, If So, What Can You Do About It?1Chris M. Thomasson

Haut de la page

Les messages affichés proviennent d'usenet.

NewsPortal