Re: updatedb

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 2007.07.26 11:58:29 +0200, Björn Steinbrink wrote:
> Note that the total RSS usage of updatedb+sort was just about 50MB,
> nevertheless swap grew to more than 300MB. It's also interesting that
> swapping is so aggressive, that the amount of free memory is constantly
> growing. I'm a missing something or wouldn't it be smarter to use that
> free memory for buffers and cache first? (x86_64 system, so even if
> highmem on x86 could be responsible, it's not the case here.)
> 
> Will now go and see what happens if I play with swappiness.

Hm, swappiness set to 0 looks even more weird to me, especially the
beginning, where (AFAICT) basically buffers and caches are dropped just
to get a pretty huge amount of free RAM.

With swappiness set to 100, you basically get what you expect: swapping.
But at least to me, that swapping looks _a lot_ smarter than what it did
for the default swappiness of 60 or the 0 swappiness. Swap is growing,
but so are the buffers, and the cache also only shrinks at a single
point, probably when the "sort" process starts to grow. Plus, the amount
of free memory isn't growing to insane sizes like in the other cases.

vmstat output for both cases to be found below.

Björn

vmstat output for swappiness = 0

procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
 1  0      0  25140  37712  65304    1    1     7    14    4   31  0  0 99  0
 4  0      0  25132  37736  65312    0    0     0    38  212  604  1  0 98  1
 2  0      0  25132  37736  65312    0    0     0     0  177  479  0  0 100  0
 3  1      0  17252  42568  65312    0    0  1516    23  641 2332  1  3 54 41
 3  2      0  15172  45412  59908    0    0  1567   482  585 2051  1  4 50 45
 2  2      0  20436  44320  54524    0    0   743     9  368 1196  0  1 50 49
 3  2      0  28416  36580  54520    0    0   533     4  312 1016  0  1 50 49
 1  2      4  44316  22780  54464    0    0   128   191  240  786  1  1 43 54
 3  0   3884  55256  18112  45772    0    0   356   277  318  937  0  3 39 57
 1  2   3924  57276  19004  40700    0    0   631   117  347 1160  0  1 50 48
 0  1   4108  61328  15348  40344    0    0   768   301  378 1218  0  1 50 49
 1  1   4276  60812  15612  40216    0  300   585   359  344 1045  0  1 50 49
 0  2   4276  62184  17484  39624    0  995   703  1208  370 1188  0  2 50 48
 0  2   4296  68244  14616  36268    0    0   360    11  275  973  0  1 50 49
 2  2   4296  75292   6976  36016    0  137   667   480  424 1315  0  3 50 47
 3  1   4300  78984   6344  33392    0    0   639   635  517 1142  0  3 49 47
 2  1   4300  80816   5520  32520    0    1   992   587  683 1479  0  7 48 45
 1  2   4556  82244   3704  32504    0   85   607   659  452 1040  0  3 50 47
 0  1   4556  81600   4972  32420    0    0   665    44  362 1040  0  1 50 49
 0  2   4940  80364   4588  32508    0  128   552   539  375  995  0  3 50 47
 0  1   5004  83116   3576  32420    0   21   416   591  405  862  0  3 49 47
 0  1   5004  80196   5388  32440    0    0   604     0  328 1014  0  2 50 48
 0  1   5004  82976   2548  32544    0    0   461   343  363  923  0  4 49 47
 1  1   5004  81528   3780  32472    0    0  1124   157  542 1524  1  4 49 47
 0  1   5516  81940   4000  32488    0  171   865   575  489 1356  0  4 49 46
 0  2   5804  82412   2380  32516    0   96   660   423  385 1160  1  6 42 51
 0  2   5804  81476   2868  32480    0    0   864   204  493 1242  0  5 50 45
 0  1   6268  83124   2088  32508    0  155   678   551  409 1107  0  7 46 47
 0  2   6268  83216   1576  32380    0    0   771   153  450 1330  1 11 43 46
 0  3  59420  97888    736  32224    0 17717   300 18035  375  869  0 27 12 60
 0  4 176160 214288    800  32316    0 38913    23 38917  347  502  0  6 30 64
 1  2 176212 242608   2752  32716    0   17   683    95  441 1256  0  4 41 54
 1  1 176212 237464   5492  32568    0    0   883   188  452 1488  1  2 50 48
 1  0 176212 232296   9628  32636    0    0  1368   263  533 1690  1  2 50 47
 0  1 176212 225852  13264  32652    0    0  1212     0  480 1818  1  3 50 46
 0  1 176212 202076  31708  32660    0    0  6143   348 1723 5654  2  7 50 41
 0  1 176212 177196  49952  32560    0    0  6081     0 1698 5413  1  6 50 43
 0  1 176212 147744  58332  32652    0    0  2791   467  884 3565  1  5 50 44
 0  1 176212 130604  63788  32664    0    0  1813   407  645 2637  1  5 50 44
 0  1 176212 119076  68012  32584    0    0  1408     0  529 2239  0  4 50 45
 2  1 176212  74112  83696  32600    0    0  5225   667 1496 7206  5 13 50 33
 1  1 176212  29296  99788  32620    0    0  5360    16 1524 7009  4 15 49 32
 0  1 176212  16012 105112  32660    0    0  1773  2901  891 2417  1  4 50 45
 1  1 194444  16656 117236  32624    0 6077  4036  6337 1228 6040  6  9 49 36
 1  1 194572  15996 122056  32568    0   43  1607    43  579 2740  1  5 50 44
 0  1 209788  15888 125520  32636    0 5072  1149  5520  503 1836  1  4 49 46
 0  1 231568  17304 133968  32884   21 7260  2933  7260  922 3912  2  9 46 43
 0  1 231568  16300 139004  32980    0    0  1695   523  636 2077  1  3 49 46
 1  1 238440  15900 145208  33072    0 2291  2102  2722  736 2482  1  5 49 46
 2  0 246140  15940 147788  32980    0 2545   860  2545  407 1353 21  3 39 36
 4  0 246140  16712 147680  32980    0    0     0   247  190  544 50  0 50  0
 3  0 246140  15392 147680  32980    0    0     0     0  177  508 50  1 49  0
 3  0 277644  18180 147688  32980    0 10501     0 10511  229  518 50  0 47  2
 4  0 277644  15940 147688  32980    0    0     0  1747  361  514 50  0 49  1
 4  0 277644  16880 147700  33212    0    0    79    15  221  519 49  0 50  1
 0  2 309192  13900 147560  61856    0 10516    11 10523  186  528 46  3 49  2
 4  0 315176  70264 149128  62880    0 1995   411 11668  506 2372  5  3 38 53
 0  0 315176  95912 149212  38104    0    0   132    68  197 16128 23  6 69  2
 0  0 315176  95920 149232  38104    0    0     0  1568  216  488  0  0 98  1
 0  0 315176  95920 149240  38104    0    0     0     9  201  662  0  1 99  0


------------------------


vmstat output for swappiness = 100

procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
 1  0      0  17120 150356  45104    1    1     8    14    4   32  0  0 99  0
 1  0      0  17072 150360  45160    0    0     1     0  190  700  0  0 100  0
 0  0      0  17072 150380  45160    0    0     0    44  196  610  0  1 98  1
 0  1   6944  15320 154124  45304    0 2315  1211  2315  582 2141  0  4 54 41
 3  1  17752  16780 159000  45164    0 3603  1614  4039  618 2062  0  2 48 50
 2  1  17876  15700 163044  45228    0   41  1348    41  514 2013  0  2 50 48
 3  1  32372  16872 166124  45180    0 4832  1021  5104  491 1888  1  4 50 45
 0  1  39964  16640 168620  45184    0 2531   844  2564  427 1331  0  4 50 46
 0  1  39964  15868 170580  45216    0    0   651   331  351 1096  0  1 50 49
 0  1  47312  16164 172184  45240    0 2449   529  2653  336  915  0  1 50 49
 3  1  55180  15392 174656  45140    0 2623   825  2623  397 1212  1  1 50 48
 0  1  63256  15648 177380  45168    0 2692   904  3085  433 1527  1  4 50 45
 2  1  68672  15408 180608  45136    0 1805  1076  2199  516 1506  0  3 50 47
 2  1  73804  16628 182420  45156    0 1711   599  2144  352 1066  1  1 50 48
 2  1  77396  16412 184192  45152    0 1197   588  1559  337 1066  0  0 50 50
 2  1  79668  16492 185944  45112    0  757   581   773  334 1058  0  2 50 48
 3  1  88964  15588 187452  45092    0 3099   500  3480  331 1046  0  1 49 50
 2  1  89040  16700 188940  45072    0   25   495    55  313 1135  0  1 50 49
 4  1  97700  15716 192584  45108    0 2887  1212  3197  503 1706  0  3 49 48
 3  1  99952  15564 195144  45056    0  751   851  2420  650 1289  0  3 50 47
 2  1 108624  15988 198256  45084    0 2891  1035  3045  455 1449  0  2 50 48
 2  1 117380  16664 200972  45080    0 2919   911  3257  430 1368  1  3 50 46
 3  1 175564  44768 180728  43316   11 19383   321 19412  370 2982  4 22 43 31
 5  0 175664  53424 160468  43048   11   33  1617   189  586 2834  1  8 50 41
 2  1 175744  54132 153648  42920    0   27  1163  1571  495 2032  1  6 49 44
 2  1 176116  41212 144836  32460    0  103  5997   756 1692 8567  7 18 49 27
 4  0 197192  40988 150000  19180   11 5592  3716  5592 1133 5697  3  9 47 41
 2  1 212884  45396 156332  19144   11 5231  2119  5573  746 2952  0  5 49 46
 3  1 226452  25416 166504  19132    0 4523  4388  4527 1301 6233  4 14 49 33
 3  1 233632  26628 168816  19188   11 2393   779  2676  394 1376  0  2 50 48
 2  1 242304  25748 171292  19192   21 2891  1189  3339  496 1856  1  4 50 45
 3  0 259492  24100 176708  19192    0 5729  1871  5739  678 2703  1  5 50 44
 1  1 259512  16628 184492  18864    0    7  2591  1047  969 3416  1  7 50 42
 2  1 270404  16984 190096  18920   11 3631  2035  3643  712 2367  1  4 50 45
 2  1 276056  17440 191416  18860   43 1884   656  4713  575 1212  0  2 50 48
 3  0 280704  16040 192140  18932    0 1549   439  1561  301  950 41  1 38 20
 4  0 280704  16200 192124  18932   21    0    21  1384  348  531 50  0 49  0
 3  0 280704  16352 192132  18932   11    0    11     9  183  524 50  0 50  0
 3  0 280704  15396 192132  18932   11    0    11     0  180  519 50  0 50  0
 3  0 286300  15740 191632  18932   11 1865    11  1877  194  529 49  0 50  1
 3  0 286300  16216 191644  19032   85    0   128     0  183  539 50  0 49  1
 3  0 324104  15824 191784  48024   21 12601   108 15856  299  678 22  4 45 29
 4  0 323904  62648 193092  51844   11    0   375    28  347 16416 26  6 43 25
 2  0 323904  92140 193156  23880   11    0    82  1609  220 1439  1  2 95  3

-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to [email protected]
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

[Index of Archives]     [Kernel Newbies]     [Netfilter]     [Bugtraq]     [Photo]     [Stuff]     [Gimp]     [Yosemite News]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux RAID]     [Video 4 Linux]     [Linux for the blind]     [Linux Resources]
  Powered by Linux