[PATCH 00/16] Balancing the scan rate of major caches V3

Changes since V2:
- fix divide error in shrink_slab()
- more debug/accounting code
- fine grained priority/scan quantity
- reluctant to reclaim lowest zone if it is out of sync with highest zone

Changes since V1:
- better broken up of patches
- replace pages_more_aged with age_ge/age_gt
- expanded shrink_slab interface
- rewrite kswapd rebalance logic to be simple and robust


This patch balances the aging rates of active_list/inactive_list/slab.

It started out as an effort to enable the adaptive read-ahead to handle large
number of concurrent readers. Then I found it envolves much more stuffs, and
deserves a standalone patchset to address the balancing problem as a whole.


The whole picture of balancing:

- In each node, inactive_list scan rates are synced with each other
  It is done in the direct/kswapd reclaim path.

- In each zone, active_list scan rate always follows that of inactive_list

- Slab cache scan rates always follow that of the current node.
  Since shrink_slab() can be called from different CPUs, that effectly sync
  slab cache scan rates with that of the most scanned node.


The patches is grouped as follows:

- balancing stuffs
mm-revert-vmscan-balancing-fix.patch
mm-simplify-kswapd-reclaim-code.patch
mm-balance-zone-aging-supporting-facilities.patch
mm-balance-zone-aging-in-direct-reclaim.patch
mm-balance-zone-aging-in-kswapd-reclaim.patch
mm-balance-slab-aging.patch
mm-balance-active-inactive-list-aging.patch
mm-fine-grained-scan-priority.patch

- pure code cleanups
mm-remove-unnecessary-variable-and-loop.patch
mm-remove-swap-cluster-max-from-scan-control.patch
mm-accumulate-nr-scanned-reclaimed-in-scan-control.patch
mm-fold-bool-variables-into-flags-in-scan-control.patch

- minor fix
mm-scan-accounting-fix.patch

- debug code
mm-account-zone-aging-rounds.patch
mm-page-reclaim-debug-traces.patch
mm-kswapd-reclaim-debug-trace.patch

Thanks,
Wu Fengguang

--
Dept. Automation                University of Science and Technology of China
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to [email protected]
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

---

• Follow-Ups:
  • [PATCH 12/16] mm: fold sc.may_writepage and sc.may_swap into sc.flags
    • From: Wu Fengguang <[email protected]>
  • [PATCH 11/16] mm: let sc.nr_scanned/sc.nr_reclaimed accumulate
    • From: Wu Fengguang <[email protected]>
  • [PATCH 15/16] mm: add page reclaim debug traces
    • From: Wu Fengguang <[email protected]>
  • [PATCH 14/16] mm: zone aging rounds accounting
    • From: Wu Fengguang <[email protected]>
  • [PATCH 16/16] mm: kswapd reclaim debug trace
    • From: Wu Fengguang <[email protected]>
  • [PATCH 13/16] mm: fix minor scan count bugs
    • From: Wu Fengguang <[email protected]>
  • [PATCH 08/16] mm: fine grained scan priority
    • From: Wu Fengguang <[email protected]>
  • [PATCH 10/16] mm: remove swap_cluster_max from scan_control
    • From: Wu Fengguang <[email protected]>
  • [PATCH 09/16] mm: remove unnecessary variable and loop
    • From: Wu Fengguang <[email protected]>
  • [PATCH 05/16] mm: balance zone aging in kswapd reclaim path
    • From: Wu Fengguang <[email protected]>
  • [PATCH 06/16] mm: balance slab aging
    • From: Wu Fengguang <[email protected]>
  • [PATCH 07/16] mm: balance active/inactive list scan rates
    • From: Wu Fengguang <[email protected]>
  • [PATCH 04/16] mm: balance zone aging in direct reclaim path
    • From: Wu Fengguang <[email protected]>
  • [PATCH 02/16] mm: simplify kswapd reclaim code
    • From: Wu Fengguang <[email protected]>
  • [PATCH 03/16] mm: supporting variables and functions for balanced zone aging
    • From: Wu Fengguang <[email protected]>
  • [PATCH 01/16] mm: restore sc.nr_to_reclaim
    • From: Wu Fengguang <[email protected]>

• Prev by Date: [SCSI] SCSI block devices larger then 2TB
• Next by Date: [PATCH 01/16] mm: restore sc.nr_to_reclaim
• Previous by thread: [SCSI] SCSI block devices larger then 2TB
• Next by thread: [PATCH 01/16] mm: restore sc.nr_to_reclaim
• Index(es):
  • Date
  • Thread

[Index of Archives]     [Kernel Newbies]     [Netfilter]     [Bugtraq]     [Photo]     [Stuff]     [Gimp]     [Yosemite News]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux RAID]     [Video 4 Linux]     [Linux for the blind]     [Linux Resources]