• Mike Rapoport's avatar
    mm/page_alloc.c: refactor initialization of struct page for holes in memory layout · 0740a50b
    Mike Rapoport authored
    There could be struct pages that are not backed by actual physical memory.
    This can happen when the actual memory bank is not a multiple of
    SECTION_SIZE or when an architecture does not register memory holes
    reserved by the firmware as memblock.memory.
    
    Such pages are currently initialized using init_unavailable_mem() function
    that iterates through PFNs in holes in memblock.memory and if there is a
    struct page corresponding to a PFN, the fields of this page are set to
    default values and it is marked as Reserved.
    
    init_unavailable_mem() does not take into account zone and node the page
    belongs to and sets both zone and node links in struct page to zero.
    
    Before commit 73a6e474 ("mm: memmap_init: iterate over memblock
    regions rather that check each PFN") the holes inside a zone were
    re-initialized during memmap_init() and got their zone/node links right.
    However, after that commit nothing updates the struct pages representing
    such holes.
    
    On a system that has firmware reserved holes in a zone above ZONE_DMA, for
    instance in a configuration below:
    
    	# grep -A1 E820 /proc/iomem
    	7a17b000-7a216fff : Unknown E820 type
    	7a217000-7bffffff : System RAM
    
    unset zone link in struct page will trigger
    
    	VM_BUG_ON_PAGE(!zone_spans_pfn(page_zone(page), pfn), page);
    
    in set_pfnblock_flags_mask() when called with a struct page from a range
    other than E820_TYPE_RAM because there are pages in the range of
    ZONE_DMA32 but the unset zone link in struct page makes them appear as a
    part of ZONE_DMA.
    
    Interleave initialization of the unavailable pages with the normal
    initialization of memory map, so that zone and node information will be
    properly set on struct pages that are not backed by the actual memory.
    
    With this change the pages for holes inside a zone will get proper
    zone/node links and the pages that are not spanned by any node will get
    links to the adjacent zone/node.  The holes between nodes will be
    prepended to the zone/node above the hole and the trailing pages in the
    last section that will be appended to the zone/node below.
    
    [akpm@linux-foundation.org: don't initialize static to zero, use %llu for u64]
    
    Link: https://lkml.kernel.org/r/20210225224351.7356-2-rppt@kernel.org
    Fixes: 73a6e474 ("mm: memmap_init: iterate over memblock regions rather that check each PFN")
    Signed-off-by: default avatarMike Rapoport <rppt@linux.ibm.com>
    Reported-by: default avatarQian Cai <cai@lca.pw>
    Reported-by: default avatarAndrea Arcangeli <aarcange@redhat.com>
    Reviewed-by: default avatarBaoquan He <bhe@redhat.com>
    Acked-by: default avatarVlastimil Babka <vbabka@suse.cz>
    Reviewed-by: default avatarDavid Hildenbrand <david@redhat.com>
    Cc: Borislav Petkov <bp@alien8.de>
    Cc: Chris Wilson <chris@chris-wilson.co.uk>
    Cc: "H. Peter Anvin" <hpa@zytor.com>
    Cc: Łukasz Majczak <lma@semihalf.com>
    Cc: Ingo Molnar <mingo@redhat.com>
    Cc: Mel Gorman <mgorman@suse.de>
    Cc: Michal Hocko <mhocko@kernel.org>
    Cc: "Sarvela, Tomi P" <tomi.p.sarvela@intel.com>
    Cc: Thomas Gleixner <tglx@linutronix.de>
    Cc: <stable@vger.kernel.org>
    Signed-off-by: default avatarAndrew Morton <akpm@linux-foundation.org>
    Signed-off-by: default avatarLinus Torvalds <torvalds@linux-foundation.org>
    0740a50b
page_alloc.c 248 KB