• Muchun Song's avatar
    mm: fix missing cache flush for all tail pages of compound page · 2771739a
    Muchun Song authored
    The D-cache maintenance inside move_to_new_page() only consider one
    page, there is still D-cache maintenance issue for tail pages of
    compound page (e.g. THP or HugeTLB).
    
    THP migration is only enabled on x86_64, ARM64 and powerpc, while
    powerpc and arm64 need to maintain the consistency between I-Cache and
    D-Cache, which depends on flush_dcache_page() to maintain the
    consistency between I-Cache and D-Cache.
    
    But there is no issues on arm64 and powerpc since they already considers
    the compound page cache flushing in their icache flush function.
    HugeTLB migration is enabled on arm, arm64, mips, parisc, powerpc,
    riscv, s390 and sh, while arm has handled the compound page cache flush
    in flush_dcache_page(), but most others do not.
    
    In theory, the issue exists on many architectures.  Fix this by not
    using flush_dcache_folio() since it is not backportable.
    
    Link: https://lkml.kernel.org/r/20220210123058.79206-3-songmuchun@bytedance.com
    Fixes: 290408d4 ("hugetlb: hugepage migration core")
    Signed-off-by: default avatarMuchun Song <songmuchun@bytedance.com>
    Reviewed-by: default avatarZi Yan <ziy@nvidia.com>
    Cc: Axel Rasmussen <axelrasmussen@google.com>
    Cc: David Rientjes <rientjes@google.com>
    Cc: Fam Zheng <fam.zheng@bytedance.com>
    Cc: Kirill A. Shutemov <kirill.shutemov@linux.intel.com>
    Cc: Lars Persson <lars.persson@axis.com>
    Cc: Mike Kravetz <mike.kravetz@oracle.com>
    Cc: Peter Xu <peterx@redhat.com>
    Cc: Xiongchun Duan <duanxiongchun@bytedance.com>
    Signed-off-by: default avatarAndrew Morton <akpm@linux-foundation.org>
    Signed-off-by: default avatarLinus Torvalds <torvalds@linux-foundation.org>
    2771739a
migrate.c 88.1 KB