• Anshuman Khandual's avatar
    arm64/mm: Change THP helpers to comply with generic MM semantics · b65399f6
    Anshuman Khandual authored
    pmd_present() and pmd_trans_huge() are expected to behave in the following
    manner during various phases of a given PMD. It is derived from a previous
    detailed discussion on this topic [1] and present THP documentation [2].
    
    pmd_present(pmd):
    
    - Returns true if pmd refers to system RAM with a valid pmd_page(pmd)
    - Returns false if pmd refers to a migration or swap entry
    
    pmd_trans_huge(pmd):
    
    - Returns true if pmd refers to system RAM and is a trans huge mapping
    
    -------------------------------------------------------------------------
    |	PMD states	|	pmd_present	|	pmd_trans_huge	|
    -------------------------------------------------------------------------
    |	Mapped		|	Yes		|	Yes		|
    -------------------------------------------------------------------------
    |	Splitting	|	Yes		|	Yes		|
    -------------------------------------------------------------------------
    |	Migration/Swap	|	No		|	No		|
    -------------------------------------------------------------------------
    
    The problem:
    
    PMD is first invalidated with pmdp_invalidate() before it's splitting. This
    invalidation clears PMD_SECT_VALID as below.
    
    PMD Split -> pmdp_invalidate() -> pmd_mkinvalid -> Clears PMD_SECT_VALID
    
    Once PMD_SECT_VALID gets cleared, it results in pmd_present() return false
    on the PMD entry. It will need another bit apart from PMD_SECT_VALID to re-
    affirm pmd_present() as true during the THP split process. To comply with
    above mentioned semantics, pmd_trans_huge() should also check pmd_present()
    first before testing presence of an actual transparent huge mapping.
    
    The solution:
    
    Ideally PMD_TYPE_SECT should have been used here instead. But it shares the
    bit position with PMD_SECT_VALID which is used for THP invalidation. Hence
    it will not be there for pmd_present() check after pmdp_invalidate().
    
    A new software defined PMD_PRESENT_INVALID (bit 59) can be set on the PMD
    entry during invalidation which can help pmd_present() return true and in
    recognizing the fact that it still points to memory.
    
    This bit is transient. During the split process it will be overridden by a
    page table page representing normal pages in place of erstwhile huge page.
    Other pmdp_invalidate() callers always write a fresh PMD value on the entry
    overriding this transient PMD_PRESENT_INVALID bit, which makes it safe.
    
    [1]: https://lkml.org/lkml/2018/10/17/231
    [2]: https://www.kernel.org/doc/Documentation/vm/transhuge.txtSigned-off-by: default avatarAnshuman Khandual <anshuman.khandual@arm.com>
    Reviewed-by: default avatarCatalin Marinas <catalin.marinas@arm.com>
    Cc: Catalin Marinas <catalin.marinas@arm.com>
    Cc: Will Deacon <will@kernel.org>
    Cc: Mark Rutland <mark.rutland@arm.com>
    Cc: Marc Zyngier <maz@kernel.org>
    Cc: Suzuki Poulose <suzuki.poulose@arm.com>
    Cc: linux-arm-kernel@lists.infradead.org
    Cc: linux-kernel@vger.kernel.org
    Link: https://lore.kernel.org/r/1599627183-14453-2-git-send-email-anshuman.khandual@arm.comSigned-off-by: default avatarWill Deacon <will@kernel.org>
    b65399f6
pgtable-prot.h 4.82 KB