Commit de08eaa6 authored by Yu Zhao's avatar Yu Zhao Committed by Andrew Morton

mm: multi-gen LRU: fix crash during cgroup migration

lru_gen_migrate_mm() assumes lru_gen_add_mm() runs prior to itself.  This
isn't true for the following scenario:

    CPU 1                         CPU 2

  clone()
    cgroup_can_fork()
                                cgroup_procs_write()
    cgroup_post_fork()
                                  task_lock()
                                  lru_gen_migrate_mm()
                                  task_unlock()
    task_lock()
    lru_gen_add_mm()
    task_unlock()

And when the above happens, kernel crashes because of linked list
corruption (mm_struct->lru_gen.list).

Link: https://lore.kernel.org/r/20230115134651.30028-1-msizanoen@qtmlabs.xyz/
Link: https://lkml.kernel.org/r/20230116034405.2960276-1-yuzhao@google.com
Fixes: bd74fdae ("mm: multi-gen LRU: support page table walks")
Signed-off-by: default avatarYu Zhao <yuzhao@google.com>
Reported-by: default avatarmsizanoen <msizanoen@qtmlabs.xyz>
Tested-by: default avatarmsizanoen <msizanoen@qtmlabs.xyz>
Cc: <stable@vger.kernel.org>	[6.1+]
Signed-off-by: default avatarAndrew Morton <akpm@linux-foundation.org>
parent 55ab834a
...@@ -3323,13 +3323,16 @@ void lru_gen_migrate_mm(struct mm_struct *mm) ...@@ -3323,13 +3323,16 @@ void lru_gen_migrate_mm(struct mm_struct *mm)
if (mem_cgroup_disabled()) if (mem_cgroup_disabled())
return; return;
/* migration can happen before addition */
if (!mm->lru_gen.memcg)
return;
rcu_read_lock(); rcu_read_lock();
memcg = mem_cgroup_from_task(task); memcg = mem_cgroup_from_task(task);
rcu_read_unlock(); rcu_read_unlock();
if (memcg == mm->lru_gen.memcg) if (memcg == mm->lru_gen.memcg)
return; return;
VM_WARN_ON_ONCE(!mm->lru_gen.memcg);
VM_WARN_ON_ONCE(list_empty(&mm->lru_gen.list)); VM_WARN_ON_ONCE(list_empty(&mm->lru_gen.list));
lru_gen_del_mm(mm); lru_gen_del_mm(mm);
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment