Commit b6dd0865 authored by Dave Chinner's avatar Dave Chinner Committed by Dave Chinner

radix-tree: clear all tags in radix_tree_node_rcu_free

Commit f446daae ("mm: implement
writeback livelock avoidance using page tagging") introduced a new
radix tree tag, increasing the number of tags in each node from 2 to
3. It did not, however, fix up the code in
radix_tree_node_rcu_free() that cleans up after radix_tree_shrink()
and hence could leave stray tags set in the new tag array.

The result is that the livelock avoidance code added in the the
above commit would hit stale tags when doing tag based lookups,
resulting in livelocks when trying to traverse the tree.

Fix this problem in radix_tree_node_rcu_free() so it doesn't happen
again in the future by using a loop to walk all the tags up to
RADIX_TREE_MAX_TAGS to clear the stray tags radix_tree_shrink()
leaves behind.
Signed-off-by: default avatarDave Chinner <dchinner@redhat.com>
Acked-by: default avatarNick Piggin <npiggin@kernel.dk>
Acked-by: default avatarJan Kara <jack@suse.cz>
parent da5cabf8
...@@ -174,14 +174,16 @@ static void radix_tree_node_rcu_free(struct rcu_head *head) ...@@ -174,14 +174,16 @@ static void radix_tree_node_rcu_free(struct rcu_head *head)
{ {
struct radix_tree_node *node = struct radix_tree_node *node =
container_of(head, struct radix_tree_node, rcu_head); container_of(head, struct radix_tree_node, rcu_head);
int i;
/* /*
* must only free zeroed nodes into the slab. radix_tree_shrink * must only free zeroed nodes into the slab. radix_tree_shrink
* can leave us with a non-NULL entry in the first slot, so clear * can leave us with a non-NULL entry in the first slot, so clear
* that here to make sure. * that here to make sure.
*/ */
tag_clear(node, 0, 0); for (i = 0; i < RADIX_TREE_MAX_TAGS; i++)
tag_clear(node, 1, 0); tag_clear(node, i, 0);
node->slots[0] = NULL; node->slots[0] = NULL;
node->count = 0; node->count = 0;
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment