Commit 084e3552 authored by Douwe Maan's avatar Douwe Maan

Merge branch 'orphaned-repo-cleanup' into 'master'

Improve repo cleanup task

I accidentally wrote a new script, not seeing we already had one.
But the old one did not do enough (it only handled global namespace orhpans) so I figured I should just drop in the new script.

See merge request !1298
parents 230d6c87 255d5f75
...@@ -12,7 +12,8 @@ sudo gitlab-rake gitlab:cleanup:dirs ...@@ -12,7 +12,8 @@ sudo gitlab-rake gitlab:cleanup:dirs
bundle exec rake gitlab:cleanup:dirs RAILS_ENV=production bundle exec rake gitlab:cleanup:dirs RAILS_ENV=production
``` ```
Remove repositories (global only for now) from `/home/git/repositories` if they don't exist in GitLab database. Rename repositories from `/home/git/repositories` if they don't exist in GitLab database.
The repositories get a `+orphaned+TIMESTAMP` suffix so that they cannot block new repositories from being created.
``` ```
# omnibus-gitlab # omnibus-gitlab
......
...@@ -46,42 +46,23 @@ namespace :gitlab do ...@@ -46,42 +46,23 @@ namespace :gitlab do
desc "GitLab | Cleanup | Clean repositories" desc "GitLab | Cleanup | Clean repositories"
task repos: :environment do task repos: :environment do
warn_user_is_not_gitlab warn_user_is_not_gitlab
remove_flag = ENV['REMOVE']
git_base_path = Gitlab.config.gitlab_shell.repos_path
all_dirs = Dir.glob(git_base_path + '/*')
global_projects = Project.in_namespace(nil).pluck(:path)
puts git_base_path.yellow
puts "Looking for global repos to remove... "
# skip non git repo
all_dirs.select! do |dir|
dir =~ /.git$/
end
# skip existing repos
all_dirs.reject! do |dir|
repo_name = File.basename dir
path = repo_name.gsub(/\.git$/, "")
global_projects.include?(path)
end
all_dirs.each do |dir_path| move_suffix = "+orphaned+#{Time.now.to_i}"
if remove_flag repo_root = Gitlab.config.gitlab_shell.repos_path
if FileUtils.rm_rf dir_path # Look for global repos (legacy, depth 1) and normal repos (depth 2)
puts "Removed...#{dir_path}".red IO.popen(%W(find #{repo_root} -mindepth 1 -maxdepth 2 -name *.git)) do |find|
else find.each_line do |path|
puts "Cannot remove #{dir_path}".red path.chomp!
repo_with_namespace = path.
sub(repo_root, '').
sub(%r{^/*}, '').
chomp('.git').
chomp('.wiki')
next if Project.find_with_namespace(repo_with_namespace)
new_path = path + move_suffix
puts path.inspect + ' -> ' + new_path.inspect
File.rename(path, new_path)
end end
else
puts "Can be removed: #{dir_path}".red
end
end
unless remove_flag
puts "To cleanup this directories run this command with REMOVE=true".yellow
end end
end end
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment