Commit 0152f3a2 authored by Sean McGivern's avatar Sean McGivern

Merge branch 'sidekiq-queue-selector-documentation' into 'master'

Fix and clarify import example on Sidekiq extra processes docs

See merge request gitlab-org/gitlab!64301
parents 8ddd7787 12aad2d1
...@@ -95,13 +95,16 @@ To view the Sidekiq processes in GitLab: ...@@ -95,13 +95,16 @@ To view the Sidekiq processes in GitLab:
## Negate settings ## Negate settings
To have the additional Sidekiq processes work on every queue **except** the ones To have the additional Sidekiq processes work on every queue **except** the ones
you list: you list. In this example, we exclude all import-related jobs from a Sidekiq node:
1. After you follow the steps for [starting extra processes](#start-multiple-processes), 1. After you follow the steps for [starting extra processes](#start-multiple-processes),
edit `/etc/gitlab/gitlab.rb` and add: edit `/etc/gitlab/gitlab.rb` and add:
```ruby ```ruby
sidekiq['negate'] = true sidekiq['negate'] = true
sidekiq['queue_groups'] = [
"feature_category=importers"
]
``` ```
1. Save the file and reconfigure GitLab for the changes to take effect: 1. Save the file and reconfigure GitLab for the changes to take effect:
...@@ -180,32 +183,21 @@ for Sidekiq are respected. ...@@ -180,32 +183,21 @@ for Sidekiq are respected.
By default, logs for `sidekiq-cluster` go to `/var/log/gitlab/sidekiq` By default, logs for `sidekiq-cluster` go to `/var/log/gitlab/sidekiq`
like regular Sidekiq logs. like regular Sidekiq logs.
## Ignore all GitHub import queues ## Ignore all import queues
When [importing from GitHub](../../user/project/import/github.md), Sidekiq might When [importing from GitHub](../../user/project/import/github.md) or
use all of its resources to perform those operations. To set up a separate other sources, Sidekiq might use all of its resources to perform those
`sidekiq-cluster` process to ignore all GitHub import-related queues: operations. To set up two separate `sidekiq-cluster` processes, where
one only processes imports and the other processes all other queues:
1. Edit `/etc/gitlab/gitlab.rb` and add: 1. Edit `/etc/gitlab/gitlab.rb` and add:
```ruby ```ruby
sidekiq['enable'] = true sidekiq['enable'] = true
sidekiq['negate'] = true sidekiq['queue_selector'] = true
sidekiq['queue_groups'] = [ sidekiq['queue_groups'] = [
"github_import_advance_stage", "feature_category=importers",
"github_importer:github_import_import_diff_note", "feature_category!=importers"
"github_importer:github_import_import_issue",
"github_importer:github_import_import_note",
"github_importer:github_import_import_lfs_object",
"github_importer:github_import_import_pull_request",
"github_importer:github_import_refresh_import_jid",
"github_importer:github_import_stage_finish_import",
"github_importer:github_import_stage_import_base_data",
"github_importer:github_import_stage_import_issues_and_diff_notes",
"github_importer:github_import_stage_import_notes",
"github_importer:github_import_stage_import_lfs_objects",
"github_importer:github_import_stage_import_pull_requests",
"github_importer:github_import_stage_import_repository"
] ]
``` ```
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment