Commit 6f3fa06f authored by Marcel Amirault's avatar Marcel Amirault Committed by Achilleas Pipinellis

Change docs markdown linter

Change from ruby mdl to node markdownlint, add
config file to root of project, delete old config
file, update exceptions, and fix one doc that
was didn't meet standards
parent d58fb67f
...@@ -65,7 +65,7 @@ docs lint: ...@@ -65,7 +65,7 @@ docs lint:
- mv doc/ /tmp/gitlab-docs/content/$DOCS_GITLAB_REPO_SUFFIX - mv doc/ /tmp/gitlab-docs/content/$DOCS_GITLAB_REPO_SUFFIX
- cd /tmp/gitlab-docs - cd /tmp/gitlab-docs
# Lint Markdown # Lint Markdown
- bundle exec mdl content/$DOCS_GITLAB_REPO_SUFFIX -c $CI_PROJECT_DIR/.mdlrc - markdownlint --config $CI_PROJECT_DIR/.markdownlint.json content/$DOCS_GITLAB_REPO_SUFFIX/**/*.md
# Build HTML from Markdown # Build HTML from Markdown
- bundle exec nanoc - bundle exec nanoc
# Check the internal links # Check the internal links
......
{
"default": true,
"first-header-h1": true,
"header-style": {
"style": "atx"
},
"ul-style": {
"style": "dash"
},
"line-length": false,
"commands-show-output": false,
"no-duplicate-header": {
"allow_different_nesting": true
},
"no-trailing-punctuation": {
"punctuation": ".,;:!。,;:!?"
},
"ol-prefix": {
"style": "one"
},
"no-inline-html": false,
"hr-style": {
"style": "---"
},
"no-emphasis-as-heading": false,
"fenced-code-language": false,
"first-line-h1": false,
"code-block-style": {
"style": "fenced"
}
}
# This is the options file for mdl, configured in .gitlab/ci/docs.gitlab-ci.yml,
# and related to the style file ./mdlrc.style
# See https://github.com/markdownlint/markdownlint/blob/master/docs/configuration.md
ignore_front_matter true
style File.expand_path('.mdlrc.style', __dir__)
# This is the style file for mdl, configured in .gitlab/ci/docs.gitlab-ci.yml,
# and related to the options file ./mdlrc
# See https://github.com/markdownlint/markdownlint/blob/master/docs/RULES.md
# for more detailed information on the rules and styles.
rule "MD001"
rule "MD002"
rule "MD003", :style => :atx
rule "MD006"
rule "MD010"
rule "MD011"
rule "MD012"
rule "MD019"
rule "MD022"
rule "MD023"
rule "MD025"
rule "MD028"
rule "MD029", :style => :one
rule "MD030"
# rule "MD032"
rule "MD034"
rule "MD037"
rule "MD038"
# Should not be used currently:
# rule "MD004", :style => :dash # unordered list style - dash
# False positives, see https://github.com/markdownlint/markdownlint/issues/261
# rule "MD039" # Spaces inside link text
# Crashes when link text has certain punctuation
# rubocop:disable Style/SignalException # rubocop:disable Style/SignalException
# frozen_string_literal: true # frozen_string_literal: true
has_only_docs_changes = helper.all_changed_files.all? { |file| file.start_with?('doc/', '.gitlab/ci/docs.gitlab-ci.yml', '.mdlrc') || file.end_with?('.md') } has_only_docs_changes = helper.all_changed_files.all? { |file| file.start_with?('doc/', '.gitlab/ci/docs.gitlab-ci.yml', '.markdownlint.json') || file.end_with?('.md') }
is_docs_only_branch = gitlab.branch_for_head =~ /(^docs[\/-].*|.*-docs$)/ is_docs_only_branch = gitlab.branch_for_head =~ /(^docs[\/-].*|.*-docs$)/
if is_docs_only_branch && !has_only_docs_changes if is_docs_only_branch && !has_only_docs_changes
......
...@@ -22,7 +22,7 @@ email_smime: ...@@ -22,7 +22,7 @@ email_smime:
``` ```
- Both files must be provided PEM-encoded. - Both files must be provided PEM-encoded.
- The key file must be unencrypted so that Gitlab can read it without user - The key file must be unencrypted so that Gitlab can read it without user
intervention. intervention.
NOTE: **Note:** Be mindful of the access levels for your private keys and visibility to NOTE: **Note:** Be mindful of the access levels for your private keys and visibility to
......
...@@ -6,7 +6,7 @@ To view rendered emails "sent" in your development instance, visit ...@@ -6,7 +6,7 @@ To view rendered emails "sent" in your development instance, visit
[`/rails/letter_opener`](http://localhost:3000/rails/letter_opener). [`/rails/letter_opener`](http://localhost:3000/rails/letter_opener).
Please note that [S/MIME signed](../administration/smime_signing_email.md) emails Please note that [S/MIME signed](../administration/smime_signing_email.md) emails
[cannot be currently previewed](https://github.com/fgrehm/letter_opener_web/issues/96) with [cannot be currently previewed](https://github.com/fgrehm/letter_opener_web/issues/96) with
`letter_opener`. `letter_opener`.
## Mailer previews ## Mailer previews
......
...@@ -20,8 +20,8 @@ every time the project is saved. ...@@ -20,8 +20,8 @@ every time the project is saved.
The summary of those statistics per namespace is then retrieved The summary of those statistics per namespace is then retrieved
by [`Namespaces#with_statistics`](https://gitlab.com/gitlab-org/gitlab-ce/blob/v12.2.0.pre/app/models/namespace.rb#L70) scope. Analyzing this query we noticed that: by [`Namespaces#with_statistics`](https://gitlab.com/gitlab-org/gitlab-ce/blob/v12.2.0.pre/app/models/namespace.rb#L70) scope. Analyzing this query we noticed that:
* It takes up to `1.2` seconds for namespaces with over `15k` projects. - It takes up to `1.2` seconds for namespaces with over `15k` projects.
* It can't be analyzed with [ChatOps](chatops_on_gitlabcom.md), as it times out. - It can't be analyzed with [ChatOps](chatops_on_gitlabcom.md), as it times out.
Additionally, the pattern that is currently used to update the project statistics Additionally, the pattern that is currently used to update the project statistics
(the callback) doesn't scale adequately. It is currently one of the largest (the callback) doesn't scale adequately. It is currently one of the largest
...@@ -62,8 +62,8 @@ REFRESH MATERIALIZED VIEW root_namespace_storage_statistics; ...@@ -62,8 +62,8 @@ REFRESH MATERIALIZED VIEW root_namespace_storage_statistics;
While this implied a single query update (and probably a fast one), it has some downsides: While this implied a single query update (and probably a fast one), it has some downsides:
* Materialized views syntax varies from PostgreSQL and MySQL. While this feature was worked on, MySQL was still supported by GitLab. - Materialized views syntax varies from PostgreSQL and MySQL. While this feature was worked on, MySQL was still supported by GitLab.
* Rails does not have native support for materialized views. We'd need to use a specialized gem to take care of the management of the database views, which implies additional work. - Rails does not have native support for materialized views. We'd need to use a specialized gem to take care of the management of the database views, which implies additional work.
### Attempt B: An update through a CTE ### Attempt B: An update through a CTE
...@@ -131,8 +131,8 @@ WHERE namespace_id IN ( ...@@ -131,8 +131,8 @@ WHERE namespace_id IN (
Even though this approach would make aggregating much easier, it has some major downsides: Even though this approach would make aggregating much easier, it has some major downsides:
* We'd have to migrate **all namespaces** by adding and filling a new column. Because of the size of the table, dealing with time/cost will not be great. The background migration will take approximately `153h`, see <https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/29772>. - We'd have to migrate **all namespaces** by adding and filling a new column. Because of the size of the table, dealing with time/cost will not be great. The background migration will take approximately `153h`, see <https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/29772>.
* Background migration has to be shipped one release before, delaying the functionality by another milestone. - Background migration has to be shipped one release before, delaying the functionality by another milestone.
### Attempt E (final): Update the namespace storage statistics in async way ### Attempt E (final): Update the namespace storage statistics in async way
...@@ -155,10 +155,10 @@ but we refresh them through Sidekiq jobs and in different transactions: ...@@ -155,10 +155,10 @@ but we refresh them through Sidekiq jobs and in different transactions:
This implementation has the following benefits: This implementation has the following benefits:
* All the updates are done async, so we're not increasing the length of the transactions for `project_statistics`. - All the updates are done async, so we're not increasing the length of the transactions for `project_statistics`.
* We're doing the update in a single SQL query. - We're doing the update in a single SQL query.
* It is compatible with PostgreSQL and MySQL. - It is compatible with PostgreSQL and MySQL.
* No background migration required. - No background migration required.
The only downside of this approach is that namespaces' statistics are updated up to `1.5` hours after the change is done, The only downside of this approach is that namespaces' statistics are updated up to `1.5` hours after the change is done,
which means there's a time window in which the statistics are inaccurate. Because we're still not which means there's a time window in which the statistics are inaccurate. Because we're still not
...@@ -171,8 +171,8 @@ performant approach of aggregating the root namespaces. ...@@ -171,8 +171,8 @@ performant approach of aggregating the root namespaces.
All the details regarding this use case can be found on: All the details regarding this use case can be found on:
* <https://gitlab.com/gitlab-org/gitlab-ce/issues/62214> - <https://gitlab.com/gitlab-org/gitlab-ce/issues/62214>
* Merge Request with the implementation: <https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/28996> - Merge Request with the implementation: <https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/28996>
Performance of the namespace storage statistics were measured in staging and production (GitLab.com). All results were posted Performance of the namespace storage statistics were measured in staging and production (GitLab.com). All results were posted
on <https://gitlab.com/gitlab-org/gitlab-ce/issues/64092>: No problem has been reported so far. on <https://gitlab.com/gitlab-org/gitlab-ce/issues/64092>: No problem has been reported so far.
...@@ -174,14 +174,14 @@ sequenceDiagram ...@@ -174,14 +174,14 @@ sequenceDiagram
c ->>+w: POST /some/url/upload c ->>+w: POST /some/url/upload
w->>+s: save the incoming file on a temporary location w->>+s: save the incoming file on a temporary location
s-->>-w: s-->>-w:
w->>+r: POST /some/url/upload w->>+r: POST /some/url/upload
Note over w,r: file was replaced with its location<br>and other metadata Note over w,r: file was replaced with its location<br>and other metadata
opt requires async processing opt requires async processing
r->>+redis: schedule a job r->>+redis: schedule a job
redis-->>-r: redis-->>-r:
end end
r-->>-c: request result r-->>-c: request result
...@@ -230,17 +230,17 @@ sequenceDiagram ...@@ -230,17 +230,17 @@ sequenceDiagram
w->>+os: PUT file w->>+os: PUT file
Note over w,os: file is stored on a temporary location. Rails select the destination Note over w,os: file is stored on a temporary location. Rails select the destination
os-->>-w: os-->>-w:
w->>+r: POST /some/url/upload w->>+r: POST /some/url/upload
Note over w,r: file was replaced with its location<br>and other metadata Note over w,r: file was replaced with its location<br>and other metadata
r->>+os: move object to final destination r->>+os: move object to final destination
os-->>-r: os-->>-r:
opt requires async processing opt requires async processing
r->>+redis: schedule a job r->>+redis: schedule a job
redis-->>-r: redis-->>-r:
end end
r-->>-c: request result r-->>-c: request result
...@@ -268,4 +268,3 @@ sequenceDiagram ...@@ -268,4 +268,3 @@ sequenceDiagram
This option affect the response to the `/authorize` call. When not enabled, the API response will not contain presigned URLs and workhorse will write the file the shared disk, on the path is provided by rails, acting like object storage was disabled. This option affect the response to the `/authorize` call. When not enabled, the API response will not contain presigned URLs and workhorse will write the file the shared disk, on the path is provided by rails, acting like object storage was disabled.
Once the request reachs rails, it will schedule an object storage upload as a sidekiq job. Once the request reachs rails, it will schedule an object storage upload as a sidekiq job.
...@@ -102,7 +102,7 @@ files to your local computer, automatically preserving the Git connection with t ...@@ -102,7 +102,7 @@ files to your local computer, automatically preserving the Git connection with t
remote repository. remote repository.
You can either clone it via HTTPS or [SSH](../ssh/README.md). If you chose to clone You can either clone it via HTTPS or [SSH](../ssh/README.md). If you chose to clone
it via HTTPS, you'll have to enter your credentials every time you pull and push. You can read more about credential storage in the [Git Credentials documentation](https://git-scm.com/book/en/v2/Git-Tools-Credential-Storage). With SSH, you enter your credentials only once. it via HTTPS, you'll have to enter your credentials every time you pull and push. You can read more about credential storage in the [Git Credentials documentation](https://git-scm.com/book/en/v2/Git-Tools-Credential-Storage). With SSH, you enter your credentials only once.
You can find both paths (HTTPS and SSH) by navigating to your project's landing page You can find both paths (HTTPS and SSH) by navigating to your project's landing page
and clicking **Clone**. GitLab will prompt you with both paths, from which you can copy and clicking **Clone**. GitLab will prompt you with both paths, from which you can copy
...@@ -157,7 +157,7 @@ git pull <REMOTE> <name-of-branch> ...@@ -157,7 +157,7 @@ git pull <REMOTE> <name-of-branch>
When you clone a repository, `REMOTE` is typically `origin`. This is where the When you clone a repository, `REMOTE` is typically `origin`. This is where the
repository was cloned from, and it indicates the SSH or HTTPS URL of the repository repository was cloned from, and it indicates the SSH or HTTPS URL of the repository
on the remote server. `<name-of-branch>` is usually `master`, but it may be any existing on the remote server. `<name-of-branch>` is usually `master`, but it may be any existing
branch. You can create additional named remotes and branches as necessary. branch. You can create additional named remotes and branches as necessary.
You can learn more on how Git manages remote repositories in the [Git Remote documentation](https://git-scm.com/book/en/v2/Git-Basics-Working-with-Remotes). You can learn more on how Git manages remote repositories in the [Git Remote documentation](https://git-scm.com/book/en/v2/Git-Basics-Working-with-Remotes).
...@@ -169,7 +169,7 @@ To view your remote repositories, type: ...@@ -169,7 +169,7 @@ To view your remote repositories, type:
git remote -v git remote -v
``` ```
The `-v` flag stands for verbose. The `-v` flag stands for verbose.
### Add a remote repository ### Add a remote repository
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment