Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
G
gitlab-ce
Project overview
Project overview
Details
Activity
Releases
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Issues
0
Issues
0
List
Boards
Labels
Milestones
Merge Requests
1
Merge Requests
1
Analytics
Analytics
Repository
Value Stream
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Create a new issue
Commits
Issue Boards
Open sidebar
nexedi
gitlab-ce
Commits
55e55b99
Commit
55e55b99
authored
Mar 02, 2020
by
Rémy Coutable
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
Remove the 'flaky-examples-check' job as it's not reliable/used
Signed-off-by:
Rémy Coutable
<
remy@rymai.me
>
parent
796cd50d
Changes
3
Show whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
2 additions
and
29 deletions
+2
-29
.gitlab/ci/rules.gitlab-ci.yml
.gitlab/ci/rules.gitlab-ci.yml
+0
-7
.gitlab/ci/test-metadata.gitlab-ci.yml
.gitlab/ci/test-metadata.gitlab-ci.yml
+0
-19
doc/development/testing_guide/flaky_tests.md
doc/development/testing_guide/flaky_tests.md
+2
-3
No files found.
.gitlab/ci/rules.gitlab-ci.yml
View file @
55e55b99
...
...
@@ -493,13 +493,6 @@
changes
:
*code-backstage-patterns
when
:
on_success
.test-metadata:rules:flaky-examples-check:
rules
:
-
<<
:
*if-merge-request
changes
:
*code-backstage-patterns
when
:
on_success
##############
# YAML rules #
##############
...
...
.gitlab/ci/test-metadata.gitlab-ci.yml
View file @
55e55b99
...
...
@@ -37,22 +37,3 @@ update-tests-metadata:
-
retry gem install fog-aws mime-types activesupport rspec_profiling postgres-copy --no-document
-
source scripts/rspec_helpers.sh
-
update_tests_metadata
flaky-examples-check
:
extends
:
-
.default-tags
-
.default-retry
-
.test-metadata:rules:flaky-examples-check
image
:
ruby:2.6-alpine
stage
:
post-test
variables
:
NEW_FLAKY_SPECS_REPORT
:
rspec_flaky/report-new.json
allow_failure
:
true
artifacts
:
expire_in
:
30d
paths
:
-
rspec_flaky/
script
:
-
'
[[
-f
$NEW_FLAKY_SPECS_REPORT
]]
||
echo
"{}"
>
${NEW_FLAKY_SPECS_REPORT}'
-
scripts/merge-reports ${NEW_FLAKY_SPECS_REPORT} rspec_flaky/new_*_*.json
-
scripts/flaky_examples/detect-new-flaky-examples $NEW_FLAKY_SPECS_REPORT
doc/development/testing_guide/flaky_tests.md
View file @
55e55b99
...
...
@@ -44,9 +44,8 @@ On our CI, we use [rspec-retry] to automatically retry a failing example a few
times (see [
`spec/spec_helper.rb`
] for the precise retries count).
We also use a home-made
`RspecFlaky::Listener`
listener which records flaky
examples in a JSON report file on
`master`
(
`retrieve-tests-metadata`
and
`update-tests-metadata`
jobs), and warns when a new flaky example
is detected in any other branch (
`flaky-examples-check`
job). In the future, the
`flaky-examples-check`
job will not be allowed to fail.
examples in a JSON report file on
`master`
(
`retrieve-tests-metadata`
and
`update-tests-metadata`
jobs).
This was originally implemented in:
<https://gitlab.com/gitlab-org/gitlab-foss/-/merge_requests/13021>
.
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment