Commit b8ea66a5 authored by Marcel Amirault's avatar Marcel Amirault

Merge branch 'selhorn-docker-edit1' into 'master'

Clarify purpose of this topic

See merge request gitlab-org/gitlab!50461
parents f905c33a bdbcf427
...@@ -7,17 +7,17 @@ type: concepts, howto ...@@ -7,17 +7,17 @@ type: concepts, howto
# Building Docker images with GitLab CI/CD # Building Docker images with GitLab CI/CD
GitLab CI/CD allows you to use Docker Engine to build and test Docker-based projects. You can use GitLab CI/CD with Docker Engine to build and test Docker-based projects.
One of the new trends in Continuous Integration/Deployment is to: For example, you might want to:
1. Create an application image. 1. Create an application image.
1. Run tests against the created image. 1. Run tests against the created image.
1. Push image to a remote registry. 1. Push image to a remote registry.
1. Deploy to a server from the pushed image. 1. Deploy to a server from the pushed image.
It's also useful when your application already has the `Dockerfile` that can be Or, if your application already has a `Dockerfile`, you can
used to create and test an image: use it to create and test an image:
```shell ```shell
docker build -t my-image dockerfiles/ docker build -t my-image dockerfiles/
...@@ -26,29 +26,37 @@ docker tag my-image my-registry:5000/my-image ...@@ -26,29 +26,37 @@ docker tag my-image my-registry:5000/my-image
docker push my-registry:5000/my-image docker push my-registry:5000/my-image
``` ```
This requires special configuration of GitLab Runner to enable `docker` support To run Docker commands in your CI/CD jobs, you must configure
during jobs. GitLab Runner to enable `docker` support.
## Runner Configuration ## Enable Docker commands in your CI/CD jobs
There are three methods to enable the use of `docker build` and `docker run` There are three ways to enable the use of `docker build` and `docker run`
during jobs, each with their own tradeoffs. during jobs, each with their own tradeoffs. You can use:
An alternative to using `docker build` is to [use kaniko](using_kaniko.md). - [The shell executor](#use-the-shell-executor)
This avoids having to execute a runner in privileged mode. - [The Docker executor with the Docker image (Docker-in-Docker)](#use-the-docker-executor-with-the-docker-image-docker-in-docker)
- [Docker socket binding](#use-docker-socket-binding)
NOTE: If you don't want to execute a runner in privileged mode,
To see how Docker and GitLab Runner are configured for shared runners on but want to use `docker build`, you can also [use kaniko](using_kaniko.md).
GitLab.com, see [GitLab.com shared
runners](../../user/gitlab_com/index.md#shared-runners). If you are using shared runners on GitLab.com, see
[GitLab.com shared runners](../../user/gitlab_com/index.md#shared-runners)
to learn more about how these runners are configured.
### Use shell executor ### Use the shell executor
The simplest approach is to install GitLab Runner in `shell` execution mode. One way to configure GitLab Runner for `docker` support is to use the
GitLab Runner then executes job scripts as the `gitlab-runner` user. `shell` executor.
1. Install [GitLab Runner](https://gitlab.com/gitlab-org/gitlab-runner/#installation). After you register a runner and select the `shell` executor,
1. During GitLab Runner installation select `shell` as method of executing job scripts or use command: your job scripts are executed as the `gitlab-runner` user.
This user needs permission to run Docker commands.
1. [Install](https://gitlab.com/gitlab-org/gitlab-runner/#installation) GitLab Runner.
1. [Register](https://docs.gitlab.com/runner/register/) a runner.
Select the `shell` executor. For example:
```shell ```shell
sudo gitlab-runner register -n \ sudo gitlab-runner register -n \
...@@ -58,12 +66,10 @@ GitLab Runner then executes job scripts as the `gitlab-runner` user. ...@@ -58,12 +66,10 @@ GitLab Runner then executes job scripts as the `gitlab-runner` user.
--description "My Runner" --description "My Runner"
``` ```
1. Install Docker Engine on server. 1. On the server where GitLab Runner is installed, install Docker Engine.
View a list of [supported platforms](https://docs.docker.com/engine/installation/).
For more information how to install Docker Engine on different systems,
check out the [Supported installations](https://docs.docker.com/engine/installation/).
1. Add `gitlab-runner` user to `docker` group: 1. Add the `gitlab-runner` user to the `docker` group:
```shell ```shell
sudo usermod -aG docker gitlab-runner sudo usermod -aG docker gitlab-runner
...@@ -75,7 +81,7 @@ GitLab Runner then executes job scripts as the `gitlab-runner` user. ...@@ -75,7 +81,7 @@ GitLab Runner then executes job scripts as the `gitlab-runner` user.
sudo -u gitlab-runner -H docker info sudo -u gitlab-runner -H docker info
``` ```
You can now verify that everything works by adding `docker info` to `.gitlab-ci.yml`: 1. In GitLab, to verify that everything works, add `docker info` to `.gitlab-ci.yml`:
```yaml ```yaml
before_script: before_script:
...@@ -87,28 +93,30 @@ GitLab Runner then executes job scripts as the `gitlab-runner` user. ...@@ -87,28 +93,30 @@ GitLab Runner then executes job scripts as the `gitlab-runner` user.
- docker run my-docker-image /script/to/run/tests - docker run my-docker-image /script/to/run/tests
``` ```
1. You can now use `docker` command (and **install** `docker-compose` if needed). You can now use `docker` commands (and install `docker-compose` if needed).
When you add `gitlab-runner` to the `docker` group, you are effectively granting `gitlab-runner` full root permissions.
Learn more about the [security of the `docker` group](https://blog.zopyx.com/on-docker-security-docker-group-considered-harmful/).
By adding `gitlab-runner` to the `docker` group you are effectively granting `gitlab-runner` full root permissions. ### Use the Docker executor with the Docker image (Docker-in-Docker)
For more information please read [On Docker security: `docker` group considered harmful](https://blog.zopyx.com/on-docker-security-docker-group-considered-harmful/).
### Use Docker-in-Docker workflow with Docker executor Another way to configure GitLab Runner for `docker` support is to
register a runner with the Docker executor and use the [Docker image](https://hub.docker.com/_/docker/)
to run your job scripts. This configuration is referred to as "Docker-in-Docker."
The second approach is to use the special Docker-in-Docker (dind) The Docker image has all of the `docker` tools installed
[Docker image](https://hub.docker.com/_/docker/) with all tools installed and can run the job script in context of the image in privileged mode.
(`docker`) and run the job script in context of that
image in privileged mode.
`docker-compose` is not part of Docker-in-Docker (dind). To use `docker-compose` in your The `docker-compose` command is not available in this configuration by default.
CI builds, follow the `docker-compose` To use `docker-compose` in your job scripts, follow the `docker-compose`
[installation instructions](https://docs.docker.com/compose/install/). [installation instructions](https://docs.docker.com/compose/install/).
WARNING: WARNING:
By enabling `--docker-privileged`, you are effectively disabling all of When you enable `--docker-privileged`, you are effectively disabling all of
the security mechanisms of containers and exposing your host to privilege the security mechanisms of containers and exposing your host to privilege
escalation which can lead to container breakout. For more information, check escalation which can lead to container breakout. For more information, check
out the official Docker documentation on out the official Docker documentation on
[Runtime privilege and Linux capabilities](https://docs.docker.com/engine/reference/run/#runtime-privilege-and-linux-capabilities). [runtime privilege and Linux capabilities](https://docs.docker.com/engine/reference/run/#runtime-privilege-and-linux-capabilities).
Docker-in-Docker works well, and is the recommended configuration, but it is Docker-in-Docker works well, and is the recommended configuration, but it is
not without its own challenges: not without its own challenges:
...@@ -363,10 +371,11 @@ build: ...@@ -363,10 +371,11 @@ build:
- docker run my-docker-image /script/to/run/tests - docker run my-docker-image /script/to/run/tests
``` ```
#### Use Docker socket binding ### Use Docker socket binding
The third approach is to bind-mount `/var/run/docker.sock` into the Another way to configure GitLab Runner for `docker` support is to
container so that Docker is available in the context of that image. bind-mount `/var/run/docker.sock` into the
container so that Docker is available in the context of the image.
NOTE: NOTE:
If you bind the Docker socket and you are If you bind the Docker socket and you are
...@@ -854,13 +863,13 @@ After you've built a Docker image, you can push it up to the built-in ...@@ -854,13 +863,13 @@ After you've built a Docker image, you can push it up to the built-in
### `docker: Cannot connect to the Docker daemon at tcp://docker:2375. Is the docker daemon running?` ### `docker: Cannot connect to the Docker daemon at tcp://docker:2375. Is the docker daemon running?`
This is a common error when you are using This is a common error when you are using
[Docker in Docker](#use-docker-in-docker-workflow-with-docker-executor) [Docker in Docker](#use-the-docker-executor-with-the-docker-image-docker-in-docker)
v19.03 or higher. v19.03 or higher.
This occurs because Docker starts on TLS automatically, so you need to do some setup. This occurs because Docker starts on TLS automatically, so you need to do some setup.
If: If:
- This is the first time setting it up, carefully read - This is the first time setting it up, carefully read
[using Docker in Docker workflow](#use-docker-in-docker-workflow-with-docker-executor). [using Docker in Docker workflow](#use-the-docker-executor-with-the-docker-image-docker-in-docker).
- You are upgrading from v18.09 or earlier, read our - You are upgrading from v18.09 or earlier, read our
[upgrade guide](https://about.gitlab.com/releases/2019/07/31/docker-in-docker-with-docker-19-dot-03/). [upgrade guide](https://about.gitlab.com/releases/2019/07/31/docker-in-docker-with-docker-19-dot-03/).
...@@ -14,7 +14,7 @@ container images from a Dockerfile, inside a container or Kubernetes cluster. ...@@ -14,7 +14,7 @@ container images from a Dockerfile, inside a container or Kubernetes cluster.
kaniko solves two problems with using the kaniko solves two problems with using the
[Docker-in-Docker [Docker-in-Docker
build](using_docker_build.md#use-docker-in-docker-workflow-with-docker-executor) method: build](using_docker_build.md#use-the-docker-executor-with-the-docker-image-docker-in-docker) method:
- Docker-in-Docker requires [privileged mode](https://docs.docker.com/engine/reference/run/#runtime-privilege-and-linux-capabilities) - Docker-in-Docker requires [privileged mode](https://docs.docker.com/engine/reference/run/#runtime-privilege-and-linux-capabilities)
to function, which is a significant security concern. to function, which is a significant security concern.
......
...@@ -305,7 +305,7 @@ is set to `always`. ...@@ -305,7 +305,7 @@ is set to `always`.
To use your own Docker images for Docker-in-Docker, follow these steps To use your own Docker images for Docker-in-Docker, follow these steps
in addition to the steps in the in addition to the steps in the
[Docker-in-Docker](../../../ci/docker/using_docker_build.md#use-docker-in-docker-workflow-with-docker-executor) section: [Docker-in-Docker](../../../ci/docker/using_docker_build.md#use-the-docker-executor-with-the-docker-image-docker-in-docker) section:
1. Update the `image` and `service` to point to your registry. 1. Update the `image` and `service` to point to your registry.
1. Add a service [alias](../../../ci/yaml/README.md#servicesalias). 1. Add a service [alias](../../../ci/yaml/README.md#servicesalias).
......
...@@ -60,7 +60,7 @@ on your code by using GitLab CI/CD and [sitespeed.io](https://www.sitespeed.io) ...@@ -60,7 +60,7 @@ on your code by using GitLab CI/CD and [sitespeed.io](https://www.sitespeed.io)
using Docker-in-Docker. using Docker-in-Docker.
1. First, set up GitLab Runner with a 1. First, set up GitLab Runner with a
[Docker-in-Docker build](../../../ci/docker/using_docker_build.md#use-docker-in-docker-workflow-with-docker-executor). [Docker-in-Docker build](../../../ci/docker/using_docker_build.md#use-the-docker-executor-with-the-docker-image-docker-in-docker).
1. Configure the default Browser Performance Testing CI job as follows in your `.gitlab-ci.yml` file: 1. Configure the default Browser Performance Testing CI job as follows in your `.gitlab-ci.yml` file:
```yaml ```yaml
......
...@@ -74,7 +74,7 @@ GitLab 11.4 or earlier, you can view the deprecated job definitions in the ...@@ -74,7 +74,7 @@ GitLab 11.4 or earlier, you can view the deprecated job definitions in the
First, you need GitLab Runner configured: First, you need GitLab Runner configured:
- For the [Docker-in-Docker workflow](../../../ci/docker/using_docker_build.md#use-docker-in-docker-workflow-with-docker-executor). - For the [Docker-in-Docker workflow](../../../ci/docker/using_docker_build.md#use-the-docker-executor-with-the-docker-image-docker-in-docker).
- With enough disk space to handle generated Code Quality files. For example on the [GitLab project](https://gitlab.com/gitlab-org/gitlab) the files are approximately 7 GB. - With enough disk space to handle generated Code Quality files. For example on the [GitLab project](https://gitlab.com/gitlab-org/gitlab) the files are approximately 7 GB.
Once you set up GitLab Runner, include the Code Quality template in your CI configuration: Once you set up GitLab Runner, include the Code Quality template in your CI configuration:
......
...@@ -103,7 +103,7 @@ job. ...@@ -103,7 +103,7 @@ job.
An example configuration workflow: An example configuration workflow:
1. Set up GitLab Runner to run Docker containers, like the 1. Set up GitLab Runner to run Docker containers, like the
[Docker-in-Docker workflow](../../../ci/docker/using_docker_build.md#use-docker-in-docker-workflow-with-docker-executor). [Docker-in-Docker workflow](../../../ci/docker/using_docker_build.md#use-the-docker-executor-with-the-docker-image-docker-in-docker).
1. Configure the default Load Performance Testing CI job in your `.gitlab-ci.yml` file. 1. Configure the default Load Performance Testing CI job in your `.gitlab-ci.yml` file.
You need to include the template and configure it with variables: You need to include the template and configure it with variables:
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment