Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
G
gitlab-ce
Project overview
Project overview
Details
Activity
Releases
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Issues
0
Issues
0
List
Boards
Labels
Milestones
Merge Requests
0
Merge Requests
0
Analytics
Analytics
Repository
Value Stream
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Create a new issue
Commits
Issue Boards
Open sidebar
Léo-Paul Géneau
gitlab-ce
Commits
258f578f
Commit
258f578f
authored
May 17, 2017
by
Stan Hu
Browse files
Options
Browse Files
Download
Plain Diff
Merge branch 'docs-update-ha' into 'master'
Docs update ha See merge request !11446
parents
c75f1d3d
cd996c5c
Changes
3
Show whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
49 additions
and
10 deletions
+49
-10
doc/administration/high_availability/README.md
doc/administration/high_availability/README.md
+18
-0
doc/administration/high_availability/nfs.md
doc/administration/high_availability/nfs.md
+19
-0
doc/university/high-availability/aws/README.md
doc/university/high-availability/aws/README.md
+12
-10
No files found.
doc/administration/high_availability/README.md
View file @
258f578f
...
@@ -5,6 +5,20 @@ The solution you choose will be based on the level of scalability and
...
@@ -5,6 +5,20 @@ The solution you choose will be based on the level of scalability and
availability you require. The easiest solutions are scalable, but not necessarily
availability you require. The easiest solutions are scalable, but not necessarily
highly available.
highly available.
GitLab provides a service that is usually essential to most organizations: it
enables people to collaborate on code in a timely fashion. Any downtime should
therefore be short and planned. Luckily, GitLab provides a solid setup even on
a single server without special measures. Due to the distributed nature
of Git, developers can still commit code locally even when GitLab is not
available. However, some GitLab features such as the issue tracker and
Continuous Integration are not available when GitLab is down.
**
Keep in mind that all Highly Available solutions come with a trade-off between
cost/complexity and uptime
**
. The more uptime you want, the more complex the
solution. And the more complex the solution, the more work is involved in
setting up and maintaining it. High availability is not free and every HA
solution should balance the costs against the benefits.
## Architecture
## Architecture
There are two kinds of setups:
There are two kinds of setups:
...
@@ -37,6 +51,10 @@ Block Device) to keep all data in sync. DRBD requires a low latency link to
...
@@ -37,6 +51,10 @@ Block Device) to keep all data in sync. DRBD requires a low latency link to
remain in sync. It is not advisable to attempt to run DRBD between data centers
remain in sync. It is not advisable to attempt to run DRBD between data centers
or in different cloud availability zones.
or in different cloud availability zones.
> **Note:** GitLab recommends against choosing this HA method because of the
complexity of managing DRBD and crafting automatic failover. This is
*compatible*
with GitLab, but not officially
*supported*
.
Components/Servers Required: 2 servers/virtual machines (one active/one passive)
Components/Servers Required: 2 servers/virtual machines (one active/one passive)
![
Active/Passive HA Diagram
](
../img/high_availability/active-passive-diagram.png
)
![
Active/Passive HA Diagram
](
../img/high_availability/active-passive-diagram.png
)
doc/administration/high_availability/nfs.md
View file @
258f578f
...
@@ -7,6 +7,25 @@ supported natively in NFS version 4. NFSv3 also supports locking as long as
...
@@ -7,6 +7,25 @@ supported natively in NFS version 4. NFSv3 also supports locking as long as
Linux Kernel 2.6.5+ is used. We recommend using version 4 and do not
Linux Kernel 2.6.5+ is used. We recommend using version 4 and do not
specifically test NFSv3.
specifically test NFSv3.
## AWS Elastic File System
GitLab does not recommend using AWS Elastic File System (EFS).
Customers and users have reported that AWS EFS does not perform well for GitLab's
use-case. There are several issues that can cause problems. For these reasons
GitLab does not recommend using EFS with GitLab.
-
EFS bases allowed IOPS on volume size. The larger the volume, the more IOPS
are allocated. For smaller volumes, users may experience decent performance
for a period of time due to 'Burst Credits'. Over a period of weeks to months
credits may run out and performance will bottom out.
-
For larger volumes, allocated IOPS may not be the problem. Workloads where
many small files are written in a serialized manner are not well-suited for EFS.
EBS with an NFS server on top will perform much better.
For more details on another person's experience with EFS, see
[
Amazon's Elastic File System: Burst Credits
](
https://www.rawkode.io/2017/04/amazons-elastic-file-system-burst-credits/
)
### Recommended options
### Recommended options
When you define your NFS exports, we recommend you also add the following
When you define your NFS exports, we recommend you also add the following
...
...
doc/university/high-availability/aws/README.md
View file @
258f578f
...
@@ -159,19 +159,21 @@ subnet and security group and
...
@@ -159,19 +159,21 @@ subnet and security group and
***
***
##
Elastic
File System
##
Network
File System
This new AWS offering allows us to create a file system accessible by
GitLab requires a shared filesystem such as NFS. The file share(s) will be
EC2 instances within a VPC. Choose our VPC and the subnets will be
mounted on all application servers. There are a variety of ways to build an
automatically configured assuming we don't need to set explicit IPs.
NFS server on AWS.
The next section allows us to add tags and choose between General
Purpose or Max I/O which is a good option when being accessed by a
large number of EC2 instances.
!
[
Elastic File System
](
img/elastic-file-system.png
)
One option is to use a third-party AMI that offers NFS as a service. A
[
search
for 'NFS' in the AWS Marketplace
](
https://aws.amazon.com/marketplace/search/results?x=0&y=0&searchTerms=NFS&page=1&ref_=nav_search_box
)
shows options such as NetApp, SoftNAS and others.
To actually mount and install the NFS client we'll use the User Data
Another option is to build a simple NFS server using a vanilla Linux server backed
section when adding our Launch Configuration.
by AWS Elastic Block Storage (EBS).
> **Note:** GitLab does not recommend using AWS Elastic File System (EFS). See
details in
[
High Availability NFS documentation
](
../../../administration/high_availability/nfs.md#aws-elastic-file-system
)
***
***
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment