This enable vieiwing applications logs directly in grafana, as long as
loki agent can access the log file and the regular expressions to parse
the logs are defined

Other changes:
 - provision data sources automatically so that user do not have to add
   them manually
 - update TODO in README
 - introduce a SR test
 - switch to dep to install dependencies, because that's how these
  packages manage their dependencies.

Versions up:
  grafana: v6.3.0
  telegraf: v1.11.1-0
  influxdb: v1.7.8rc1
New:
  loki: v0.3.0

This promise check if nextcloud app was correctly deployed, it ensure that slapos instance will deploy until nextcloud install succeed.

/reviewed-on nexedi/slapos!676

The called python program is python3 program, and provided
PYTHONPATH is from python2, resulting in bad behaviour.

On testnodes, python can be too long for linux shebang (#!) line.

We had for example:
    
    /srv/slapgrid/slappart15/srv/testnode/cqc/inst/test0-0/tmp/shared/python2.7/338ccc0e387d64185920266f8a97c87b/bin/python2.7
  

that is 123 characters long.

With this, the generated glib-genmarshall script will have:
    
    #!/usr/bin/env  /srv/slapgrid/slappart15/srv/testnode/cqc/inst/test0-0/tmp/shared/python2.7/338ccc0e387d64185920266f8a97c87b/bin/python2.7

which exceeds the linux kernel limit.

Instead, we generate scripts that will use
    
    #!/usr/bin/env python

and it will be the caller responsibility to set $PATH to use the expected python.


This fixes the issues we had on SlapOS.SoftwareReleases.IntegrationTest tests since we updated glib to 2.56.4 in a7a86db9

/reviewed-on nexedi/slapos!670

Provides a way to monitor edge PoP by using surykatka tool with
monitoring promises added in slapos.toolbox 1.101

Adds edgetest and edgebot software types, where edgetest is a software type
to request by user and requests by itself edgebot, which does the monitoring
work.

Based on Rafael Monnerat <rafael@nexedi.com>

Provides check_surykatka_json promise plugin.

python3 with venv to provide pip, which uses requirements file to install
stabilised set of distributions.

This reverts merge request !660

/reviewed-on nexedi/slapos!671

# To review

 - [x] [master parameters](https://lab.nexedi.com/luke/slapos/blob/feature/monitor-edge-test/software/monitor/instance-edgetest-input-schema.json)
 - [x] [slave parameters](https://lab.nexedi.com/luke/slapos/blob/feature/monitor-edge-test/software/monitor/instance-edgetest-slave-input-schema.json)

# Tasks

  - [x] assure that slaves are correctly destroyed (using SlapOS Master)


/reviewed-on nexedi/slapos!660

Adds edgetest and edgebot software types, where edgetest is a software type
to request by user and requests by itself edgebot, which does the monitoring
work.

Based on Rafael Monnerat <rafael@nexedi.com>

Provides check_surykatka_json promise plugin.

python3 with venv to provide pip, which uses requirements file to install
stabilised set of distributions.

This reverts commit f615611c.

Follow compilation flags used by many distributions

- make profiles for software-types "self contained"
- add default ports ( because port is marked required )

/reviewed-on nexedi/slapos!664

installing vscode-ripgrep creates a folder in temporary directory, but
never removes it.

On our test nodes it was observed that a first testnode running installs
and create this folder in /tmp/ then another testnode running as another
unix user installs and we had this error:

    Command: node ./lib/postinstall.js
    Arguments:
    Directory: /srv/slapgrid/slappart13/srv/testnode/cqg/inst/test0-0/tmp/soft/c3f3d686d3e77f9e5c20a555a2698c98/parts/theia/node_modules/vscode-ripgrep
    Output:
    Finding release for v11.0.1-2
    GET https://api.github.com/repos/microsoft/ripgrep-prebuilt/releases/tags/v11.0.1-2
    Downloading from https://api.github.com/repos/microsoft/ripgrep-prebuilt/releases/assets/13800816
    Downloading to /tmp/vscode-ripgrep-cache-1.5.7/ripgrep-v11.0.1-2-x86_64-unknown-linux-musl.tar.gz
    Download options: {"headers":{"user-agent":"vscode-ripgrep","accept":"application/octet-stream"}}
    events.js:167
        throw er; // Unhandled 'error' event
        ^

    Error: EACCES: permission denied, open '/tmp/vscode-ripgrep-cache-1.5.7/ripgrep-v11.0.1-2-x86_64-unknown-linux-musl.tar.gz'
    Emitted 'error' event at:
        at fs.open (internal/fs/streams.js:250:12)
        at FSReqWrap.oncomplete (fs.js:145:20)
    info Visit https://yarnpkg.com/en/docs/cli/install for documentation about this command.
    theia: Non zero exit code (1) while running command.
    While:
    Installing theia.
    Error: Non zero exit code (1) while running command.

/reviewed-on nexedi/slapos!668

This Merge Request aims to make as many components used by the webrunner shared.

/reviewed-on nexedi/slapos!665

/reviewed on nexedi/slapos!666