Commit fba6eaa8 authored by Ivan Tyagov's avatar Ivan Tyagov

Update documentation for ebulk.

parent c7aec491
...@@ -23,49 +23,25 @@ ...@@ -23,49 +23,25 @@
<img src="telecom-nexedi-logos?display=svg" alt="BigData Home"> <img src="telecom-nexedi-logos?display=svg" alt="BigData Home">
<p>Ebulk tool</p> <p>Ebulk tool</p>
</div> </div>
<h1>Tool description</h1> <h1>Tool description</h1>
<p><a target="_blank" href="https://lab.nexedi.com/nexedi/ebulk">Ebulk</a> makes easy to exchange or archive very large data sets. It performs data set ingestions or downloads from different protocols, to Wendelin-IA platform. It also allows to perform local changes in data sets and to upload added and modified files. One key feature of Ebulk is to be able to resume and recover from errors happening with interrupted transfers. <b><a href="#/?page=ebulk_doc" style="color:#116D82">See documentation</a></b></p> <p><a target="_blank" href="https://lab.nexedi.com/nexedi/ebulk">Ebulk</a> makes it easy to exchange or archive very large data sets. It performs data set ingestions or downloads from different protocols, to Wendelin Big Data platform. It also allows to perform local changes in data sets and to upload added and modified files. One key feature of Ebulk is to be able to resume and recover from errors happening with interrupted transfers.</p>
<h1>Requirements</h1> <h1>Requirements</h1>
<p>Ebulk tool relies on <b>Embulk</b> Java application (see <a target="_blank" href="https://www.embulk.org/">docs</a>). Please make sure that <a target="_blank" href="https://www.oracle.com/java/technologies/javase-downloads.html">Java 8</a> is installed. <p>Ebulk tool relies on <b>Embulk</b> Java application (see <a target="_blank" href="https://www.embulk.org/">docs</a>). Please make sure that <a target="_blank" href="https://www.oracle.com/java/technologies/javase-downloads.html">Java 8</a> is installed.</p>
</p>
<h1>Install</h1> <h1>Installation</h1>
<p>Please use the package installation for your operative system and follow the installation instructions.</p>
<h2>Linux</h2> <h2>Debian / Ubuntu Linux OS</h2>
<p>Ebulk package available in ubuntu-ppa repository allows to easily install the tool using apt commands.</p> <p>Please follow these instructions.</p>
<p>Make sure <code>software-properties-common</code> is installed in order to run all apt commands:</p>
<div class="code"><p>sudo apt-get install software-properties-common</p></div>
<p>Add the ppa repository:</p>
<div class="code"><p>sudo add-apt-repository ppa:rporchetto/ebulk-ppa</p></div>
<p>Update your local sources and install ebulk:</p>
<div class="code"> <div class="code">
<p>sudo apt-get update</p> <p>gpg --keyserver hkp://keyserver.ubuntu.com:80 --recv-keys B38DB8D777BB9026 </p>
<p>sudo apt-get install ebulk</p> <p>gpg --output /usr/share/keyrings/ebulk-ebulk-ppa-archive-keyring.gpg --export B38DB8D777BB9026</p>
<p>echo "deb [signed-by=/usr/share/keyrings/ebulk-ebulk-ppa-archive-keyring.gpg] http://ppa.launchpad.net/ebulk/ebulk-ppa/ubuntu xenial main" > /etc/apt/sources.list.d/ebulk-ebulk-ppa.list </p>
<p>apt update</p>
<p>apt install ebulk curl</p>
</div> </div>
<h2>Debian considerations</h2>
<p>For any OS version/series inconvenient during apt installation, it is recommended to install ebulk from the <code>.deb</code> package directly.</p>
<p>Please download the <a id="deb_link">latest <code>.deb</code> ebulk package</a> and install it by running:</p>
<div class="code"><p>dpkg -i ebulk_package.deb</p></div>
<h2>Mac OS X</h2>
<p>Installation on Mac OS can be done via homebrew packages by running:</p>
<div class="code">
<p>curl -L https://github.com/roquegit/homebrew-ebulk/raw/master/ebulk.rb > ebulk.rb</p>
<p>brew install ebulk.rb</p>
</div>
<h2>Potential installation issues</h2>
<p>During the package intallation, or during first ebulk execution, the bash script will try to install Embulk automatically (if it is not installed).
If your OS needs special permission, it maybe will be necessary to install Embulk v 0.9.7 manually:</p>
<div class="code">
<p>curl --create-dirs -o ~/.embulk/bin/embulk -L "https://github.com/embulk/embulk/releases/download/v0.9.7/embulk-0.9.7.jar"</p>
<p>chmod +x ~/.embulk/bin/embulk</p>
<p>echo 'export PATH="$HOME/.embulk/bin:$PATH"' >> ~/.bashrc</p>
<p>source ~/.bashrc</p>
</div>
<h2>Linux Source</h2> <h2>Linux Source</h2>
<p><a href="https://lab.nexedi.com/nexedi/ebulk"> Git project repository</a></p> <p><a href="https://lab.nexedi.com/nexedi/ebulk"> Git project repository</a></p>
</div> </div>
......
...@@ -101,7 +101,7 @@ ...@@ -101,7 +101,7 @@
</item> </item>
<item> <item>
<key> <string>title</string> </key> <key> <string>title</string> </key>
<value> <string>FIF Download</string> </value> <value> <string>Download ebulk</string> </value>
</item> </item>
<item> <item>
<key> <string>version</string> </key> <key> <string>version</string> </key>
...@@ -238,7 +238,7 @@ ...@@ -238,7 +238,7 @@
</item> </item>
<item> <item>
<key> <string>serial</string> </key> <key> <string>serial</string> </key>
<value> <string>992.23871.4225.17186</string> </value> <value> <string>1005.22671.35265.19063</string> </value>
</item> </item>
<item> <item>
<key> <string>state</string> </key> <key> <string>state</string> </key>
...@@ -256,7 +256,7 @@ ...@@ -256,7 +256,7 @@
</tuple> </tuple>
<state> <state>
<tuple> <tuple>
<float>1623425975.4</float> <float>1672393988.95</float>
<string>UTC</string> <string>UTC</string>
</tuple> </tuple>
</state> </state>
......
...@@ -6,12 +6,12 @@ ...@@ -6,12 +6,12 @@
.declareAcquiredMethod("jio_get", "jio_get") .declareAcquiredMethod("jio_get", "jio_get")
.declareService(function () { .declareService(function () {
var gadget = this, var gadget = this,
download_deb_element = document.querySelector("#deb_link"), //download_deb_element = document.querySelector("#deb_link"),
jio_key = 'document_module/ebulk-1.1.9.deb'; //jio_key = 'document_module/ebulk-1.1.9.deb';
return gadget.jio_get(jio_key) return gadget.jio_get(jio_key)
.push(function (jio_document) { .push(function (jio_document) {
download_deb_element.download = jio_document.short_title; //download_deb_element.download = jio_document.short_title;
download_deb_element.href = window.location.origin + "/" + jio_key + "/getData"; //download_deb_element.href = window.location.origin + "/" + jio_key + "/getData";
}, function (error) { }, function (error) {
console.log("Latest .deb ebulk package document not available:", error); console.log("Latest .deb ebulk package document not available:", error);
}); });
......
...@@ -234,7 +234,7 @@ ...@@ -234,7 +234,7 @@
</item> </item>
<item> <item>
<key> <string>serial</string> </key> <key> <string>serial</string> </key>
<value> <string>991.37699.2285.38724</string> </value> <value> <string>1005.22670.28734.11554</string> </value>
</item> </item>
<item> <item>
<key> <string>state</string> </key> <key> <string>state</string> </key>
...@@ -252,7 +252,7 @@ ...@@ -252,7 +252,7 @@
</tuple> </tuple>
<state> <state>
<tuple> <tuple>
<float>1619452806.99</float> <float>1672393904.55</float>
<string>UTC</string> <string>UTC</string>
</tuple> </tuple>
</state> </state>
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment