relpipe-data/release-v0.13.xml
author František Kučera <franta-hg@frantovo.cz>
Wed, 31 Jul 2019 16:01:34 +0200
branchv_0
changeset 264 d39cfc926f95
parent 258 relpipe-data/release-v0.12.xml@2868d772c27e
child 276 cfaf1fa94154
permissions -rw-r--r--
XMLTable, SQL, v0.13
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
23
0d2729ed16ed zkouška interního odkazu
František Kučera <franta-hg@frantovo.cz>
parents: 18
diff changeset
     1
<stránka
0d2729ed16ed zkouška interního odkazu
František Kučera <franta-hg@frantovo.cz>
parents: 18
diff changeset
     2
	xmlns="https://trac.frantovo.cz/xml-web-generator/wiki/xmlns/strana"
0d2729ed16ed zkouška interního odkazu
František Kučera <franta-hg@frantovo.cz>
parents: 18
diff changeset
     3
	xmlns:m="https://trac.frantovo.cz/xml-web-generator/wiki/xmlns/makro">
0d2729ed16ed zkouška interního odkazu
František Kučera <franta-hg@frantovo.cz>
parents: 18
diff changeset
     4
	
264
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
     5
	<nadpis>Release v0.13</nadpis>
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
     6
	<perex>sixth public release of Relational pipes</perex>
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
     7
	<m:release>v0.13</m:release>
4
1bb39595a51c genrování hlavní nabídky #1
František Kučera <franta-hg@frantovo.cz>
parents: 2
diff changeset
     8
2
ab9099ff88fa vkládání zápatí, jmenné prostory, saxon
František Kučera <franta-hg@frantovo.cz>
parents: 1
diff changeset
     9
	<text xmlns="http://www.w3.org/1999/xhtml">
ab9099ff88fa vkládání zápatí, jmenné prostory, saxon
František Kučera <franta-hg@frantovo.cz>
parents: 1
diff changeset
    10
		<p>
256
822ffd23d679 Release v0.11
František Kučera <franta-hg@frantovo.cz>
parents: 250
diff changeset
    11
			We are pleased to introduce you the new development version of <m:name/>.
264
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    12
			This release brings the XMLTable input filter, the SQL transformation and a small improvement in the filesystem input filter: 
241
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    13
		</p>
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    14
		
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    15
		<ul>
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    16
			<li>
264
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    17
				<strong>XMLTable input</strong>:
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    18
				This tool does similar job like the <a href="https://www.postgresql.org/docs/current/functions-xml.html">xmltable</a> function known from SQL.
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    19
				It uses the <a href="https://www.w3.org/TR/xpath/all/">XPath</a> language for selecting parts of the input XML – one XPath expression points to record nodes
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    20
				and one or more XPath expressions point to attribute nodes/values relatively to particular record node.
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    21
				Thus it is able to produce one or more relations from an arbitrary XML input.
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    22
				The input is parsed at once and converted to DOM in memory i.e. no streaming – thus processing of huge XML files requires appropriate amounts of RAM, on the other hand: 
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    23
				our expression can access whole XML document and pick values not only from currently processed record node.
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    24
				This tool uses the <a href="http://xmlsoft.org/">Libxml2</a> library (XML parser and XPath processor).
250
d16336d1c61f Release v0.10
František Kučera <franta-hg@frantovo.cz>
parents: 241
diff changeset
    25
			</li>
d16336d1c61f Release v0.10
František Kučera <franta-hg@frantovo.cz>
parents: 241
diff changeset
    26
			
d16336d1c61f Release v0.10
František Kučera <franta-hg@frantovo.cz>
parents: 241
diff changeset
    27
			<li>
264
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    28
				<strong>SQL transformation</strong>:
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    29
				SQL is one of most powerful languages for processing relational data and the most widespread one.
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    30
				Now it can be used even on-the-fly in shell pipelines – without having any database server running.
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    31
				It is useful for record filtering, JOINing several relations together, doing aggregations or computations.
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    32
				By default everything is done in memory, but with the <code>--file</code> parameter we can use a temporary file
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    33
				and with <code>--keep-file</code> we can make it not so temporary.
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    34
				This tool uses the <a href="https://www.sqlite.org/">SQLite</a> library.
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    35
			</li>
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    36
			
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    37
			<li>
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    38
				<strong>file system input</strong>:
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    39
				new optional attribute has been added: <code>--file content</code>
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    40
				which allows getting the text content (currently only in the UTF-8 encoding) of the file which allows us using the file system as a simple database.
241
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    41
			</li>
258
2868d772c27e Release v0.12 – AWK
František Kučera <franta-hg@frantovo.cz>
parents: 256
diff changeset
    42
			
241
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    43
		</ul>
256
822ffd23d679 Release v0.11
František Kučera <franta-hg@frantovo.cz>
parents: 250
diff changeset
    44
		
241
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    45
		<p>
256
822ffd23d679 Release v0.11
František Kučera <franta-hg@frantovo.cz>
parents: 250
diff changeset
    46
			See the <m:a href="examples">examples</m:a> and <m:a href="screenshots">screenshots</m:a> pages for details.
151
5697a01db388 roadmap
František Kučera <franta-hg@frantovo.cz>
parents: 147
diff changeset
    47
		</p>
256
822ffd23d679 Release v0.11
František Kučera <franta-hg@frantovo.cz>
parents: 250
diff changeset
    48
		
822ffd23d679 Release v0.11
František Kučera <franta-hg@frantovo.cz>
parents: 250
diff changeset
    49
		<p>
822ffd23d679 Release v0.11
František Kučera <franta-hg@frantovo.cz>
parents: 250
diff changeset
    50
			Please note that this is still a development relasease and thus the API (libraries, CLI arguments, formats) might and will change.
822ffd23d679 Release v0.11
František Kučera <franta-hg@frantovo.cz>
parents: 250
diff changeset
    51
			Any suggestions, ideas and bug reports are welcome in our <m:a href="contact">mailing list</m:a>.
822ffd23d679 Release v0.11
František Kučera <franta-hg@frantovo.cz>
parents: 250
diff changeset
    52
		</p>
151
5697a01db388 roadmap
František Kučera <franta-hg@frantovo.cz>
parents: 147
diff changeset
    53
		
5697a01db388 roadmap
František Kučera <franta-hg@frantovo.cz>
parents: 147
diff changeset
    54
		<h3>Data types</h3>
5697a01db388 roadmap
František Kučera <franta-hg@frantovo.cz>
parents: 147
diff changeset
    55
		<ul>
241
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    56
			<li m:since="v0.8">boolean</li>
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    57
			<li m:since="v0.8">variable unsigned integer (prototype)</li>
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    58
			<li m:since="v0.8">string in UTF-8</li>
151
5697a01db388 roadmap
František Kučera <franta-hg@frantovo.cz>
parents: 147
diff changeset
    59
		</ul>
5697a01db388 roadmap
František Kučera <franta-hg@frantovo.cz>
parents: 147
diff changeset
    60
		<h3>Inputs</h3>
5697a01db388 roadmap
František Kučera <franta-hg@frantovo.cz>
parents: 147
diff changeset
    61
		<ul>
256
822ffd23d679 Release v0.11
František Kučera <franta-hg@frantovo.cz>
parents: 250
diff changeset
    62
			<li m:since="v0.11">Recfile</li>
241
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    63
			<li m:since="v0.9">XML</li>
264
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    64
			<li m:since="v0.13">XMLTable</li>
241
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    65
			<li m:since="v0.9">CSV</li>
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    66
			<li m:since="v0.9">file system</li>
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    67
			<li m:since="v0.8">CLI</li>
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    68
			<li m:since="v0.8">fstab</li>
151
5697a01db388 roadmap
František Kučera <franta-hg@frantovo.cz>
parents: 147
diff changeset
    69
		</ul>
5697a01db388 roadmap
František Kučera <franta-hg@frantovo.cz>
parents: 147
diff changeset
    70
		<h3>Transformations</h3>
5697a01db388 roadmap
František Kučera <franta-hg@frantovo.cz>
parents: 147
diff changeset
    71
		<ul>
264
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    72
			<li m:since="v0.13">sql: filtering and transformations using the SQL language</li>
258
2868d772c27e Release v0.12 – AWK
František Kučera <franta-hg@frantovo.cz>
parents: 256
diff changeset
    73
			<li m:since="v0.12">awk: filtering and transformations using the classic AWK tool and language</li>
250
d16336d1c61f Release v0.10
František Kučera <franta-hg@frantovo.cz>
parents: 241
diff changeset
    74
			<li m:since="v0.10">guile: filtering and transformations defined in the Scheme language using GNU Guile</li>
241
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    75
			<li m:since="v0.8">grep: regular expression filter, removes unwanted records from the relation</li>
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    76
			<li m:since="v0.8">cut: regular expression attribute cutter (removes or duplicates attributes and can also DROP whole relation)</li>
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    77
			<li m:since="v0.8">sed: regular expression replacer</li>
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    78
			<li m:since="v0.8">validator: just a pass-through filter that crashes on invalid data</li>
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    79
			<li m:since="v0.8">python: highly experimental</li>
151
5697a01db388 roadmap
František Kučera <franta-hg@frantovo.cz>
parents: 147
diff changeset
    80
		</ul>
5697a01db388 roadmap
František Kučera <franta-hg@frantovo.cz>
parents: 147
diff changeset
    81
		<h3>Outputs</h3>
5697a01db388 roadmap
František Kučera <franta-hg@frantovo.cz>
parents: 147
diff changeset
    82
		<ul>
256
822ffd23d679 Release v0.11
František Kučera <franta-hg@frantovo.cz>
parents: 250
diff changeset
    83
			<li m:since="v0.11">ASN.1 BER</li>
822ffd23d679 Release v0.11
František Kučera <franta-hg@frantovo.cz>
parents: 250
diff changeset
    84
			<li m:since="v0.11">Recfile</li>
241
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    85
			<li m:since="v0.9">CSV</li>
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    86
			<li m:since="v0.8">tabular</li>
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    87
			<li m:since="v0.8">XML</li>
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    88
			<li m:since="v0.8">nullbyte</li>
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    89
			<li m:since="v0.8">GUI in Qt</li>
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
    90
			<li m:since="v0.8">ODS (LibreOffice)</li>
151
5697a01db388 roadmap
František Kučera <franta-hg@frantovo.cz>
parents: 147
diff changeset
    91
		</ul>
5697a01db388 roadmap
František Kučera <franta-hg@frantovo.cz>
parents: 147
diff changeset
    92
		
5697a01db388 roadmap
František Kučera <franta-hg@frantovo.cz>
parents: 147
diff changeset
    93
		<p>
219
a94eb371f77e Release v0.8
František Kučera <franta-hg@frantovo.cz>
parents: 218
diff changeset
    94
			Instalation was tested on Debian GNU/Linux 9.6.
a94eb371f77e Release v0.8
František Kučera <franta-hg@frantovo.cz>
parents: 218
diff changeset
    95
			The process should be similar on other distributions.
a94eb371f77e Release v0.8
František Kučera <franta-hg@frantovo.cz>
parents: 218
diff changeset
    96
		</p>
151
5697a01db388 roadmap
František Kučera <franta-hg@frantovo.cz>
parents: 147
diff changeset
    97
		
264
d39cfc926f95 XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents: 258
diff changeset
    98
		<m:pre src="examples/release-v0.13.sh" jazyk="bash" odkaz="ano"/>
151
5697a01db388 roadmap
František Kučera <franta-hg@frantovo.cz>
parents: 147
diff changeset
    99
		
219
a94eb371f77e Release v0.8
František Kučera <franta-hg@frantovo.cz>
parents: 218
diff changeset
   100
		<p>
a94eb371f77e Release v0.8
František Kučera <franta-hg@frantovo.cz>
parents: 218
diff changeset
   101
			<m:name/> are modular thus you can download and install only parts you need (the libraries are needed always).
a94eb371f77e Release v0.8
František Kučera <franta-hg@frantovo.cz>
parents: 218
diff changeset
   102
			Tools <code>out-gui.qt</code> and <code>tr-python</code> require additional libraries and are not built by default.
a94eb371f77e Release v0.8
František Kučera <franta-hg@frantovo.cz>
parents: 218
diff changeset
   103
		</p>
151
5697a01db388 roadmap
František Kučera <franta-hg@frantovo.cz>
parents: 147
diff changeset
   104
		
241
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
   105
		<p>
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
   106
			The module <code>relpipe-in-filesystem</code> uses C++ filesystem API which is supported since GCC 8.
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
   107
			This module can be compiled and seems usable even with GCC 6, but requires some patching (switch to the experimental API):
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
   108
		</p>
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
   109
		
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
   110
		<m:pre jazyk="bash"><![CDATA[sed 's@#include <filesystem>@#include <experimental/filesystem>@g' -i "$RELPIPE_SRC"/relpipe-in-filesystem.cpp/src/FileAttributeFinder.h "$RELPIPE_SRC"/relpipe-in-filesystem.cpp/src/XattrAttributeFinder.h "$RELPIPE_SRC"/relpipe-in-filesystem.cpp/src/FilesystemCommand.h "$RELPIPE_SRC"/relpipe-in-filesystem.cpp/src/AttributeFinder.h
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
   111
sed 's@std::filesystem@std::experimental::filesystem@g' -i "$RELPIPE_SRC"/relpipe-in-filesystem.cpp/src/FileAttributeFinder.h "$RELPIPE_SRC"/relpipe-in-filesystem.cpp/src/XattrAttributeFinder.h "$RELPIPE_SRC"/relpipe-in-filesystem.cpp/src/FilesystemCommand.h "$RELPIPE_SRC"/relpipe-in-filesystem.cpp/src/AttributeFinder.h
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
   112
sed 's/.*PROPERTY CXX_STANDARD.*/#\0/g' -i "$RELPIPE_SRC"/relpipe-in-filesystem.cpp/src/CMakeLists.txt]]></m:pre>
f71d300205b7 Release v0.9
František Kučera <franta-hg@frantovo.cz>
parents: 219
diff changeset
   113
250
d16336d1c61f Release v0.10
František Kučera <franta-hg@frantovo.cz>
parents: 241
diff changeset
   114
		<p>
d16336d1c61f Release v0.10
František Kučera <franta-hg@frantovo.cz>
parents: 241
diff changeset
   115
			The module <code>relpipe-tr-guile</code> uses GNU Guile 2.2 but can also work with 2.0.
d16336d1c61f Release v0.10
František Kučera <franta-hg@frantovo.cz>
parents: 241
diff changeset
   116
			In such case, it requires this patch:
d16336d1c61f Release v0.10
František Kučera <franta-hg@frantovo.cz>
parents: 241
diff changeset
   117
		</p>
d16336d1c61f Release v0.10
František Kučera <franta-hg@frantovo.cz>
parents: 241
diff changeset
   118
		
d16336d1c61f Release v0.10
František Kučera <franta-hg@frantovo.cz>
parents: 241
diff changeset
   119
		<m:pre jazyk="bash"><![CDATA[sed 's/guile-2\.2/guile-2.0/g' -i "$RELPIPE_SRC"/relpipe-tr-guile.cpp/src/CMakeLists.txt]]></m:pre>
d16336d1c61f Release v0.10
František Kučera <franta-hg@frantovo.cz>
parents: 241
diff changeset
   120
87
25dec6931f18 Lepší odsazení, tabulátory.
František Kučera <franta-hg@frantovo.cz>
parents: 23
diff changeset
   121
	</text>
4
1bb39595a51c genrování hlavní nabídky #1
František Kučera <franta-hg@frantovo.cz>
parents: 2
diff changeset
   122
1
a05c6f3cbc3e základ, první verze
František Kučera <franta-hg@frantovo.cz>
parents:
diff changeset
   123
</stránka>