relpipe-data/index.xml
author František Kučera <franta-hg@frantovo.cz>
Mon, 21 Feb 2022 00:43:11 +0100
branchv_0
changeset 329 5bc2bb8b7946
parent 321 e32e2e308de4
permissions -rw-r--r--
Release v0.18
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
23
0d2729ed16ed zkouška interního odkazu
František Kučera <franta-hg@frantovo.cz>
parents: 18
diff changeset
     1
<stránka
0d2729ed16ed zkouška interního odkazu
František Kučera <franta-hg@frantovo.cz>
parents: 18
diff changeset
     2
	xmlns="https://trac.frantovo.cz/xml-web-generator/wiki/xmlns/strana"
0d2729ed16ed zkouška interního odkazu
František Kučera <franta-hg@frantovo.cz>
parents: 18
diff changeset
     3
	xmlns:m="https://trac.frantovo.cz/xml-web-generator/wiki/xmlns/makro">
0d2729ed16ed zkouška interního odkazu
František Kučera <franta-hg@frantovo.cz>
parents: 18
diff changeset
     4
	
137
ecfe2980ae1f logo and css
František Kučera <franta-hg@frantovo.cz>
parents: 136
diff changeset
     5
	<nadpis>Relational pipes</nadpis>
ecfe2980ae1f logo and css
František Kučera <franta-hg@frantovo.cz>
parents: 136
diff changeset
     6
	<perex>Official homepage of Relational pipes.</perex>
4
1bb39595a51c genrování hlavní nabídky #1
František Kučera <franta-hg@frantovo.cz>
parents: 2
diff changeset
     7
	<pořadí>10</pořadí>
1bb39595a51c genrování hlavní nabídky #1
František Kučera <franta-hg@frantovo.cz>
parents: 2
diff changeset
     8
2
ab9099ff88fa vkládání zápatí, jmenné prostory, saxon
František Kučera <franta-hg@frantovo.cz>
parents: 1
diff changeset
     9
	<text xmlns="http://www.w3.org/1999/xhtml">
ab9099ff88fa vkládání zápatí, jmenné prostory, saxon
František Kučera <franta-hg@frantovo.cz>
parents: 1
diff changeset
    10
		<p>
217
3e2fd4ce9f02 hacker culture and the GNU way
František Kučera <franta-hg@frantovo.cz>
parents: 183
diff changeset
    11
			One of the great parts of the hacker culture<m:podČarou><m:unix tvar="vysvětlivka"/>
3e2fd4ce9f02 hacker culture and the GNU way
František Kučera <franta-hg@frantovo.cz>
parents: 183
diff changeset
    12
			(see also <a href="https://stallman.org/articles/on-hacking.html">hacking</a> and <a href="https://www.gnu.org/gnu/gnu-linux-faq.html">GNU/Linux FAQ</a>)</m:podČarou> and the GNU way
3e2fd4ce9f02 hacker culture and the GNU way
František Kučera <franta-hg@frantovo.cz>
parents: 183
diff changeset
    13
			is the invention<m:podČarou>which is attributed to Doug McIlroy, see <a href="http://www.catb.org/~esr/writings/taoup/html/ch07s02.html#plumbing">The Art of Unix Programming: Pipes, Redirection, and Filters</a></m:podČarou>
143
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    14
			of <em>pipes</em> and the idea<m:podČarou>see <a href="http://www.catb.org/~esr/writings/taoup/html/ch01s06.html">The Art of Unix Programming: Basics of the Unix Philosophy</a></m:podČarou> 
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    15
			that <em>one program should do one thing and do it well</em>.
87
25dec6931f18 Lepší odsazení, tabulátory.
František Kučera <franta-hg@frantovo.cz>
parents: 23
diff changeset
    16
		</p>
138
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    17
		
143
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    18
		<p>
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    19
			Each running program (process) has one input stream (called standard input or STDIN) and one output stream (called standard output or STDOUT) and also one additional output stream for logging/errors/warnings (STDERR).
321
e32e2e308de4 improve English
František Kučera <franta-hg@frantovo.cz>
parents: 316
diff changeset
    20
			We can connect programs and pass the STDOUT of the first one to the STDIN of the second one (etc.) using pipes.
143
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    21
		</p>
144
ee7e96151673 classic pipeline example
František Kučera <franta-hg@frantovo.cz>
parents: 143
diff changeset
    22
		
ee7e96151673 classic pipeline example
František Kučera <franta-hg@frantovo.cz>
parents: 143
diff changeset
    23
		<p>
306
f600b6f8a88c non-breaking spaces
František Kučera <franta-hg@frantovo.cz>
parents: 273
diff changeset
    24
			A classic pipeline example (<m:a href="classic-example">explained</m:a>):
144
ee7e96151673 classic pipeline example
František Kučera <franta-hg@frantovo.cz>
parents: 143
diff changeset
    25
		</p>
ee7e96151673 classic pipeline example
František Kučera <franta-hg@frantovo.cz>
parents: 143
diff changeset
    26
		
ee7e96151673 classic pipeline example
František Kučera <franta-hg@frantovo.cz>
parents: 143
diff changeset
    27
		<m:classic-example/>
143
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    28
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    29
		<!--		
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    30
		<m:diagram orientace="vodorovně">
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    31
			node[shape=box];
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    32
			
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    33
			cat  [label="cat /etc/fstab"];
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    34
			dd   [];
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    35
			grep [label="grep tmpfs"];
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    36
			log  [label="/tmp/dd.log"];
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    37
			
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    38
			cat -> dd  [label="STDOUT → STDIN"];
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    39
			dd -> grep [label="STDOUT → STDIN"];
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    40
			dd -> log  [label="STDERR → file"];
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    41
		</m:diagram>
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    42
		-->
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    43
		
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    44
		<p>
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    45
			According to this principle we can build complex and powerful programs (pipelines) by composing several simple, single-purpose and reusable programs.
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    46
			Such single-purpose programs (often called <em>filters</em>) are much easier to create, test and optimize and their authors don't have to bother about the complexity of the final pipeline.
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    47
			They even don't have to know, how their programs will be used in the future by others.
306
f600b6f8a88c non-breaking spaces
František Kučera <franta-hg@frantovo.cz>
parents: 273
diff changeset
    48
			This is a great design principle that brings us advanced flexibility, reusability, efficiency and reliability.
f600b6f8a88c non-breaking spaces
František Kučera <franta-hg@frantovo.cz>
parents: 273
diff changeset
    49
			Being in any role (author of a filter, builder of a pipeline etc.), we can always focus on our task only and do it well.<m:podČarou>see <a href="http://wiki.apidesign.org/wiki/Cluelessness">cluelessness</a> by Jaroslav Tulach in his <em>Practical API Design. Confessions of a Java Framework Architect</em></m:podČarou>
143
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    50
			And we can collaborate with others even if we don't know about them and we don't know that we are collaborating.
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    51
			Now think about putting this together with the free software ideas...  How very!
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    52
		</p>
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    53
		
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    54
		<!--
138
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    55
		<m:diagram orientace="vodorovně">
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    56
			compound=true;
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    57
			node[shape=box];
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    58
			
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    59
			subgraph cluster_in {
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    60
			label = "Inputs:";
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    61
			cli;
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    62
			fstab;
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    63
			}
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    64
			
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    65
			subgraph cluster_tr {
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    66
			label = "Transformations:";
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    67
			grep;
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    68
			sed;
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    69
			}
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    70
			
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    71
			subgraph cluster_out {
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    72
			label = "Outputs:";
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    73
			xml;
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    74
			tabular;
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    75
			gui;
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    76
			}
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    77
			
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    78
			cli -> grep  [ltail=cluster_in, lhead=cluster_tr];
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    79
			grep -> xml [ltail=cluster_tr, lhead=cluster_out];
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    80
			// cli -> xml [ltail=cluster_in, lhead=cluster_out];
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    81
			
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
    82
		</m:diagram>
143
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    83
		-->
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
    84
		
144
ee7e96151673 classic pipeline example
František Kučera <franta-hg@frantovo.cz>
parents: 143
diff changeset
    85
		
146
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
    86
		<p>
148
d51787006954 principles
František Kučera <franta-hg@frantovo.cz>
parents: 146
diff changeset
    87
			But the question is: how the data passed through pipes should be formatted and structured.
321
e32e2e308de4 improve English
František Kučera <franta-hg@frantovo.cz>
parents: 316
diff changeset
    88
			There is a wide spectrum of options from simple unstructured text files (just arrays of lines)
146
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
    89
			through various <abbr title="delimiter-separated values e.g. CSV separated by comas">DSV</abbr>
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
    90
			to formats like XML (YAML, JSON, ASN.1, Diameter, S-expressions etc.).
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
    91
			Simpler formats look temptingly but have many problems and limitations (see the Pitfalls section in the <m:a href="classic-example">Classic pipeline example</m:a>).
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
    92
			On the other hand, the advanced formats are capable to represent arbitrary object tree structures or even arbitrary graphs.
321
e32e2e308de4 improve English
František Kučera <franta-hg@frantovo.cz>
parents: 316
diff changeset
    93
			They offer unlimited possibilities – and this is their strength and weakness at the same time.
146
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
    94
		</p>
144
ee7e96151673 classic pipeline example
František Kučera <franta-hg@frantovo.cz>
parents: 143
diff changeset
    95
		
146
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
    96
		<!--
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
    97
		<blockquote>Everything should be made as simple as possible, but not simpler.</blockquote>
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
    98
		-->
144
ee7e96151673 classic pipeline example
František Kučera <franta-hg@frantovo.cz>
parents: 143
diff changeset
    99
		
146
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
   100
		<p>
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
   101
			It is not about the shape of the brackets, apostrophes, quotes or text vs. binary.
306
f600b6f8a88c non-breaking spaces
František Kučera <franta-hg@frantovo.cz>
parents: 273
diff changeset
   102
			It is not a technical question – it is in the semantic layer and human brain.
146
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
   103
			Generic formats and their <em>arbitrary object trees/graphs</em> are (for humans, not for computers) difficult to understand and work with
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
   104
			– compared to simpler structures like arrays, maps or matrixes.
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
   105
		</p>
144
ee7e96151673 classic pipeline example
František Kučera <franta-hg@frantovo.cz>
parents: 143
diff changeset
   106
		
146
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
   107
		<p>
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
   108
			This is the reason why we have chosen the relational model as our logical model.
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
   109
			This model comes from 1969<m:podČarou>invented and described by Edgar F. Codd, 
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
   110
				see <em>Derivability, Redundancy, and Consistency of Relations Stored in Large Data Banks, Research Report, IBM</em> from 1969 
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
   111
				and <em>A Relational Model of Data for Large Shared Data Banks</em> from 1970, 
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
   112
				see also <a href="https://en.wikipedia.org/wiki/Relational_model">Relational model</a>
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
   113
			</m:podČarou>
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
   114
			and through decades it has proven its qualities and viability.
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
   115
			This logical model is powerful enough to describe almost any data and – at the same time – it is still simple and easy to be understood by humans.
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
   116
		</p>
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
   117
		
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
   118
		<p>
321
e32e2e308de4 improve English
František Kučera <franta-hg@frantovo.cz>
parents: 316
diff changeset
   119
			Thus, the <m:name/> are streams containing zero or more relations.
306
f600b6f8a88c non-breaking spaces
František Kučera <franta-hg@frantovo.cz>
parents: 273
diff changeset
   120
			Each relation has a name, one or more attributes and zero or more records (tuples).
f600b6f8a88c non-breaking spaces
František Kučera <franta-hg@frantovo.cz>
parents: 273
diff changeset
   121
			Each attribute has a name and a data-type.
146
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
   122
			Records contain attribute values.
306
f600b6f8a88c non-breaking spaces
František Kučera <franta-hg@frantovo.cz>
parents: 273
diff changeset
   123
			We can imagine this stream as a sequence of tables (but the table is only one of many possible visual representations of such relational data).
146
8c2e2dbee5cc format, structure and logical model – the relational model
František Kučera <franta-hg@frantovo.cz>
parents: 145
diff changeset
   124
		</p>
144
ee7e96151673 classic pipeline example
František Kučera <franta-hg@frantovo.cz>
parents: 143
diff changeset
   125
		
143
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   126
		<h2>What <m:name/> are?</h2>
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   127
		
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   128
		<p>
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   129
			<m:name/> are an open <em>data format</em> designed for streaming structured data between two processes. 
306
f600b6f8a88c non-breaking spaces
František Kučera <franta-hg@frantovo.cz>
parents: 273
diff changeset
   130
			Simultaneously with the format specification, we are also developing a <em>reference implementation</em> (libraries and tools) as a free software.
143
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   131
			Although we believe in the specification-first (or contract-first) approach, we always look and check, whether the theoretic concepts are feasible and whether they can be reasonably and reliably implemented.
321
e32e2e308de4 improve English
František Kučera <franta-hg@frantovo.cz>
parents: 316
diff changeset
   132
			So before publishing any new specification or its version, we will verify it by creating a reference implementation at least in one programming language.
143
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   133
		</p>
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   134
		<p>
306
f600b6f8a88c non-breaking spaces
František Kučera <franta-hg@frantovo.cz>
parents: 273
diff changeset
   135
			More generally, <m:name/> are a philosophical continuation of the classic <m:unix/> pipelines and the relational model.
143
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   136
		</p>
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   137
		
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   138
		
329
5bc2bb8b7946 Release v0.18
František Kučera <franta-hg@frantovo.cz>
parents: 321
diff changeset
   139
		<h2 id="not">What <m:name/> are not?</h2>
143
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   140
			
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   141
		<p>
306
f600b6f8a88c non-breaking spaces
František Kučera <franta-hg@frantovo.cz>
parents: 273
diff changeset
   142
			<m:name/> respect the existing ecosystem and are rather an improvement or supplement than a replacement.
f600b6f8a88c non-breaking spaces
František Kučera <franta-hg@frantovo.cz>
parents: 273
diff changeset
   143
			So the <m:name/> are not a:
143
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   144
		</p>
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   145
		
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   146
		<ul>
306
f600b6f8a88c non-breaking spaces
František Kučera <franta-hg@frantovo.cz>
parents: 273
diff changeset
   147
			<li>Shell – we use existing shells (e.g. GNU Bash), work with any shell and even without a shell (e.g. as a stream format passed through a network or stored in a file).</li>
145
42bbbccd87f3 small fixes and improvements
František Kučera <franta-hg@frantovo.cz>
parents: 144
diff changeset
   148
			<li>Terminal emulator – same as with shells, we use existing terminals and we can use <m:name/> also outside any terminal; if we interact with the terminal, we use standard means like Unicode, ANSI escape sequences etc.</li>
183
František Kučera <franta-hg@frantovo.cz>
parents: 148
diff changeset
   149
			<li>IDE – we can use standard <m:unix/> tools as an IDE (GNU Screen, Emacs, Make etc.) or any other IDE.</li>
143
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   150
			<li>Programming language – <m:name/> are language-independent data format and can be produced or consumed in any programming language.</li>
316
d7ae02390fac relpipe-tr-guile.cpp → relpipe-tr-scheme.cpp
František Kučera <franta-hg@frantovo.cz>
parents: 306
diff changeset
   151
			<li>Query language – although some of our tools are doing queries, filtering or transformations, we are not inventing a new query language – instead, we use existing languages like SQL, XPath, Scheme, AWK or regular expressions.</li>
143
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   152
			<!--<li>Text editor – </li>-->
306
f600b6f8a88c non-breaking spaces
František Kučera <franta-hg@frantovo.cz>
parents: 273
diff changeset
   153
			<li>Database system, DBMS – we focus on the stream processing rather than data storage. Although sometimes it makes sense to redirect data to a file and continue with the processing later.</li>
143
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   154
		</ul>
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   155
		
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   156
		
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   157
		<h2>Project status</h2>
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   158
		
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   159
		<p>
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   160
			The main ideas and the roadmap are quite clear, but many things will change (including the format internals and interfaces of the libraries and tools).
145
42bbbccd87f3 small fixes and improvements
František Kučera <franta-hg@frantovo.cz>
parents: 144
diff changeset
   161
			Because we understand how important the API and ABI stability is, we are not ready to publish the version 1.0 yet.
143
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   162
		</p>
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   163
		<p>
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   164
			On the other hand, the already published tools (tagged as v0.x in v_0 branch) should work quite well (should compile, should run, should not segfault often, should not wipe your hard drive or kill your cat),
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   165
			so they might be useful for someone who likes our ideas and who is prepared to update own programs and scripts when the new version is ready.
297da74fcab2 introduction
František Kučera <franta-hg@frantovo.cz>
parents: 138
diff changeset
   166
		</p>
266
862a1d97e74b add the Big picture diagram
František Kučera <franta-hg@frantovo.cz>
parents: 217
diff changeset
   167
		
273
b68a2fc9e2b3 mention also guile/scheme and awk
František Kučera <franta-hg@frantovo.cz>
parents: 270
diff changeset
   168
		<p>We promise to fulfill all requirements of the Sane software manifesto before we release the version 1.0:</p>
270
e6bac9ff0d87 Sane software manifesto
František Kučera <franta-hg@frantovo.cz>
parents: 268
diff changeset
   169
		<p style="text-align: right">
e6bac9ff0d87 Sane software manifesto
František Kučera <franta-hg@frantovo.cz>
parents: 268
diff changeset
   170
			<a href="https://sane-software.globalcode.info/">
e6bac9ff0d87 Sane software manifesto
František Kučera <franta-hg@frantovo.cz>
parents: 268
diff changeset
   171
				<img alt="Sane software manifesto" src="img/sane-software-logo-rectangle.png"/>
e6bac9ff0d87 Sane software manifesto
František Kučera <franta-hg@frantovo.cz>
parents: 268
diff changeset
   172
			</a>
e6bac9ff0d87 Sane software manifesto
František Kučera <franta-hg@frantovo.cz>
parents: 268
diff changeset
   173
		</p>
e6bac9ff0d87 Sane software manifesto
František Kučera <franta-hg@frantovo.cz>
parents: 268
diff changeset
   174
		
e6bac9ff0d87 Sane software manifesto
František Kučera <franta-hg@frantovo.cz>
parents: 268
diff changeset
   175
		
266
862a1d97e74b add the Big picture diagram
František Kučera <franta-hg@frantovo.cz>
parents: 217
diff changeset
   176
		<h2>Big picture</h2>
862a1d97e74b add the Big picture diagram
František Kučera <franta-hg@frantovo.cz>
parents: 217
diff changeset
   177
		
862a1d97e74b add the Big picture diagram
František Kučera <franta-hg@frantovo.cz>
parents: 217
diff changeset
   178
		<p>
862a1d97e74b add the Big picture diagram
František Kučera <franta-hg@frantovo.cz>
parents: 217
diff changeset
   179
			Typical relational pipeline consists of an input filter (left), an output filter (right) and zero, one or more transformations (middle)
862a1d97e74b add the Big picture diagram
František Kučera <franta-hg@frantovo.cz>
parents: 217
diff changeset
   180
			as outlined on this diagram:<m:podČarou>The diagram was made in the <a href="https://www.mapeditor.org/">Tiled Map Editor</a> 
862a1d97e74b add the Big picture diagram
František Kučera <franta-hg@frantovo.cz>
parents: 217
diff changeset
   181
			and the tiles (particular pipe graphics parts) come from the game called <a href="http://www.users.waitrose.com/~thunor/pipepanic/">Pipepanic</a>.
862a1d97e74b add the Big picture diagram
František Kučera <franta-hg@frantovo.cz>
parents: 217
diff changeset
   182
			The tiles used in this diagram are licensed under the <a href="http://artlibre.org/licence/lal/en/">Free Art License</a>.
862a1d97e74b add the Big picture diagram
František Kučera <franta-hg@frantovo.cz>
parents: 217
diff changeset
   183
			</m:podČarou>
862a1d97e74b add the Big picture diagram
František Kučera <franta-hg@frantovo.cz>
parents: 217
diff changeset
   184
		</p>
862a1d97e74b add the Big picture diagram
František Kučera <franta-hg@frantovo.cz>
parents: 217
diff changeset
   185
		
862a1d97e74b add the Big picture diagram
František Kučera <franta-hg@frantovo.cz>
parents: 217
diff changeset
   186
		<m:img src="img/relational-pipes-big-picture-1.png"/>
862a1d97e74b add the Big picture diagram
František Kučera <franta-hg@frantovo.cz>
parents: 217
diff changeset
   187
		
862a1d97e74b add the Big picture diagram
František Kučera <franta-hg@frantovo.cz>
parents: 217
diff changeset
   188
		<p>
306
f600b6f8a88c non-breaking spaces
František Kučera <franta-hg@frantovo.cz>
parents: 273
diff changeset
   189
			Data can flow through a sequence of several transformations or directly from the input filter to the output filter.
266
862a1d97e74b add the Big picture diagram
František Kučera <franta-hg@frantovo.cz>
parents: 217
diff changeset
   190
		</p>
138
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
   191
5d892b169e32 metadata, footer
František Kučera <franta-hg@frantovo.cz>
parents: 137
diff changeset
   192
		
87
25dec6931f18 Lepší odsazení, tabulátory.
František Kučera <franta-hg@frantovo.cz>
parents: 23
diff changeset
   193
	</text>
4
1bb39595a51c genrování hlavní nabídky #1
František Kučera <franta-hg@frantovo.cz>
parents: 2
diff changeset
   194
1
a05c6f3cbc3e základ, první verze
František Kučera <franta-hg@frantovo.cz>
parents:
diff changeset
   195
</stránka>
87
25dec6931f18 Lepší odsazení, tabulátory.
František Kučera <franta-hg@frantovo.cz>
parents: 23
diff changeset
   196