author | František Kučera <franta-hg@frantovo.cz> |
Mon, 21 Feb 2022 00:43:11 +0100 | |
branch | v_0 |
changeset 329 | 5bc2bb8b7946 |
parent 317 | fce3d6290c40 |
permissions | -rw-r--r-- |
23
0d2729ed16ed
zkouška interního odkazu
František Kučera <franta-hg@frantovo.cz>
parents:
18
diff
changeset
|
1 |
<stránka |
0d2729ed16ed
zkouška interního odkazu
František Kučera <franta-hg@frantovo.cz>
parents:
18
diff
changeset
|
2 |
xmlns="https://trac.frantovo.cz/xml-web-generator/wiki/xmlns/strana" |
0d2729ed16ed
zkouška interního odkazu
František Kučera <franta-hg@frantovo.cz>
parents:
18
diff
changeset
|
3 |
xmlns:m="https://trac.frantovo.cz/xml-web-generator/wiki/xmlns/makro"> |
0d2729ed16ed
zkouška interního odkazu
František Kučera <franta-hg@frantovo.cz>
parents:
18
diff
changeset
|
4 |
|
147
c004a45502b3
new pages: principles, roadmap, faq
František Kučera <franta-hg@frantovo.cz>
parents:
139
diff
changeset
|
5 |
<nadpis>Roadmap</nadpis> |
c004a45502b3
new pages: principles, roadmap, faq
František Kučera <franta-hg@frantovo.cz>
parents:
139
diff
changeset
|
6 |
<perex>Vision of future versions</perex> |
c004a45502b3
new pages: principles, roadmap, faq
František Kučera <franta-hg@frantovo.cz>
parents:
139
diff
changeset
|
7 |
<pořadí>14</pořadí> |
4
1bb39595a51c
genrování hlavní nabídky #1
František Kučera <franta-hg@frantovo.cz>
parents:
2
diff
changeset
|
8 |
|
2
ab9099ff88fa
vkládání zápatí, jmenné prostory, saxon
František Kučera <franta-hg@frantovo.cz>
parents:
1
diff
changeset
|
9 |
<text xmlns="http://www.w3.org/1999/xhtml"> |
ab9099ff88fa
vkládání zápatí, jmenné prostory, saxon
František Kučera <franta-hg@frantovo.cz>
parents:
1
diff
changeset
|
10 |
<p> |
151 | 11 |
Releases before v1.0.0 are development and are not intended for production use. |
12 |
Releases after v1.0.0 should follow the rules of <a href="http://semver.org/">Semantic versioning</a>. |
|
13 |
</p> |
|
14 |
||
241 | 15 |
<p> |
16 |
Released versions are described on the <m:a href="download">download</m:a> page. |
|
17 |
</p> |
|
18 |
||
329 | 19 |
<h2>v0.19, v0.20, v0.21 etc.</h2> |
151 | 20 |
|
21 |
<p> |
|
22 |
Releases for discussion and verification of the format and API design. |
|
23 |
</p> |
|
24 |
||
329 | 25 |
<p> |
26 |
This phase (before v1.0.0) might seem quite long. |
|
27 |
But it is important to verify the ideas and design in various scenarios, on various use cases. |
|
28 |
The general idea and the big picture are quite clear and stable. |
|
29 |
However there are many technical details that need to be carefully tuned. |
|
30 |
</p> |
|
31 |
||
151 | 32 |
<h3>Data types</h3> |
33 |
<ul> |
|
284
075d3d62d913
roadmap: v0.14 update
František Kučera <franta-hg@frantovo.cz>
parents:
267
diff
changeset
|
34 |
<li>fractions</li> |
075d3d62d913
roadmap: v0.14 update
František Kučera <franta-hg@frantovo.cz>
parents:
267
diff
changeset
|
35 |
|
151 | 36 |
<li>arrays/streams of bytes (octets)</li> |
37 |
<li>arrays of other types</li> |
|
38 |
<li>arrays of other types with support for NULL values</li> |
|
39 |
<li>nested relations</li> |
|
40 |
<li>date and time</li> |
|
291
2fab532bda09
roadmap: streamlet, IEEE 754
František Kučera <franta-hg@frantovo.cz>
parents:
289
diff
changeset
|
41 |
<li>floating-point numbers (IEEE 754)</li> |
151 | 42 |
<li>support NULL values (introduce bitmaps)</li> |
43 |
<li>support long strings (chunked, similar to octet streams)</li> |
|
44 |
||
45 |
<li>fixed size integers</li> |
|
46 |
<li>precise BigDecimal</li> |
|
47 |
<li>string in UTF-16</li> |
|
48 |
<li>string in ASCII</li> |
|
49 |
<li>string in ISO 8859-1</li> |
|
50 |
<li>string in ISO 8859-2</li> |
|
51 |
</ul> |
|
52 |
||
53 |
<h3>Inputs</h3> |
|
241 | 54 |
<p>Probably no new ones before v1.0.0.</p> |
55 |
||
151 | 56 |
<h3>Transformations</h3> |
287
780d782cdef5
roadmap: SQL: use ODBC interface instead of API of a particular DBMS
František Kučera <franta-hg@frantovo.cz>
parents:
284
diff
changeset
|
57 |
<ul> |
291
2fab532bda09
roadmap: streamlet, IEEE 754
František Kučera <franta-hg@frantovo.cz>
parents:
289
diff
changeset
|
58 |
<li>relpipe-tr-streamlet: based on the same interface as used by --streamlet in relpipe-in-filesystem</li> |
287
780d782cdef5
roadmap: SQL: use ODBC interface instead of API of a particular DBMS
František Kučera <franta-hg@frantovo.cz>
parents:
284
diff
changeset
|
59 |
</ul> |
264
d39cfc926f95
XMLTable, SQL, v0.13
František Kučera <franta-hg@frantovo.cz>
parents:
258
diff
changeset
|
60 |
|
151 | 61 |
<h3>Outputs</h3> |
241 | 62 |
<p>Probably no new ones before v1.0.0.</p> |
151 | 63 |
|
155
63cc1f6e8e3f
roadmap: tasks before v1.0
František Kučera <franta-hg@frantovo.cz>
parents:
152
diff
changeset
|
64 |
<h3>Other tasks</h3> |
63cc1f6e8e3f
roadmap: tasks before v1.0
František Kučera <franta-hg@frantovo.cz>
parents:
152
diff
changeset
|
65 |
<ul> |
293
b862d16a2e9f
roadmap: update before v0.15
František Kučera <franta-hg@frantovo.cz>
parents:
291
diff
changeset
|
66 |
<li>publish documentation of the stable API and file format</li> |
b862d16a2e9f
roadmap: update before v0.15
František Kučera <franta-hg@frantovo.cz>
parents:
291
diff
changeset
|
67 |
<li>publish automated complex tests (specification vs. implementation compliance)</li> |
b862d16a2e9f
roadmap: update before v0.15
František Kučera <franta-hg@frantovo.cz>
parents:
291
diff
changeset
|
68 |
<li>verify the format from the performance point of view</li> |
329 | 69 |
<li>relpipe-lib-writer: several modes of output buffering (auto, relation, record, value) or manual control</li> |
293
b862d16a2e9f
roadmap: update before v0.15
František Kučera <franta-hg@frantovo.cz>
parents:
291
diff
changeset
|
70 |
<li>improve parsing (corrupted input may currently lead to huge memory allocations), more fuzzing</li> |
b862d16a2e9f
roadmap: update before v0.15
František Kučera <franta-hg@frantovo.cz>
parents:
291
diff
changeset
|
71 |
<li>code clean-up and refactoring, move some reusable parts to common libraries</li> |
294
abbc9bcfbcc4
Release v0.15 – streamlets, parallel processing
František Kučera <franta-hg@frantovo.cz>
parents:
293
diff
changeset
|
72 |
<li>test the build with another compiler and tune the code</li> |
155
63cc1f6e8e3f
roadmap: tasks before v1.0
František Kučera <franta-hg@frantovo.cz>
parents:
152
diff
changeset
|
73 |
<li>pkg-config: version numbers, debug vs. release</li> |
218
d7a7f20aae51
roadmap: packaging
František Kučera <franta-hg@frantovo.cz>
parents:
184
diff
changeset
|
74 |
<li>packaging for Guix SD and .deb and .rpm distributions, Snapcraft, Flatpak etc.</li> |
317
fce3d6290c40
Release v0.16 – JACK MIDI output, ports + rename Guile to Scheme + improve CLI interfaces
František Kučera <franta-hg@frantovo.cz>
parents:
315
diff
changeset
|
75 |
<li>more examples, screenshots, videos, asciinema etc.</li> |
155
63cc1f6e8e3f
roadmap: tasks before v1.0
František Kučera <franta-hg@frantovo.cz>
parents:
152
diff
changeset
|
76 |
</ul> |
151 | 77 |
|
78 |
<h2>v1.0</h2> |
|
79 |
||
80 |
<p> |
|
81 |
First version for production use. |
|
82 |
Brings no new features, just stabilized result of previous development. |
|
83 |
Stable must be: |
|
84 |
</p> |
|
85 |
||
86 |
<ul> |
|
87 |
<li>format specification</li> |
|
88 |
<li>relpipe-lib-writer</li> |
|
89 |
<li>relpipe-lib-reader</li> |
|
90 |
<li>relpipe-in-cli</li> |
|
91 |
<li>relpipe-out-tabular</li> |
|
241 | 92 |
<li>relpipe-in-xml</li> |
151 | 93 |
<li>relpipe-out-xml</li> |
241 | 94 |
<li>relpipe-in-csv</li> |
95 |
<li>relpipe-out-csv</li> |
|
96 |
<li>relpipe-out-ods</li> |
|
151 | 97 |
</ul> |
98 |
||
99 |
<p> |
|
100 |
Other parts might be released as stable later. |
|
101 |
</p> |
|
102 |
<p> |
|
103 |
After this point, all components (the format specification, particular libraries and particular tools) |
|
104 |
will be versioned independently and the compatibility matrix will be maintained. |
|
87
25dec6931f18
Lepší odsazení, tabulátory.
František Kučera <franta-hg@frantovo.cz>
parents:
23
diff
changeset
|
105 |
</p> |
151 | 106 |
|
107 |
<h2>Further versions</h2> |
|
108 |
<p> |
|
109 |
Plans for next decades: |
|
110 |
</p> |
|
111 |
||
112 |
<h3>Data types</h3> |
|
113 |
<ul> |
|
114 |
<li>intervals of various types</li> |
|
115 |
<li>IPv4 address and subnet</li> |
|
116 |
<li>IPv6 address and subnet</li> |
|
117 |
<li>UUID</li> |
|
118 |
<li>e-mail</li> |
|
119 |
<li>URL / URI</li> |
|
120 |
<li>geographic locations</li> |
|
121 |
<li>OID: Object identifier</li> |
|
122 |
</ul> |
|
123 |
<h3>Inputs</h3> |
|
124 |
<p>Systems, commands:</p> |
|
125 |
<ul> |
|
126 |
<li>network information: ip, iptables, netstat, ss, dhcp-lease-list</li> |
|
127 |
<li>network interaction: ping, host, wget, curl</li> |
|
128 |
<li>system information: ps, lsof</li> |
|
129 |
<li>versioning systems (Mercurial, Git, Subversion, Monotone, Bazaar)</li> |
|
267
1826d1cce404
roadmap: remove already implemented features and add some new ones
František Kučera <franta-hg@frantovo.cz>
parents:
264
diff
changeset
|
130 |
<li>D-Bus</li> |
293
b862d16a2e9f
roadmap: update before v0.15
František Kučera <franta-hg@frantovo.cz>
parents:
291
diff
changeset
|
131 |
<li>POSIX MQ</li> |
151 | 132 |
</ul> |
133 |
||
134 |
<p>Formats:</p> |
|
135 |
<ul> |
|
241 | 136 |
<li>regular expression (regex groups → attributes)</li> |
151 | 137 |
<li>ODS (LibreOffice)</li> |
152
f876683324c2
roadmap: more formats
František Kučera <franta-hg@frantovo.cz>
parents:
151
diff
changeset
|
138 |
<li>iCalendar</li> |
f876683324c2
roadmap: more formats
František Kučera <franta-hg@frantovo.cz>
parents:
151
diff
changeset
|
139 |
<li>vCard</li> |
293
b862d16a2e9f
roadmap: update before v0.15
František Kučera <franta-hg@frantovo.cz>
parents:
291
diff
changeset
|
140 |
<li>MIME (e-mail messages)</li> |
b862d16a2e9f
roadmap: update before v0.15
František Kučera <franta-hg@frantovo.cz>
parents:
291
diff
changeset
|
141 |
<li>YAML, JSON, INI, TOML etc. (probably through alt2xml + in streamlets)</li> |
151 | 142 |
<li>Fsdb</li> |
143 |
<li>Java .properties</li> |
|
144 |
<li>Gettext / .po files</li> |
|
145 |
<li>STDIO log: captured STDIN, STDOUT and STDERR of other process with precise timing of all events</li> |
|
152
f876683324c2
roadmap: more formats
František Kučera <franta-hg@frantovo.cz>
parents:
151
diff
changeset
|
146 |
<li>pcap / tcpdump</li> |
151 | 147 |
<li>Inverse tabular</li> |
148 |
<li>Wikipedia / MediaWiki: harvest tables from given article</li> |
|
267
1826d1cce404
roadmap: remove already implemented features and add some new ones
František Kučera <franta-hg@frantovo.cz>
parents:
264
diff
changeset
|
149 |
<li>(X)HTML tables generic import (probably implemented in XQuery)</li> |
151 | 150 |
</ul> |
151 |
<h3>Transformations</h3> |
|
152 |
<ul> |
|
153 |
<li>iconv: character encoding converter</li> |
|
154 |
<li>rename: relations, attributes</li> |
|
155 |
<li>filter/skip: relations, attributes</li> |
|
156 |
<li>add constant attribute</li> |
|
157 |
<li>WHERE-like filter</li> |
|
158 |
<li>JOIN</li> |
|
159 |
<li>ORDER BY</li> |
|
160 |
<li>UNION, UNION ALL, explicit or implicit (relation interleaving)</li> |
|
161 |
<li>split single relation into multiple relations according to an attribute value</li> |
|
162 |
<li>union multiple relations and add an attribute with original relation name</li> |
|
163 |
<li>XPath, XSLT, XQuery</li> |
|
164 |
<li>statistics: compute/add aggregated values like min(), max(), avg(), sum() or percentiles</li> |
|
165 |
<li>function calls (probably should be part od SQL or XPath)</li> |
|
166 |
<li>pack and unpack: single record with arrays vs. multiple records with scalars</li> |
|
267
1826d1cce404
roadmap: remove already implemented features and add some new ones
František Kučera <franta-hg@frantovo.cz>
parents:
264
diff
changeset
|
167 |
<li>Lua, Perl, Python</li> |
151 | 168 |
<li>system command executor</li> |
169 |
</ul> |
|
170 |
<h3>Outputs</h3> |
|
171 |
<ul> |
|
172 |
<li>GUI in GTK</li> |
|
173 |
<li>(La)TeX</li> |
|
174 |
<li>XML tree</li> |
|
152
f876683324c2
roadmap: more formats
František Kučera <franta-hg@frantovo.cz>
parents:
151
diff
changeset
|
175 |
<li>iCalendar</li> |
f876683324c2
roadmap: more formats
František Kučera <franta-hg@frantovo.cz>
parents:
151
diff
changeset
|
176 |
<li>vCard</li> |
f876683324c2
roadmap: more formats
František Kučera <franta-hg@frantovo.cz>
parents:
151
diff
changeset
|
177 |
<li>tar: directories and files <!--relations and records = directories; attribute values = files--></li> |
151 | 178 |
<li>YAML, JSON, INI</li> |
179 |
<li>Fsdb</li> |
|
180 |
<li>Java .properties</li> |
|
181 |
<li>Gettext / .po files</li> |
|
182 |
<li>GraphViz: .dot files</li> |
|
183 |
<li>SQL: CREATE TABLE, INSERT</li> |
|
184 |
<li>SMTP, IMAP, files, HTTP, SOAP, ZeroMQ, TCP, UDP</li> |
|
267
1826d1cce404
roadmap: remove already implemented features and add some new ones
František Kučera <franta-hg@frantovo.cz>
parents:
264
diff
changeset
|
185 |
<li>D-Bus</li> |
293
b862d16a2e9f
roadmap: update before v0.15
František Kučera <franta-hg@frantovo.cz>
parents:
291
diff
changeset
|
186 |
<li>POSIX MQ</li> |
151 | 187 |
<li>source code / literals in Java, C, C++, Bash</li> |
188 |
</ul> |
|
189 |
||
190 |
<h3>Libraries and tools</h3> |
|
191 |
<p>Readers (SAX-like parsers) and writers (generators) for:</p> |
|
192 |
<ul> |
|
193 |
<li>C++</li> |
|
194 |
<li>C</li> |
|
195 |
<li>Java</li> |
|
293
b862d16a2e9f
roadmap: update before v0.15
František Kučera <franta-hg@frantovo.cz>
parents:
291
diff
changeset
|
196 |
<li>D</li> |
b862d16a2e9f
roadmap: update before v0.15
František Kučera <franta-hg@frantovo.cz>
parents:
291
diff
changeset
|
197 |
<li>Rust</li> |
b862d16a2e9f
roadmap: update before v0.15
František Kučera <franta-hg@frantovo.cz>
parents:
291
diff
changeset
|
198 |
<li>Go</li> |
151 | 199 |
<li>Python</li> |
200 |
<li>Perl</li> |
|
201 |
<li>PHP</li> |
|
202 |
</ul> |
|
203 |
<p>Other libraries and tools:</p> |
|
204 |
<ul> |
|
205 |
<li>ORM API: mapping between classes/objects and relations/records</li> |
|
297
192b0059a6c4
Release v0.16 – ODBC in SQL + JACK MIDI
František Kučera <franta-hg@frantovo.cz>
parents:
294
diff
changeset
|
206 |
<li>JDBC and ODBC drivers</li> |
151 | 207 |
<li>schemas (XSD-like)</li> |
208 |
<li>generators, compilers, validators, comparators</li> |
|
209 |
<li>transformer helpers</li> |
|
210 |
<li>Ragel input helpers</li> |
|
211 |
<li>PEG input helpers</li> |
|
212 |
<li>repair tools (for corrupted data)</li> |
|
213 |
<li>pull parsers</li> |
|
214 |
<li>SAX and DOM parsers (read relational data like it was XML)</li> |
|
215 |
<li>visual editor for pipeline design</li> |
|
216 |
</ul> |
|
217 |
||
218 |
||
87
25dec6931f18
Lepší odsazení, tabulátory.
František Kučera <franta-hg@frantovo.cz>
parents:
23
diff
changeset
|
219 |
</text> |
4
1bb39595a51c
genrování hlavní nabídky #1
František Kučera <franta-hg@frantovo.cz>
parents:
2
diff
changeset
|
220 |
|
1 | 221 |
</stránka> |