Alois Mahdal
57b7154d0c
Skip the rest if a test fails badly
10 vuotta sitten
Alois Mahdal
537b2d9d84
Restructure test folders to separate test/oracle/result
Support test folder structure where test, oracle and generated result
data are stored each in separate directory. This makes it easier to
ensure legible diff output without cluttering the filenames too much.
10 vuotta sitten
Alois Mahdal
7f9f951174
Do not warn on "ok" situation
10 vuotta sitten
Alois Mahdal
35015a8fbb
Review and document local variables
10 vuotta sitten
Alois Mahdal
e128a4b82e
Remove unnecessary function
Apparently leftover from earlier TF version.
10 vuotta sitten
Alois Mahdal
4eb772d93b
Do not require TF_SETUP and TF_CLEANUP be in Bash
They can be any executables now.
10 vuotta sitten
Alois Mahdal
8eb12c6a13
Do not exit whole session from tf_do_subtests
This was obviously a bug.
10 vuotta sitten
Alois Mahdal
f4e949a8f0
Handle cases of bad enumeration and filtering
Previously the framework was silent in cases such as when enumeration
fails (maybe due to enum functions not implemented), returns nothing,
or if regex in TF_FILTER_SUBTEST leaves nothing.
Now it bails out on errorneous or empty enumeration, and adds debug
message if TF_FILTER_SUBTEST is "too hungry".
Also, intermediary lists are saved to file and left for artifact
collection.
10 vuotta sitten
Alois Mahdal
21d9f71cba
Rewrite TF subtest execution
Most changes are in tf_do_subtest.
* Separated setup/cleanup logic from test data collecting and
execution/evaluation.
* Revamped the execution/evaluation logic in a new tool testflt,
allowing tester to use it as the need be.
* Code to compose actual test command removed, as testflt makes it
easy to write the code in one place (TF_RUN) and keep simple things
simple.
* Removed tf_parse_meta, as it's obsolered by above changes.
* Updated tests to reflect the new style.
10 vuotta sitten
Alois Mahdal
013d416c69
Add nice new slogan
(Thx Joe Spolsky for inspiration)
10 vuotta sitten
Alois Mahdal
88e5b9f6f1
Pre-declare r_es properly: local, with docstring
10 vuotta sitten
Alois Mahdal
6dcbf8c10e
Use better name for body start field/var
10 vuotta sitten
Alois Mahdal
a724ad919e
Update tf_parse_meta docstring and add example
10 vuotta sitten
Alois Mahdal
d4f547496e
Use same naming scheme as simple.sh
10 vuotta sitten
Alois Mahdal
8ffb66b73d
Rename ffoo_import oracles to show semantic
10 vuotta sitten
Alois Mahdal
9b73d14c10
Remove unnecessary .stdout files
Apparently leftover from earlier changes, these files are exact
duplicates of their .oracle counterpart, but are not actually used by
local TF_RUN
10 vuotta sitten
Alois Mahdal
875fd46b01
Refactor ffoo_import test inc. docstrings
...so that it can be understood by future reader.
10 vuotta sitten
Alois Mahdal
7d11177c1c
Use `.test` suffix for test definitions
Avoiding using the plain test name makes it easier to understand the
role of each file.
10 vuotta sitten
Alois Mahdal
286875cae1
Fix filename reported in warning
10 vuotta sitten
Alois Mahdal
ced6673ce1
Add docstrings for local variables
10 vuotta sitten
Alois Mahdal
9c49ec07c5
Move variable declares to top
This as convention helps spot leaking variables and makes it
easier to document variables for reader
10 vuotta sitten
Alois Mahdal
7ee7517e97
Fill in forgotten stub docstring
10 vuotta sitten
Alois Mahdal
7978da2b45
Ignore tests without TF_RUN executable
It is intended, documented and assumed in later code that any test must
contain this executable.
10 vuotta sitten
Alois Mahdal
9fdf36e543
Die on unsafe -L|--list parameter
10 vuotta sitten
Alois Mahdal
38d7b93528
Revamp mkit
Make it
* more flexible,
* more readable,
* faster,
* take care of manpages (not fully done yet),
* take care of dist list,
* little bit more polished in various other things.
10 vuotta sitten
Alois Mahdal
cb2e6b7f02
Fix and clarify cfgrep docstring
11 vuotta sitten
Alois Mahdal
076e112c0f
Bump version
11 vuotta sitten
Alois Mahdal
ad65edc47e
Move project parts below src
A more conventional hierarchy
11 vuotta sitten
Alois Mahdal
8e2d43efc8
Update tester's docs according to new hierarchy
11 vuotta sitten
Alois Mahdal
052a8cc7da
Revamp test script file tree hierarchy
This new hierarchy makes it easier to work simultaneously on data and
the script, simplifies deployment to tempdir and makes the launching
script naming consistent with simple.sh.
11 vuotta sitten
Alois Mahdal
9560538839
Remove obsolete make target
"doc" (not manpages) is built and installed with others.
11 vuotta sitten
Alois Mahdal
f586ebf928
Always resolve install prefix
Otherwise tests with --prefix break since they operate from independent
folder.
11 vuotta sitten
Alois Mahdal
e302be9904
Add --prefix -- support testing from arbitrary dir
11 vuotta sitten
Alois Mahdal
956f5168dc
Add long options
11 vuotta sitten
Alois Mahdal
035aa8b343
Add docstrings to mkit's functions
11 vuotta sitten
Alois Mahdal
eb982b525a
Fix typo
11 vuotta sitten
Alois Mahdal
726f0413eb
Fix errorneous usage of _expand
11 vuotta sitten
Alois Mahdal
008cacab80
Bump version
11 vuotta sitten
Alois Mahdal
2a86c9b05e
Add argument to prepend dir to FFOO_PATH
This should be consistent with `ffoom` and `ffdoc`
11 vuotta sitten
Alois Mahdal
c95b5fbf75
Bump version
11 vuotta sitten
Alois Mahdal
74c5096033
Update docs after CLI change
11 vuotta sitten
Alois Mahdal
cb7ab36aa6
Avoid confusion with -I from ffoom and ffdoc
11 vuotta sitten
Alois Mahdal
6d244fb69c
Add style guide (draft)
11 vuotta sitten
Alois Mahdal
4542fa171d
Explain variables in cfgrep
11 vuotta sitten
Alois Mahdal
5f369c789b
Remove unnecessary lines
11 vuotta sitten
Alois Mahdal
798f63ef8a
Add and improve docstrings for config.sh internals
11 vuotta sitten
Alois Mahdal
3774c24116
Use the _expand internal backend
11 vuotta sitten
Alois Mahdal
2be3fe83ab
Use more appropriate function name
11 vuotta sitten
Alois Mahdal
b09e8cd427
Add docstrings to internals
11 vuotta sitten
Alois Mahdal
308350e1a2
Fix typo
11 vuotta sitten