Split-fork from qecc

All other files have been moved to *eecc* and whole qecc
history (~300 commits) has been squashed into this commit.

.gitignore

@@ -0,0 +1 @@
+.autoclean

LICENSE

@@ -0,0 +1,165 @@
+                   GNU LESSER GENERAL PUBLIC LICENSE
+                       Version 3, 29 June 2007
+
+ Copyright (C) 2007 Free Software Foundation, Inc. <http://fsf.org/>
+ Everyone is permitted to copy and distribute verbatim copies
+ of this license document, but changing it is not allowed.
+
+
+  This version of the GNU Lesser General Public License incorporates
+the terms and conditions of version 3 of the GNU General Public
+License, supplemented by the additional permissions listed below.
+
+  0. Additional Definitions.
+
+  As used herein, "this License" refers to version 3 of the GNU Lesser
+General Public License, and the "GNU GPL" refers to version 3 of the GNU
+General Public License.
+
+  "The Library" refers to a covered work governed by this License,
+other than an Application or a Combined Work as defined below.
+
+  An "Application" is any work that makes use of an interface provided
+by the Library, but which is not otherwise based on the Library.
+Defining a subclass of a class defined by the Library is deemed a mode
+of using an interface provided by the Library.
+
+  A "Combined Work" is a work produced by combining or linking an
+Application with the Library.  The particular version of the Library
+with which the Combined Work was made is also called the "Linked
+Version".
+
+  The "Minimal Corresponding Source" for a Combined Work means the
+Corresponding Source for the Combined Work, excluding any source code
+for portions of the Combined Work that, considered in isolation, are
+based on the Application, and not on the Linked Version.
+
+  The "Corresponding Application Code" for a Combined Work means the
+object code and/or source code for the Application, including any data
+and utility programs needed for reproducing the Combined Work from the
+Application, but excluding the System Libraries of the Combined Work.
+
+  1. Exception to Section 3 of the GNU GPL.
+
+  You may convey a covered work under sections 3 and 4 of this License
+without being bound by section 3 of the GNU GPL.
+
+  2. Conveying Modified Versions.
+
+  If you modify a copy of the Library, and, in your modifications, a
+facility refers to a function or data to be supplied by an Application
+that uses the facility (other than as an argument passed when the
+facility is invoked), then you may convey a copy of the modified
+version:
+
+   a) under this License, provided that you make a good faith effort to
+   ensure that, in the event an Application does not supply the
+   function or data, the facility still operates, and performs
+   whatever part of its purpose remains meaningful, or
+
+   b) under the GNU GPL, with none of the additional permissions of
+   this License applicable to that copy.
+
+  3. Object Code Incorporating Material from Library Header Files.
+
+  The object code form of an Application may incorporate material from
+a header file that is part of the Library.  You may convey such object
+code under terms of your choice, provided that, if the incorporated
+material is not limited to numerical parameters, data structure
+layouts and accessors, or small macros, inline functions and templates
+(ten or fewer lines in length), you do both of the following:
+
+   a) Give prominent notice with each copy of the object code that the
+   Library is used in it and that the Library and its use are
+   covered by this License.
+
+   b) Accompany the object code with a copy of the GNU GPL and this license
+   document.
+
+  4. Combined Works.
+
+  You may convey a Combined Work under terms of your choice that,
+taken together, effectively do not restrict modification of the
+portions of the Library contained in the Combined Work and reverse
+engineering for debugging such modifications, if you also do each of
+the following:
+
+   a) Give prominent notice with each copy of the Combined Work that
+   the Library is used in it and that the Library and its use are
+   covered by this License.
+
+   b) Accompany the Combined Work with a copy of the GNU GPL and this license
+   document.
+
+   c) For a Combined Work that displays copyright notices during
+   execution, include the copyright notice for the Library among
+   these notices, as well as a reference directing the user to the
+   copies of the GNU GPL and this license document.
+
+   d) Do one of the following:
+
+       0) Convey the Minimal Corresponding Source under the terms of this
+       License, and the Corresponding Application Code in a form
+       suitable for, and under terms that permit, the user to
+       recombine or relink the Application with a modified version of
+       the Linked Version to produce a modified Combined Work, in the
+       manner specified by section 6 of the GNU GPL for conveying
+       Corresponding Source.
+
+       1) Use a suitable shared library mechanism for linking with the
+       Library.  A suitable mechanism is one that (a) uses at run time
+       a copy of the Library already present on the user's computer
+       system, and (b) will operate properly with a modified version
+       of the Library that is interface-compatible with the Linked
+       Version.
+
+   e) Provide Installation Information, but only if you would otherwise
+   be required to provide such information under section 6 of the
+   GNU GPL, and only to the extent that such information is
+   necessary to install and execute a modified version of the
+   Combined Work produced by recombining or relinking the
+   Application with a modified version of the Linked Version. (If
+   you use option 4d0, the Installation Information must accompany
+   the Minimal Corresponding Source and Corresponding Application
+   Code. If you use option 4d1, you must provide the Installation
+   Information in the manner specified by section 6 of the GNU GPL
+   for conveying Corresponding Source.)
+
+  5. Combined Libraries.
+
+  You may place library facilities that are a work based on the
+Library side by side in a single library together with other library
+facilities that are not Applications and are not covered by this
+License, and convey such a combined library under terms of your
+choice, if you do both of the following:
+
+   a) Accompany the combined library with a copy of the same work based
+   on the Library, uncombined with any other library facilities,
+   conveyed under the terms of this License.
+
+   b) Give prominent notice with the combined library that part of it
+   is a work based on the Library, and explaining where to find the
+   accompanying uncombined form of the same work.
+
+  6. Revised Versions of the GNU Lesser General Public License.
+
+  The Free Software Foundation may publish revised and/or new versions
+of the GNU Lesser General Public License from time to time. Such new
+versions will be similar in spirit to the present version, but may
+differ in detail to address new problems or concerns.
+
+  Each version is given a distinguishing version number. If the
+Library as you received it specifies that a certain numbered version
+of the GNU Lesser General Public License "or any later version"
+applies to it, you have the option of following the terms and
+conditions either of that published version or of any later version
+published by the Free Software Foundation. If the Library as you
+received it does not specify a version number of the GNU Lesser
+General Public License, you may choose any version of the GNU Lesser
+General Public License ever published by the Free Software Foundation.
+
+  If the Library as you received it specifies that a proxy can decide
+whether future versions of the GNU Lesser General Public License shall
+apply, that proxy's public statement of acceptance of any version is
+permanent authorization for you to choose that version for the
+Library.

Makefile

@@ -0,0 +1,40 @@
+# ffood - Fast Food - a Bash Library
+# See LICENSE file for copyright and license details.
+
+include config.mk
+
+all: options doc ffood
+
+options:
+	@echo ffood build options:
+	@echo "VERSION  = ${VERSION}"
+	@echo "PREFIX   = ${PREFIX}"
+
+doc:
+	@setup/mk.sh doc
+
+install_manpages: manpages
+	@setup/mk.sh install_manpages
+
+manpages:
+	@setup/mk.sh manpages
+
+ffood:
+	@setup/mk.sh ffood
+
+test: install
+	@setup/mk.sh test
+
+clean:
+	@setup/mk.sh clean
+
+dist: clean
+	@setup/mk.sh dist
+
+install: all
+	@setup/mk.sh install
+
+uninstall:
+	@setup/mk.sh uninstall
+
+.PHONY: all options clean dist install test uninstall

README

@@ -1,4 +1,20 @@
-QECC
-====
+Fast Food Bash library
+======================
 
-Quality Engineering Control Centre
+ffood - Fast Food - a Bash Library
+
+
+BUGS
+----
+
+  * *core.debug():* if `debug -v "x*:` is used, `x*` apparently tries to match
+    match *filenames* first, and only if there is no match, it goes on to
+    match variable names.  This does not seem to affect `@`, though.
+
+    Probably some eval pitfall.  For now I'll just remove `*`.  If somebody
+    can fix it, we can re-add it.
+
+    On the other hand, I don't even understand how `*` should exactly behave
+    compared to `@`, so having it disabled does not seem like such a loss.
+    And by the way, did you know that the eval is evil?  So in the end, maybe
+    we should not have this feature in the first place... :)

bin/fffun.in

@@ -0,0 +1,43 @@
+#!/bin/bash
+
+. __FFOOD_DIR__/ffood.sh
+
+ffood import core
+ffood import recon
+
+
+usage() {
+    usage_is "[-I|--include module] [--] function [args...]"
+}
+
+includes=""
+FFOOD_DEBUG=false
+
+while true; do
+    case $1 in
+        -d|--debug)
+            FFOOD_DEBUG=true
+            shift 1
+            ;;
+        -I|--include)
+            includes=$includes:$2
+            shift 2
+            ;;
+        "")
+            usage
+            ;;
+        --)
+            shift 1
+            break
+            ;;
+        *)
+            break;
+            ;;
+    esac;
+done
+
+for i in $(tr ":" " " <<<"$includes"); do
+    ffood import $i
+done
+
+"$@"

config.mk

@@ -0,0 +1,3 @@
+VERSION = 0.0.0
+PREFIX = /usr/local
+MANPREFIX = ${PREFIX}/share/man

doc/BUGS.md

@@ -0,0 +1,8 @@
+Bugs
+====
+
+*   debug_pipe and all `while read`-based commands will throw away
+    last line if there is no newline at the end.
+
+    This is "fixed" by adding at least one (possibly all-matching)
+    `grep` command before the while loop

doc/examples/template.sh.in

@@ -0,0 +1,8 @@
+#!/bin/bash
+
+. __FFOOD_DIR__/ffood.sh
+
+ffood import core
+
+FFOOD_VERBOSE=true
+FFOOD_DEBUG=true

doc/fffun.1.md

@@ -0,0 +1,13 @@
+FFFUN
+=====
+
+
+SYNOPSIS
+--------
+
+    fffun [-d] [-I module] function [args...]
+
+AUTHOR
+------
+
+Alois Mahdal

doc/ffood.3.md

@@ -0,0 +1,74 @@
+FFOOD
+=====
+
+SYNOPSIS
+--------
+
+    #!/bin/bash
+    # ~/bin/example
+    source /usr/share/lib/ffood/ffood.sh
+    ffood import core
+
+    # basic echo helpers
+    think "about saying something..."   # like echo if FFOOD_VERBOSE
+    warn "this is just an example"      # obvious :)
+    false || die "false was true!"      # Perlism :)
+    x=1; y=2; z=3
+    debug "x=$x" "y=$y" "z=$z"          # debug:example: x=1
+                                        # debug:example: y=2
+                                        # debug:example: z=3
+    debug -v x:y:z                      # short for above!
+    echo "hello" | debug_pipe mypipe    # debug:PIPE mypipe: hello
+
+    # more advanced functions
+    FFOOD_DATADIR=$HOME/.example
+    cat >$FFOOD_DATADIR/main.ini <<EOF
+    # a sample ini file
+    [mysection]
+        key = something
+        multiline = also possible
+        multiline = like this :)
+    [scripts]
+        s1 =#!/usr/bin/python
+        s1 =def main():
+        s1 =    print "will work!"
+    EOF
+    iniread -s mysection -k mykey main.ini  # prints "something"
+    iniread -S -k s1 > sample.py            # why section? with unique key...
+    python sample.py                        # "will work!" due to the -S
+
+    # even more
+    ffood import recon
+    wait_until -e ! test -e badfile         # -e means use eval (make "!" work)
+    think "the badfile is away..."
+    bad_file_away() {                       # but you can avoid eval
+        ! test -f badfile
+    }
+    wait_until bad_file_away
+
+    # ... and more
+    ffood import recon
+    register_artifact this_file_will_exist.log
+    some_important_program > this_file_will_exist.log
+    collect_artifacts                       # will preserve tree from /
+
+    # ...AND MORE!
+    ffood import sw
+    cat > dependencies.ini <<EOF
+    [needs/now]
+        yum = ronn
+        yum = vim
+        pypi = docopt
+    [needs/for_test]
+        cpan = Test::More
+    # yeah I made that up
+    EOF
+    iniread ./dependencies.ini | any_install
+
+
+
+
+AUTHOR
+------
+
+Alois Mahdal

ffood.sh.in

@@ -0,0 +1,38 @@
+#!/bin/bash
+
+FFOOD_DATA_DIR=${FFOOD_DATA_DIR:-$HOME/.ffood}
+FFOOD_ARTIFACTS_DIR=${FFOOD_ARTIFACTS_DIR:-artifacts}
+FFOOD_DEBUG=${FFOOD_DEBUG:-false}
+FFOOD_VERBOSE=${FFOOD_VERBOSE:-false}
+FFOOD_VERSION=__VERSION__
+
+die() {
+    echo "$@" >&2
+    exit 1
+}
+
+ffood() {
+    local ffood_dir="${FFOOD_DIR:-__FFOOD_DIR__}"
+    case $1 in
+        import)
+            if test -f "$ffood_dir/include/$2.sh";
+            then
+                . "$ffood_dir/include/$2.sh";
+                return $?
+            elif test -n "$FFOOD_INCLUDE" -a -f "$FFOOD_INCLUDE/$2.sh";
+            then
+                . "$FFOOD_INCLUDE/$2.sh"
+                return $?
+            elif test -f "./$2.sh";
+            then
+                . "./$2.sh"
+                return $?
+            else
+                die "cannot find library: $2"
+            fi
+            ;;
+        *)
+            die "unknown ffood command: $1"
+            ;;
+    esac
+}

include/core.sh

@@ -0,0 +1,323 @@
+#!/bin/bash
+
+debug() {
+    #
+    # You already know what it does.
+    #
+    # BTW, following are equivalent:
+    #
+    #     debug "var1=$var1" "var2=$var2" "result=$result"
+    #     debug -v var1:var2:result
+    #     debug -v "var@:result"
+    #
+    $FFOOD_DEBUG || return 0
+    if test "$1" == "-v";
+    then
+        local varnames="$2"
+        local vn
+        for vn in $(tr ":" " " <<<"$varnames");
+        do
+            local heel="${vn:0-1}"          # last char
+            local toes="${vn%%$heel}"       # all but last char
+            if test "$heel" == "@";
+            then
+                # FIXME: review+fix the eval (even at cost of dropping the feature)
+                local vars=$(eval "echo \"\${!$toes$heel}\"")
+                debug -v $(tr " " ":" <<<"$vars")
+            else
+                debug "$vn='$(echo -n ${!vn})'"
+            fi
+        done
+    elif test "$1" == "-t";
+    then
+        local -a tr=(${FUNCNAME[@]})
+        unset tr[0]; unset tr[1];
+        local tmp=$(echo "${tr[*]}" | tr '  ' '\n' | tac )
+        echo "== trace ==" >&2
+        echo "$tmp" | sed -e 's/^/-> /g' >&2
+    else
+        local me=${FUNCNAME[1]}
+        case $me in
+            main)       me=$(basename $0)       ;;
+            debug)      me="${FUNCNAME[2]}()"   ;;
+            debug_pipe) me="${FUNCNAME[2]}()"   ;;
+            *)          me="$me()"              ;;
+        esac
+        local l
+        for l in "$@";
+        do echo "debug:$me: $l" >&2
+        done
+    fi
+}
+
+debug_pipe() {
+    #
+    # Debug the whole pipe.
+    #
+    grep ".*" \
+        | while IFS= read line;
+          do
+              debug "PIPE $1: '$line'"
+              echo "$line"
+          done
+}
+
+die() {
+    #
+    # A Perl-style death (a truly honorable one that is)
+    #
+    debug -t
+    warn $*
+    exit 9
+}
+
+echo_hr() {
+    #
+    # Echo a horizontal ruler out of char "$1" all across terminal.
+    #
+    test 0$COLUMNS -gt 0 || return
+    local char="$1"
+    local i
+    for (( i=1; $i<$COLUMNS; i=$i+1 )); do echo -n "$char"; done
+    echo
+}
+
+mute_known() {
+    #
+    # Mute known messages
+    #
+    # For those yums and rpms that don't know theit manners.  Use with care!
+    #
+    grep -vxf <(iniread -s mute -k $1 mute.ini)
+}
+
+usage_is() {
+    #
+    # Echo out usage patterns and exit 1
+    #
+    # Define usage() in your script and use this in body
+    #
+    local me=$(basename $0)
+    local u
+    for u in "$@";
+    do echo "usage: $me $u"
+    done
+    exit 1
+}
+
+usagef() {
+    #
+    # Same as usage_is, but for functions.
+    #
+    # That means it does not exit and uses FUNCNAME, not $0
+    #
+    local u
+    for u in "$@";
+    do echo "usage: ${FUNCNAME[1]} $u"
+    done
+}
+
+think() {
+    #
+    # If verose is on, think loud.
+    #
+    $FFOOD_VERBOSE && echo "$@"
+}
+
+warn() {
+    #
+    # Warn them
+    #
+    # Resist  temptation to prefix "warning" or similar BS here.
+    # STDERR is *made* for warnings.
+    #
+    echo "$*" >&2
+}
+
+append_if_missing() {
+    #
+    # Append line to the file but only if it's not already there.
+    #
+    # Handy for your fstabs, or whatever line-based confs Handy for your fstabs, or whatever line-based confs
+    #
+    local line=$1
+    local file=$2
+    grep -qsx "$line" $file || echo "$line" >> $file
+}
+
+collapse_tilde() {
+    #
+    # Exchange home back to "~".
+    #
+    # Nice to save them users from some eye pain.
+    #
+    perl -pe "s|^$HOME|~|"
+}
+
+expand_tilde() {
+    #
+    # Exchange "~" for home.
+    #
+    perl -pe "s|^[[:space:]]*~|$HOME|"
+}
+
+__iniread__cat() {
+    # cat without starting a process
+    while IFS= read line;
+    do echo "$line"; done
+}
+
+__iniread__flt_comments() {
+    grep -v -e "^[[:space:]]*[#;]" -e "^[[:space:]]*$"
+}
+
+__iniread__flt_key() {
+    # filter values from key=value pair
+    local line
+    local key
+    local value
+    while IFS= read line;
+    do
+        line=$(sed -re 's/^\s*//' <<<"$line")
+        key=$(sed -re 's/\s*=.*//; s/^\s*//' <<<"$line")
+        if $strict;
+        then
+            value=$(sed -re 's/[^=]*=//' <<<"$line")
+        else
+            value=$(sed -re 's/[^=]*=\s*//' <<<"$line")
+        fi
+        if test "$key" = "$wantkey";
+        then
+            echo "$value"
+        fi
+    done
+}
+
+__iniread__flt_section() {
+    # filter per section
+    local section_ok=false
+    local line
+    while IFS= read line;
+    do
+        if grep -qse "^\[$wantsection\]" <<<"$line";
+        then
+            section_ok=true
+        elif grep -qse "^\[" <<<"$line";
+        then
+            section_ok=false
+        elif $section_ok;
+        then
+            $strict || line="$(sed -re 's/^\s*//' <<<"$line")"
+            echo "$line"
+        fi
+    done
+}
+
+__iniread__merge() {
+    local spec="$1"
+    local file=""
+    local dirs="/etc/ffood $HOME/.ffood"
+    local p
+    case $spec in
+        -|*/*)          # stdin, or path (with slash)
+            cat "$spec"
+            ;;
+        "")             # name not given
+            for p in $dirs;
+            do
+                debug -v p
+                cat $p/ffood.ini 2>/dev/null
+            done
+            cat .ffood.ini 2>/dev/null
+            ;;
+        *)              # name given
+            for p in $dirs;
+            do
+                debug -v p
+                cat $p/$spec 2>/dev/null
+            done
+            ;;
+    esac
+    true
+}
+
+iniread() {
+    #
+    # A flexible (not just) .ini file reader
+    #
+    # Can read anything from commented plaintext to keyless section INI,
+    # sectionless keyed INI or sectioned keyed INI, including multi-line
+    # and whitespace-safe chunks.
+    #
+    # Is constantly becoming smarter and smarter.
+    #
+    local file="-"
+    local wantsection=""
+    local wantkey=""
+    local strict=false
+    local section_ok=true
+    local one_line=false
+    while true;
+    do
+        case $1 in
+            -1|--one-line)
+                one_line=true
+                shift 1
+                ;;
+            -k|--key)
+                wantkey="$2"
+                shift 2
+                ;;
+            -p|--path)
+                wantkey="$(echo $2 | rev | cut -d. -f1 | rev)"
+                wantsection="${2%.$wantkey}"
+                shift 2
+                ;;
+            -s|--section)
+                wantsection="$2"
+                section_ok=false
+                shift 2
+                ;;
+            -S|--strict)
+                strict=true
+                shift 1
+                ;;
+            -l|--list-sections)
+                #TODO: list sections
+                warn "--list-sections is not implemented"
+                shift
+                ;;
+            -L|--list-keys)
+                #TODO: list keys as section/key (with -s, list keys only)
+                warn "--list-keys is not implemented"
+                shift
+                ;;
+            --)
+                file=$2
+                break
+                ;;
+            "")
+                break
+                ;;
+            *)
+                file=$1
+                break
+                ;;
+        esac
+    done
+
+    flt_section=__iniread__cat
+    flt_key=__iniread__cat
+    limit_line=__iniread__cat
+    test -n "$wantsection" && flt_section=__iniread__flt_section
+    test -n "$wantkey" && flt_key=__iniread__flt_key
+    $one_line && limit_line="head -1"
+
+    debug -v file:wantkey:wantsection
+
+    __iniread__merge $file \
+        | __iniread__flt_comments \
+        | $flt_section \
+        | $flt_key \
+        | $limit_line
+}

include/proj_ol.sh

@@ -0,0 +1,86 @@
+#!/bin/bash
+
+ffood import core
+ffood import recon
+ffood import testing
+ffood import yummy
+
+
+OLCS_RUNHOW=$(iniread -s run.how proj-ol.ini)
+OLCS_VGLOG="cimserver-valgrind.log"
+OLCS_VG="valgrind --trace-children=yes --log-file=$OLCS_VGLOG"
+OLCS_GDBFIFO="/tmp/gdbfifo.$$"
+
+disable_pam_for() {
+    echo "disabling PAM for $1"
+    sed -i -e 's/^[^#].* pam_/# \0/' /etc/pam.d/$1
+}
+
+start_cimserver() {
+    local cmd="cimserver"
+    local args="daemon=false"
+    local out="cimserver.out"
+    local err="cimserver.err"
+    register_artifact "$out" "$err"
+    case $OLCS_RUNHOW in
+        simple)
+            $cmd $args > $out 2>$err &
+            ;;
+        service)
+            systemctl start tog-pegasus
+            ;;
+        gdb)
+            yum_install_if_needed gdb
+            rm -f $OLCS_GDBFIFO
+            mkfifo $OLCS_GDBFIFO
+            gdb cimserver 2>$err < $OLCS_GDBFIFO | tee $out &
+            echo  "run $args" > $OLCS_GDBFIFO
+            ;;
+        valgrind)
+            yum_install_if_needed valgrind
+            disable_pam_for wbem
+            chmod -s /usr/sbin/unix_chkpwd
+            register_artifact "$OLCS_VGLOG"
+            $OLCS_VG $cmd $args > $out 2>$err &
+            ;;
+    esac
+    wait_until -t 20 port_listening 5989
+}
+
+stop_cimserver() {
+    echo "stopping cimserver"
+    case $OLCS_RUNHOW in
+        simple)
+            killall cimserver
+            ;;
+        service)
+            systemctl stop tog-pegasus
+            ;;
+        gdb)
+            killall cimserver
+            echo bt > $OLCS_GDBFIFO
+            echo quit > $OLCS_GDBFIFO
+            echo y > $OLCS_GDBFIFO
+            rm -f $OLCS_GDBFIFO
+            ;;
+        valgrind)
+            killall -r ^memcheck-
+            ;;
+    esac
+    wait_until -t 20 -e ! pids_matching cimserver,^memcheck-
+}
+
+comment_cimserver() {
+    case $OLCS_RUNHOW in
+        simple)
+            echo "as a separate process"
+            ;;
+        service)
+            echo "as a service"
+            ;;
+        gdb|valgrind)
+            echo "under $OLCS_RUNHOW"
+            ;;
+    esac
+}
+

include/recon.sh

@@ -0,0 +1,193 @@
+#!/bin/bash
+
+ffood import core
+
+
+age_of_leaf() {
+    local now=$1
+    sed 's/.*/"&"/' \
+        | xargs stat -c %Z \
+        | while read ctime;
+          do echo $(($now - $ctime));
+          done
+}
+
+age_of_tree() {
+    local now=$(date +%s)
+    find -L "$1" \
+        | age_of_leaf $now \
+        | sort -n \
+        | head -1
+}
+
+cat_uri() {
+    wget -q $1 -O - || echo "ERROR: $?" >&2
+}
+
+filter() {
+    local silent
+    while true; do case $1 in
+        -s|--silent) silent=true; shift ;;
+        *) break ;;
+    esac done
+    debug "\$*=$*"
+    while read item;
+    do
+        if $* $item;
+        then
+            echo "$item"
+        fi
+    done
+}
+
+pids_matching() {
+    local all_pids=""
+    local pids=""
+    local pfx=""
+    local pattern
+    for pattern in "$@";
+    do
+        local pids=$(ps -e -o pid= -o comm= \
+                     | grep $pattern \
+                     | sed -e 's/^ *//' \
+                     | cut -d\  -f 1 \
+                     | tr "\n" " ")
+        debug -v pattern:pids
+        all_pids="$all_pids$pfx$pids"
+        pfx=" "
+    done
+    debug -v all_pids
+    echo $all_pids
+    test -n "$all_pids"
+}
+
+port_listening() {
+    local host="localhost"
+    local port="$1"
+    debug -v host:port
+    test -n "$port" || usagef "PORT"
+    netstat -ntlp \
+        | sed -e 's/  */ /g' \
+        | cut -d\  -f 4 \
+        | grep -qs :$port\$
+}
+
+reachable_by_ping() {
+    local host=$1
+    debug -v host
+    test -n "$host" || usagef "HOST"
+    ping -w 1 $host >& /dev/null
+}
+
+reachable_by_ssh() {
+    local host=$1
+    debug -v host
+    test -n "$host" || usagef "HOST"
+    ssh -n -o ConnectTimeout=3 $host -- true >/dev/null 2>&1;
+}
+
+reachable_by_tcp() {
+    local port=$1
+    local host=$2
+    debug -v port:host
+    test -n "$host" -a -n "$port" || usagef "PORT HOST"
+    nc -w 1 $host $port >/dev/null 2>&1;
+}
+
+filter_hosts() {
+    local do_ping=true
+    local do_ssh=false
+    local do_tcp=false
+    local tcp_port=0
+
+    while true;
+    do
+        case $1 in
+            -t|--tcp)
+                do_tcp=true
+                tcp_port=$2
+                shift 2
+                ;;
+            -p|--ping)
+                do_ping=true
+                shift 1
+                ;;
+            -P|--no-ping)
+                do_ping=false
+                shift 1
+                ;;
+            -s|--ssh)
+                do_ssh=true
+                shift 1
+                ;;
+            -S|--no-ssh)
+                do_ssh=false
+                shift 1
+                ;;
+            "")
+                break
+                ;;
+            *)
+                usagef "[-p|P] [-s|-S] [-t port]"
+                return 2
+                ;;
+        esac
+    done
+
+    local ping_fun=true
+    local ssh_fun=true
+    local tcp_fun=true
+    $do_ping    && ping_fun="reachable_by_ping"
+    $do_tcp     && tcp_fun="reachable_by_tcp $tcp_port"
+    $do_ssh     && ssh_fun="reachable_by_ssh"
+    filter $ping_fun | filter $tcp_fun | filter $ssh_fun
+}
+
+sort_paths_by_age() {
+    while read path;
+    do echo "$(age_of_tree $path) $path"
+    done \
+      | sort -n \
+      | cut -d\  -f 2-
+}
+
+wait_until() {
+    local timeout=10
+    local delay=1
+    local use_eval=false
+    while true; do case "$1" in
+        -e) use_eval=true; shift; break ;;
+        -d) delay="$2"; shift 2;        ;;
+        -t) timeout="$2"; shift 2;      ;;
+        --) shift 1; break;             ;;
+        *)  break;                      ;;
+    esac done
+    think "waiting for: $@"
+    local elapsed=0
+    local start=$(date +%s)
+    while true;
+    do
+        sleep $delay
+        local now=$(date +%s)
+        local elapsed=$(($now - $start))
+        local rv=0
+        if $use_eval;
+        then
+            eval $@;
+            rv=$?
+        else
+            $@;
+            rv=$?
+        fi
+        if [ $rv -eq 0 ];
+        then
+            return 0;
+        fi
+        if test $elapsed -gt $timeout;
+        then
+            warn "timeout reached when waiting: $elapsed > $timeout"
+            return 1
+        fi
+        think "waiting for another $delay s"
+    done
+}

include/sw.sh

@@ -0,0 +1,32 @@
+#!/bin/bash
+
+ffood import core
+ffood import yummy
+
+any_install() {
+    local tool pkg
+    sed -e 's/^\s*//; s/\s*=\s*/=/;' \
+      | while read line;
+        do
+            tool=$(cut -d= -f1 <<<"$line")
+            pkg=$(cut -d= -f2 <<<"$line")
+            debug -v line:tool:pkg
+            think "installing $pkg"
+            case $tool in
+                cpan)
+                    yum_install_if_needed perl-CPAN
+                    cpan $pkg
+                    ;;
+                pypi)
+                    yum_install_if_needed python-setuptools
+                    easy_install -q $pkg
+                    ;;
+                yum)
+                    yum_install_if_needed $pkg
+                    ;;
+                *)
+                    warn "unsupported tool: $tool"
+                    ;;
+            esac
+        done
+}

include/testing.sh

@@ -0,0 +1,30 @@
+#!/bin/bash
+
+ffood import core
+
+FFOOD_ARTIFACTS_DIR=artifacts
+
+collect_artifacts() {
+    test -f $TMP_DIR/artifact_list || return 0
+    local tgt
+    echo "collecting artifacts to $FFOOD_ARTIFACTS_DIR"
+    cat $TMP_DIR/artifact_list \
+        | while read path;
+          do
+              tgt=$FFOOD_ARTIFACTS_DIR/$(dirname $path)
+              mkdir -p $tgt
+              cp -r "$path" "$tgt"
+          done
+}
+
+register_artifact() {
+    local list=$TMP_DIR/artifact_list
+    local a
+    for a in "$@";
+    do
+        local dn=$(cd $(dirname $a); pwd)
+        test "$dn" = "/" && dn=""   # hack: avoid "//" if path was abs
+        local abspath="$dn/$(basename $a)"
+        append_if_missing  "$abspath" $list
+    done
+}

include/www.sh

@@ -0,0 +1,95 @@
+#!/bin/bash
+
+ffood import core
+
+filter_ids() {
+    #
+    # Hack doer-like id's (ID#123) out of the text.
+    #
+    tr ' ' '\n' \
+      | perl -ne '
+            next unless m/\b([a-zA-Z]{2,}#\d+)\b/;
+            print "$1\n";
+        ' \
+      | debug_pipe id_lookalikes
+}
+
+filter_kws() {
+    #
+    # Hack out lines that look like kw expressions.
+    #
+    local kwbase="[a-z][a-z0-9]*"
+    grep -e "^$kwbase " -e "^$kwbase\$" \
+        | debug_pipe kw_lookalikes
+}
+
+filter_uris() {
+    #
+    # Hack URIs out of the text.
+    #
+    tr ' ' '\n' \
+      | perl -ne '
+            next unless m|(\bhttps?://[[:alnum:]_:/.?&%=-]+)\b|;
+            print "$1\n";
+        ' \
+      | debug_pipe uri_lookalikes
+}
+
+find_uri() {
+    #
+    # Scan stdin for what looks like URI, ID or keyword
+    #
+    # Output URIS: first what were apparent uris, then IDs converted to
+    # URIs, then things that looked like kw expressions, converted to
+    # URIs.
+    #
+    # Apply this filter to args or clipboard, and either use head -1 or
+    # if you are brave, open all URIs.
+    #
+    local d=$(mktemp -d)
+    pushd $d >&/dev/null
+        ##
+        # heat up and fill pipes
+        #
+        mkfifo maybe_uris maybe_ids maybe_kws \
+               uris uris_from_ids uris_from_kws
+        tee maybe_uris | tee maybe_ids | tee maybe_kws | cat >/dev/null &
+        ##
+        # process each pipe *async* by different filter
+        #
+        cat maybe_uris | filter_uris                       > uris &
+        cat maybe_ids  | filter_ids  | tr '#' ' ' | kw2uri > uris_from_ids &
+        cat maybe_kws  | filter_kws  | kw2uri              > uris_from_kws &
+        ##
+        # print result *sync* in correct order
+        #
+        cat uris
+        cat uris_from_ids
+        cat uris_from_kws
+    popd >&/dev/null
+    rm -rf $d
+}
+
+kw2uri() {
+    #
+    # Turn keyword or query (like "g hello" for google) to URI
+    #
+    local line
+    declare -l line
+    while read line;
+    do
+        line="$line "
+        local kw=${line%% *}
+        local query=${line#$kw }
+        debug -v kw:query
+        if test -n "$query";
+        then
+            local fmt=$(iniread -1 -p www.query.$kw www.ini)
+            debug -v fmt
+            printf "$fmt\n" "$query"
+        else
+            iniread -1 -p www.bookmark.$kw www.ini
+        fi
+    done
+}
+

include/xorg.sh

@@ -0,0 +1,9 @@
+#!/bin/bash
+
+ffood import core
+
+clipln() {
+    xclip -o -selection primary 2>/dev/null
+    echo ""
+}
+

include/yummy.sh

@@ -0,0 +1,107 @@
+#!/bin/bash
+
+guess_pkgnames() {
+    # guess interesting names from folder of RPMs
+    ls "$1" \
+      | grep rpm\$ \
+      | sed -e 's/-[0-9].*$//' \
+      | sort \
+      | uniq
+}
+
+guess_rtag() {
+    uname -r | sed -e 's/^[.0-9-]*//; s/\..*$//'
+}
+
+guess_rtagn() {
+    echo $(guess_rtag) | sed -e 's/[0-9]*$//'
+}
+
+installed_versions() {
+    # for every prefix print installed versions
+    cat - \
+        | while read name;
+          do rpm -qa "$name*";
+          done \
+            | sort \
+            | uniq
+}
+
+nvc_parse() {
+    local what="$1"
+    local nvc="$2"
+    test -n "$2" || warn "usage: nvc_parse WHAT NVC"
+    local arch="${nvc##*.}"
+    local rest="${nvc%%.$arch}"
+    local release="${rest##*-}"
+    local rest="${rest%%-$release}"
+    local version="${rest##*-}"
+    local name="${rest%-*}"
+    case $what in
+        arch)
+            echo $arch
+            ;;
+        release)
+            echo $release
+            ;;
+        version)
+            echo $version
+            ;;
+        name)
+            echo $name
+            ;;
+        *)
+            warn "WHAT = [arch|release|version|name]"
+            return 1
+    esac
+}
+
+save_repo_for() {
+    local target=$1
+    local rtagn=$(guess_rtagn)
+    local uri=$(iniread -s $rtagn -k $target repo_uris.ini)
+    think "adding repo for $target"
+    debug -v target:rtagn:uri
+    case "$uri" in
+        INCLUDED)
+            ;;
+        NONE)
+            warn "no repo available for $target"
+            return 1
+            ;;
+        *)
+            pushd /etc/yum.repos.d/ >/dev/null
+            wget -q "$uri"
+            popd >/dev/null
+            ;;
+    esac
+}
+
+yum_preerase() {
+    # read package names from stdin and pre-erase them
+    cat - \
+        | while read pkgname;
+          do
+              if rpm -q "$pkgname" 2>/dev/null 1>&2;
+              then
+                  echo "pre-erasing $pkgname"
+                  yum -q -y erase "$pkgname"
+              fi
+          done
+}
+
+yum_install() {
+    yum -q -y install "$@" 2>&1 | mute_known yum
+}
+
+yum_install_if_needed() {
+    local pkg
+    for pkg in "$@";
+    do
+        rpm -q $pkg >& /dev/null || yum_install $pkg;
+    done
+}
+
+yum_update() {
+    yum -q -y update "$@" 2>&1 | mute_known yum
+}

notes/BUGS.md

@@ -0,0 +1,10 @@
+BUGS
+====
+
+  * iniread: when same key is found in e.g. /etc/ffood.ffood.ini
+    and ~/.ffood.ffood.ini, output is concatenated.  If you want
+    the value be rather overriden, you can simply add `-1` to
+    limit output to the last one but that obviously won't work
+    for multi-line values.
+
+    It's not yet decided what should be the behavior.

notes/guidelines.md

@@ -0,0 +1,52 @@
+
+UI
+--
+
+*   Heavily prefer unix filter UI.
+
+    If you can't do it with filtering, it could mean you should split your
+    function anyway.
+
+*   Even function can use dash options and even `usagef()`.
+
+*   Reserved options are
+
+     *  `-q|--quiet`, to turn off verbosity,
+     *  `-v|--verbose`, to turn on verbosity,
+     *  and `-d|--debug` to turn on debug output (stderr).
+
+*   Do not `think()` in functions.
+
+*   Preferred capitalization in messages is:
+
+    *   all small for libs (debug/warn/die)
+
+    *   First cap for scripts
+
+*   Message width:
+
+    *   think/warn/die: try hard to never exceed 72
+
+    *   debug: do what you must
+
+    *   always try to split message to fixed part, colon and  *before* colon and
+        the "data" part after the colon, e.g.:
+
+            file missing: /var/run/media/somebody/some-medium/some-long/path
+
+        instead of:
+
+            file /var/run/media/somebody/some-medium/some-long/path is missing
+
+        (even if you think that it will be short)
+
+
+
+
+PRINCIPLES
+----------
+
+Be smart but honest: if you can default, default, otherwise be honest = fail
+
+Don't talk.  `think()` instead.
+

setup/mk.sh

@@ -0,0 +1,121 @@
+#!/bin/bash
+# ffood - Fast Food - a Bash Library
+# See LICENSE file for copyright and license details.
+
+tmp=$(mktemp)
+sed -e 's/ = /=/' < config.mk > $tmp
+. $tmp
+rm -f $tmp
+
+bindir=${DESTDIR}${PREFIX}/bin
+mandir=${DESTDIR}${MANPREFIX}
+docdir=${DESTDIR}${PREFIX}/share/doc/ffood
+shrdir=${DESTDIR}${PREFIX}/share/ffood
+
+list_of_bins() {
+    echo bin/fffun
+}
+
+list_of_installed_bins() {
+    list_of_bins | sed -e "s/bin/$(sed -e 's/\//\\\//g' <<<$bindir)/"
+}
+
+list_of_docs() {
+    echo doc/fffun.1.md
+    echo doc/ffood.3.md
+}
+
+list_of_shrs() {
+    echo ffood.sh
+    echo include
+}
+
+clean() {
+    test -f built.list && {
+        cat built.list | xargs rm -f
+        rm -f built.list
+    } || :
+}
+
+dist() {
+    local dirname=ffood-${VERSION}
+    mkdir -p $dirname
+    cp -R   bin \
+            config.mk \
+            doc \
+            include \
+            Makefile \
+            ffood.sh.in \
+            README \
+            LICENSE \
+            setup \
+            test \
+            $dirname
+    tar -cf $dirname.tar $dirname
+    gzip $dirname.tar
+    rm -rf $dirname
+    echo $dirname.tar.gz >> built.list
+}
+
+install() {
+    mkdir -p $bindir \
+             $docdir \
+             $shrdir
+    list_of_bins | xargs cp -vrt $bindir
+    list_of_docs | xargs cp -vrt $docdir
+    list_of_shrs | xargs cp -vrt $shrdir
+    list_of_installed_bins | xargs chmod 755
+    test -f .autoclean && clean || :
+}
+
+manpages() {
+    ronn -r doc/*.[1-9].md
+    ls doc/*.[1-9] >> built.list
+}
+
+install_manpages() {
+    cp -vr doc/*.1 $mandir/man1
+    cp -vr doc/*.3 $mandir/man3
+    test -f .autoclean && clean || :
+}
+
+ffood() {
+    local srcpath dstpath
+    find -type f -name '*.in' \
+        | while read srcpath;
+          do
+              dstpath=${srcpath%.in}
+              perl -pe "s|__FFOOD_DIR__|$shrdir|;
+                        s|__VERSION__|$VERSION|;" < $srcpath > $dstpath
+              echo $dstpath >> built.list
+          done
+}
+
+run_test() {
+    pushd test
+    find -maxdepth 1 -type f \! -name '*.in' | while read test;
+    do
+        chmod 0755 $test
+        $test || exit $?
+    done
+    popd
+}
+
+uninstall() {
+    list_of_installed_bins | xargs rm -f
+    rm -rf $shrdir/ffood
+    rm -rf $docdir/ffood
+    rm -f $mandir/man1/fffun.1
+    rm -f $mandir/man3/ffood.3
+}
+
+case $1 in
+    clean|dist|install|install_manpages|manpages|ffood|uninstall)
+        $1
+        ;;
+    test)
+        run_test
+        ;;
+    *)
+        echo "usage: $(basename $0) clean|dist|install|ffood|test|uninstall" >&2
+esac

test/data/iniread/oracle1

@@ -0,0 +1,2 @@
+hello
+hello1

test/data/iniread/oracle10

@@ -0,0 +1,2 @@
+someThing
+also=someThing

test/data/iniread/oracle11

@@ -0,0 +1,3 @@
+things.that
+things.this
+words.this

test/data/iniread/oracle12

@@ -0,0 +1,2 @@
+things
+words

test/data/iniread/oracle13

@@ -0,0 +1,2 @@
+that
+this

test/data/iniread/oracle2

@@ -0,0 +1,3 @@
+box
+cat
+man

test/data/iniread/oracle3

@@ -0,0 +1,2 @@
+something
+also=something

test/data/iniread/oracle4

@@ -0,0 +1,2 @@
+someThing
+also=someThing

test/data/iniread/oracle5

@@ -0,0 +1,2 @@
+someThing
+also=someThing

test/data/iniread/oracle7

@@ -0,0 +1,15 @@
+#!/usr/bin/python
+
+
+class Myclass(object):
+
+    def __init__(self, status="OK"):
+        self.status = status
+
+    def check(self):
+        print "I guess I'm %s" % self.status
+
+
+if __name__ == "__main__":
+    c = Myclass()
+    c.check()

test/data/iniread/oracle8

@@ -0,0 +1,15 @@
+#!/usr/bin/python
+
+
+class Myclass(object):
+
+	def __init__(self, status="OK"):
+		self.status = status
+
+	def check(self):
+		print "I guess I'm %s" % self.status
+
+
+if __name__ == "__main__":
+	c = Myclass()
+	c.check()

test/data/iniread/oracle9

@@ -0,0 +1,5 @@
+[funny things
+or=other[funny[things
+here in the middle of
+sed]ction
+=before

test/data/iniread/test1

@@ -0,0 +1,3 @@
+# plain # --
+hello
+hello1

test/data/iniread/test10

@@ -0,0 +1,12 @@
+# path # -p things.this
+[things]
+nothing
+this=someThing
+this=also=someThing
+that=nothing
+that=also=nothing
+[words]
+word
+this=curseword
+this=bad=word
+another word

test/data/iniread/test11

@@ -0,0 +1,12 @@
+# list paths # -L paths
+[things]
+nothing
+this=someThing
+this=also=someThing
+that=nothing
+that=also=nothing
+[words]
+word
+this=curseword
+this=bad=word
+another word

test/data/iniread/test12

@@ -0,0 +1,12 @@
+# list sections # -L sections
+[things]
+nothing
+this=someThing
+this=also=someThing
+that=nothing
+that=also=nothing
+[words]
+word
+this=curseword
+this=bad=word
+another word

test/data/iniread/test13

@@ -0,0 +1,12 @@
+# list keys # -L keys
+[things]
+nothing
+this=someThing
+this=also=someThing
+that=nothing
+that=also=nothing
+[words]
+word
+this=curseword
+this=bad=word
+another word

test/data/iniread/test2

@@ -0,0 +1,12 @@
+# sections only # -s words
+[greetings]
+hello
+hello1
+[words]
+box
+cat
+man
+[sword]
+short
+long
+broad

test/data/iniread/test3

@@ -0,0 +1,6 @@
+# keys only # -k this
+nothing
+this=something
+this=also=something
+that=nothing
+that=also=nothing

test/data/iniread/test4

@@ -0,0 +1,12 @@
+# both keys and sections # -s things -k this
+[things]
+nothing
+this=someThing
+this=also=someThing
+that=nothing
+that=also=nothing
+[words]
+word
+this=curseword
+this=bad=word
+another word

test/data/iniread/test5

@@ -0,0 +1,12 @@
+# keys, sections and spaces # -s things -k this
+[things]
+    nothing
+	this=someThing
+    this=also=someThing
+	that=nothing
+    that=also=nothing
+[words]
+    word
+	this=curseword
+	this=bad=word
+	another word

test/data/iniread/test7

@@ -0,0 +1,17 @@
+# tricks with strict and script # -S -s needs_strict -k py
+[needs_strict]
+py =#!/usr/bin/python
+py =
+py =
+py =class Myclass(object):
+py =
+py =    def __init__(self, status="OK"):
+py =        self.status = status
+py =
+py =    def check(self):
+py =        print "I guess I'm %s" % self.status
+py =
+py =
+py =if __name__ == "__main__":
+py =    c = Myclass()
+py =    c.check()

test/data/iniread/test8

@@ -0,0 +1,17 @@
+# tricks with strict and script # -S -s needs_strict -k py
+[needs_strict]
+py =#!/usr/bin/python
+py =
+py =
+py =class Myclass(object):
+py =
+py =	def __init__(self, status="OK"):
+py =		self.status = status
+py =
+py =	def check(self):
+py =		print "I guess I'm %s" % self.status
+py =
+py =
+py =if __name__ == "__main__":
+py =	c = Myclass()
+py =	c.check()

test/data/iniread/test9

@@ -0,0 +1,12 @@
+# tricks with strict and script # -s "funny/ in"
+[funny/ in]
+    [funny things
+    or=other[funny[things
+    here in the middle of
+    sed]ction
+=before
+[other section]
+which is
+not
+ [funny/ in]
+    but other 

test/iniread.in

@@ -0,0 +1,40 @@
+#!/bin/bash
+
+. /usr/share/beakerlib/beakerlib.sh
+
+. __FFOOD_DIR__/qecc.sh
+ffood import core
+
+
+do_test() {
+    local n=$1
+    local head=$(cat "test$n" | head -1 | sed -e 's/\s*#\s*/#/g')
+    local name=$(cut -d\# -f 2 <<<"$head")
+    local args=$(cut -d\# -f 3 <<<"$head")
+    rlPhaseStartTest "$name"
+        rlRun "iniread $args < test$n > result$n"
+        rlRun "diff -u oracle$n result$n"
+        rlGetPhaseState || rlLogInfo "cat test$n"
+    rlPhaseEnd
+}
+
+
+rlJournalStart
+
+    rlPhaseStartSetup
+        tmp=$(mktemp -d)
+        cp $(dirname $0)/data/iniread/* $tmp
+        pushd $tmp
+    rlPhaseEnd
+
+    for n in $(seq 1 13);
+    do
+        do_test $n
+    done
+
+    rlPhaseStartCleanup
+        popd
+        rm -rf $tmp
+    rlPhaseEnd
+
+rlJournalEnd

test/test_iniread.py

@@ -0,0 +1,66 @@
+#!/usr/bin/python
+
+import operator
+import subprocess
+import unittest
+
+from sznqalibs import hoover
+
+
+class PyinireadDriver(hoover.BaseTestDriver):
+
+    def _get_data(self):
+        out = ""
+        with open(self._args['file']) as fh:
+            for x in fh.readlines():
+                if not x.startswith("#"):
+                    out += x
+        self.data['stdout'] = out
+
+
+class InireadDriver(hoover.BaseTestDriver):
+
+    plain_args = ['file']
+    params = ['-k', '-s']
+    switches = ['-d', '-1']
+
+    def _get_data(self):
+        args = ['fffun', 'iniread']
+        for key in self._args['order'].split(','):
+            value = self._args[key]
+            if key in self.switches:
+                if value:
+                    args.append(key)
+            elif key in self.params:
+                if value is not None:
+                    args += [key, value]
+            else:
+                if value is not None:
+                    args.append(value)
+        self.data['stdout'] = subprocess.check_output(args)
+
+
+class TestCase(unittest.TestCase):
+
+    def setUp(self):
+        self.driver_class = InireadDriver
+
+    def test_simple(self):
+        argsrc = hoover.Cartman({
+            'order': ['-k,-s,file', '-s,-k,file'],
+            '-k': ['somekey', None, ''],
+            '-s': ['somesection', None, ''],
+            'file': './data/iniread/test1',
+        }, {
+            'order': hoover.Cartman.Iterable,
+            '-k': hoover.Cartman.Iterable,
+            '-s': hoover.Cartman.Iterable,
+            'file': hoover.Cartman.Scalar,
+        })
+        tests = [(operator.eq, InireadDriver, PyinireadDriver)]
+        tracker = hoover.regression_test(argsrc, tests)
+        self.assertFalse(tracker.errors_found(), tracker.format_report())
+
+
+if __name__ == '__main__':
+    unittest.main()