freebsd-src/contrib/kyua
Igor Ostapenko 99689201a1 kyua: Do not count skipped as passed in test cmd
It changes output of 'kyua test' CLI command only. Hence, other outputs
like junit are kept intact for CI and other use cases. It's meant to
improve UX of attended use cases.

The issue is that the following can be tricky to interpret:

  222/222 passed (0 failed)

It can be read as all tests are passed, but it might be a summary line
of all tests skipped due to some requirement is not met.

It's reworked to easily distinguish such cases:

  222/222 passed (0 broken, 0 failed, 0 skipped)
  0/222 passed (0 broken, 0 failed, 222 skipped)

The overall formula is:

  <actually passed>/<total> (<details about not actually passed ones>)

Suggested by:	kp
Reviewed by:	ngie, markj
Approved by:	markj (mentor)
Differential Revision:	https://reviews.freebsd.org/D46653
2024-10-05 10:22:22 +00:00
..
admin contrib/kyua: Merge vendor import 2024-01-18 17:26:13 +01:00
bootstrap
cli kyua: Do not count skipped as passed in test cmd 2024-10-05 10:22:22 +00:00
doc kyua: Add FreeBSD Jail execution environment support 2024-07-18 09:18:28 -04:00
drivers kyua: Add FreeBSD Jail execution environment support 2024-07-18 09:18:28 -04:00
engine kyua: fix gcc builds 2024-07-20 00:28:06 +01:00
examples kyua: Add FreeBSD Jail execution environment support 2024-07-18 09:18:28 -04:00
integration kyua: Do not count skipped as passed in test cmd 2024-10-05 10:22:22 +00:00
m4
misc
model kyua: Do not count skipped as passed in test cmd 2024-10-05 10:22:22 +00:00
os/freebsd kyua: Add FreeBSD Jail execution environment support 2024-07-18 09:18:28 -04:00
store
utils kyua: Add FreeBSD Jail execution environment support 2024-07-18 09:18:28 -04:00
.cirrus.yml contrib/kyua: Merge vendor import 2024-01-18 17:26:13 +01:00
.gitignore
.travis.yml
AUTHORS kyua: Add FreeBSD Jail execution environment support 2024-07-18 09:18:28 -04:00
configure.ac
CONTRIBUTING.md
CONTRIBUTORS
Doxyfile.in
INSTALL.md
Kyuafile
LICENSE
main.cpp kyua: Add FreeBSD Jail execution environment support 2024-07-18 09:18:28 -04:00
Makefile.am
NEWS.md
README.md

Welcome to the Kyua project!

Kyua is a testing framework for infrastructure software, originally designed to equip BSD-based operating systems with a test suite. This means that Kyua is lightweight and simple, and that Kyua integrates well with various build systems and continuous integration frameworks.

Kyua features an expressive test suite definition language, a safe runtime engine for test suites and a powerful report generation engine.

Kyua is for both developers and users, from the developer applying a simple fix to a library to the system administrator deploying a new release on a production machine.

Kyua is able to execute test programs written with a plethora of testing libraries and languages. The library of choice is ATF, for which Kyua was originally designed, but simple, framework-less test programs and TAP-compliant test programs can also be executed through Kyua.

Kyua is licensed under a liberal BSD 3-clause license. This is not an official Google product.

Read more about Kyua in the About wiki page.

Download

The latest version of Kyua is 0.13 and was released on August 26th, 2016.

Download: kyua-0.13.

See the release notes for information about the changes in this and all previous releases.

Installation

You are encouraged to install binary packages for your operating system wherever available:

  • Fedora 20 and above: install the kyua-cli package with yum install kyua-cli.

  • FreeBSD 10.0 and above: install the kyua package with pkg install kyua.

  • NetBSD with pkgsrc: install the pkgsrc/devel/kyua package.

  • OpenBSD with packages: install the kyua package with pkg_add kyua.

  • OS X (with Homebrew): install the kyua package with brew install kyua.

Should you want to build and install Kyua from the source tree provided here, follow the instructions in the INSTALL.md file.

You should also install the ATF libraries to assist in the development of test programs. To that end, see the ATF project page.

Contributing

Want to contribute? Great! But please first read the guidelines provided in CONTRIBUTING.md.

If you are curious about who made this project possible, you can check out the list of copyright holders and the list of individuals.

Support

Please use the kyua-discuss mailing list for any support inquiries.

Homepage: https://github.com/jmmv/kyua/