[lsb-discuss] RFC: new LSB development infrastructure
Banginwar, Rajesh
rajesh.banginwar at intel.com
Fri Jul 14 16:38:01 PDT 2006
>
>Package The Number of Interfaces Presumably Tested Now
>------- ------------------------ ---------------------
>LSB Core ABI 1532 550 (36%)
>LSB CPP ABI 1942 519 (27%)
>LSB Desktop ABI 19103 3966 (21%)
>
>Note: "presumably tested" is an optimistic estimation based on the fact
>that the interface is referenced from the test ELF (but it does not
even
>mean it is called and of course it does not guarantee it is tested
>adequately).
>
>To ensure the strength of the LSB standard, most of the interfaces must
>have minimal tests (that at least call the interface once) and some
most
>important interfaces (manually selected) should have good tests.
>
We went through this process during LSB 3.1. If you look at the GTK (and
associated libraries like ATK etc) tests, we have about 1600-1800
interfaces tested out of about 4500 total. We looked at about 40-50
commonly used open source applications (like Firefox etc) and analyzed
the usage of GTK+ stack libraries interface usage. This usage
information gave us the most commonly used interfaces that need to be
tested thoroughly. So the new test development was scoped to target only
those interfaces and not all. So the 35-40% coverage really should
translate to 80% or so in effect.
I would basically recommend the similar model for any library we target
for testing. Instead of targeting 100% test coverage, focus only on the
commonly used interfaces (to get the best bang for the buck).
And by the way, above number (listed by Ian) really is skewed due to
very minimal testing we have for Qt (talking only about the Desktop
part).
Thanks,
-Rajesh
More information about the lsb-discuss
mailing list