[Fuego] RFC - "Measurements" vs. "metrics"
daniel.sangorrin at toshiba.co.jp
Wed Jun 28 02:08:00 UTC 2017
> -----Original Message-----
> From: fuego-bounces at lists.linuxfoundation.org [mailto:fuego-bounces at lists.linuxfoundation.org] On Behalf Of Bird, Timothy
> Sent: Wednesday, June 28, 2017 10:42 AM
> To: fuego at lists.linuxfoundation.org
> Subject: [Fuego] RFC - "Measurements" vs. "metrics"
> Hello all,
> In Fuego documentation, I have been calling the value that is obtained for a particular benchmark test case
> a "metric". I didn't have a name for the individual test case result for functional tests.
> In looking at the kernelci documentation, they use the term "measurement" in their json API schema.
> Should we switch to using the term "measurement" throughout Fuego? Does anyone know what
> the industry "standard" for describing the result value for an individual test case is?
> Let me know if you have an opinion.
I think that the term "measurement" is more accurate.
Fuego only allows one single measurement for each test_case at the moment. And
this measurement will be compared to the corresponding single threshold. I think we
should support multiple measurements per test_case as in kernel ci.
More information about the Fuego