[Fuego] RFC - "Measurements" vs. "metrics"

[Daniel Sangorrin]

> -----Original Message-----
> From: fuego-bounces at lists.linuxfoundation.org [mailto:fuego-bounces at lists.linuxfoundation.org] On Behalf Of Bird, Timothy
> Sent: Wednesday, June 28, 2017 10:42 AM
> To: fuego at lists.linuxfoundation.org
> Subject: [Fuego] RFC - "Measurements" vs. "metrics"
> 
> Hello all,
> 
> In Fuego documentation, I have been calling the value that is obtained for a particular benchmark test case
> a "metric".  I didn't have a name for the individual test case result for functional tests.
> 
> In looking at the kernelci documentation, they use the term "measurement" in their json API schema.
> Should we switch to using the term "measurement" throughout Fuego?  Does anyone know what
> the industry "standard" for describing the result value for an individual test case is?
> 
> Let me know if you have an opinion.

I think that the term "measurement" is more accurate.

Off-topic: 
Fuego only allows one single measurement for each test_case at the moment. And 
this measurement will be compared to the corresponding single threshold. I think we
should support multiple measurements per test_case as in kernel ci.

Thanks,
Daniel