[Shootout-list] benchmark design, hard limit for how many 'n'?
Bengt Kleberg
bengt.kleberg@ericsson.com
Fri, 29 Apr 2005 15:14:08 +0200
Brent Fulgham wrote:
...deleted
> Each iteration of the test produces one output file
> for each test program. The output file is compared
> against an official "known good" output file. If
> they match, the program is accepted as valid and
> it timings are added to an output table (otherwise
> the program is marked as 'failed'.)
does the iteration stop when a test fails for a 'n'?
(ie, does
if ($rc < 0)
{
last;
}
skip the remaining iterations?)
...deleted
> Eventually, the output data table is compiled into
> the 'data.csv' and 'ndata.csv' that are used to
> run the website.
what is the difference beween ''data.csv'' and ''ndata.csv''?
usage?
contents?
bengt, who is very greatful for this explanation