[Shootout-list] benchmark design, hard limit for how many 'n'?

[Bengt Kleberg]

Brent Fulgham wrote:
...deleted
> Each iteration of the test produces one output file
> for each test program.  The output file is compared
> against an official "known good" output file.  If
> they match, the program is accepted as valid and
> it timings are added to an output table (otherwise
> the program is marked as 'failed'.)

does the iteration stop when a test fails for a 'n'?
(ie, does
	    if ($rc < 0)
	    {
	    	last;
	    }
skip the remaining iterations?)


...deleted
> Eventually, the output data table is compiled into
> the 'data.csv' and 'ndata.csv' that are used to
> run the website.

what is the difference beween ''data.csv'' and ''ndata.csv''?
usage?
contents?


bengt, who is very greatful for this explanation