[Shootout-list] benchmark design, hard limit for how many 'n'?

[Brent Fulgham]

--- Bengt Kleberg <bengt.kleberg@ericsson.com> wrote:

> does the iteration stop when a test fails for a 'n'?
> (ie, does
> 	    if ($rc < 0)
> 	    {
> 	    	last;
> 	    }
> skip the remaining iterations?)

Yes.  It does this for:

1.  Program fails.
2.  Program times out.
3.  Program output is incorrect.
 
> what is the difference beween ''data.csv'' and
> ''ndata.csv''? usage? contents?

data.csv holds the summary data used for the overall
web page displays.  ndata.csv holds the data for
individual tests (i.e., each value of N for which
a test was run), for the 'side-by-side' comparison.

-Brent