[[Shootout-list] important facts i can not find

Bengt Kleberg bengt.kleberg@ericsson.com
Wed, 18 May 2005 10:15:25 +0200


skaller wrote:
...deleted
> run each test for increasing N 
> until one test exceeds T seconds or max N for
> some limit, then stop. 
> 
> This has the pleasant effect of clipping the graph
> of results for all languages, so both slow and fast languages
> 'run off' the graph, either upwards (slow languages) 
> or rightwards (fast languages). 

...deleted
> It isn't quite clear how this measurement model might
> fit in with the Shootout, it does, however, ensure
> 'automatically' that all the measurements are over
> a significant period of time AND that the time is
> bounded for the benchmarking process (modulo the 

i think this is a nice way of measuring (i admit to beeing biased since 
this is what i do myself). it is much better than the current shootout 
method. it will fit fine with the graph results (ndata.csv). it would 
probably be deemed unusable for the one-value-fits-all results (data.csv).
i am not interested in one-value-fits-all, but i realise that without an 
acceptable solution for data.cvs i will never be allowed better ndata.csv.