[Shootout-list] X per second scoring system, resume

[Bengt Kleberg]

Brandon J. Van Every wrote:
...deleted
> 
> - yes it would be nice to have some larger, roughly constant amount of
> time for all tests

i think a single measurement, no matter how eact it has been done, no 
matter how much time has been spen on selecting when to do it and for 
how long, will be less accurate than a graph.


> 
> - startup/shutdown times vary both by language and by test.
>   How much is unknown.

...deleted

> Unless someone has further arguments, I think a wise course of action
> would be to pick a language and a test that is expected to have the most
> variance in startup/shutdown times.  In other words, deal with a likely
> worst case.  Implement invasive timers for that language, see if it
> makes much difference for test accuracy.  Also deal with "how many
> seconds should the test be?" while one is at it.
> 
> Can anyone recommend what language + test should be the guinea pig?

the two things i kept right above here (before and after ...deleted) 
shows that if we are interested in variance, it would have to be almost 
all languages/all tests. even a very slow starter could be very precise.

if you really think this is such a important thing you should ofcourse 
do it. however, in my view it would be better to put that energy into 
something else.


bengt