[Shootout-list] X per second scoring system, resume

Bengt Kleberg bengt.kleberg@ericsson.com
Thu, 30 Sep 2004 09:05:58 +0200


greetings all,

in the discussion about a good scoring system for the shootout it has 
been suggested that we use ''X per second scoring system''. this should 
not have to mean that the test is supposed to be run for only a second. 
it really means X-per-timeunit. it is then possible to normalise to 
another timeunit (seconds) if so desired.

one way to get this X-per-timeunit is (imho) quite simple. we take the 
graph that is created for every test and extraxt X-per-timeunit from it. 
(do i need to explain how?)


another way to get X-per-timeunit is to re-write all our test to include 
timers. it will also mean accepting that the timers might (depending 
upon implementation) disturb the test result more or less. also, some 
test (eg reverse) are very difficult to do like this.


as can be seen from my argumentation :-) i am strongly in favour of the 
first way. what do others think?


bengt