[Shootout-list] X per second scoring system, resume
Bengt Kleberg
bengt.kleberg@ericsson.com
Thu, 30 Sep 2004 09:05:58 +0200
greetings all,
in the discussion about a good scoring system for the shootout it has
been suggested that we use ''X per second scoring system''. this should
not have to mean that the test is supposed to be run for only a second.
it really means X-per-timeunit. it is then possible to normalise to
another timeunit (seconds) if so desired.
one way to get this X-per-timeunit is (imho) quite simple. we take the
graph that is created for every test and extraxt X-per-timeunit from it.
(do i need to explain how?)
another way to get X-per-timeunit is to re-write all our test to include
timers. it will also mean accepting that the timers might (depending
upon implementation) disturb the test result more or less. also, some
test (eg reverse) are very difficult to do like this.
as can be seen from my argumentation :-) i am strongly in favour of the
first way. what do others think?
bengt