[Shootout-list] begging questions about CRAPS

Brandon J. Van Every vanevery@indiegamedesign.com
Wed, 20 Oct 2004 22:09:50 -0700


Einar Karttunen wrote:
> Brandon J. Van Every
> >
> > My agenda is to kill CRAPS.  I think it should be replaced
> > with a system
> > of better grouped, composite benchmarks.  CRAPS is crap!
>
> Well to kill CRAPS something better has to exist first.

Yes, it is an organizational and definitional problem.  One that as
Bengt pointed out, is hard.  I believe that one can tackle it in pieces,
however.

For instance, it's very clear to me that a threads / concurrency subtest
*should* exist.  It *should* wrap up several tests into one package.
The problem is mainly that the interested parties don't agree on what to
package up.  And, I can't help 'em, 'cuz I'm not interested in that
particular problem.

I am more interested in "CPU performance" type tests.  Unfortunately, my
work pressure is seriously accelerating now, so what I'm willing to do
for the time being is quite limited.  I'm mainly just fishing for common
interest at this point.  If there is no common interest, no shared
vision of 'better organized tests in groups', then I'll move on.  I've
got way more to do right now that I really want to contend with.


Cheers,                     www.indiegamedesign.com
Brandon Van Every           Seattle, WA

When no one else sells courage, supply and demand take hold.