[Shootout-list] fannkuch (timer resolution; HZ=1000?)

Jon Harrop jon@ffconsultancy.com
Fri, 20 May 2005 23:07:54 +0100


On Friday 20 May 2005 22:52, Isaac Gouy wrote:
> --- Brent Fulgham <bfulg@pacbell.net> wrote:
> > Obviously, this causes problems for the slow
> > languages (since they will most likely time out now).
>
> We actually reduced the max time for nbody within the last week,
> because I'd made it too large.

I'm not convinced that you did make it too large. As I've said before, the=
=20
OCaml code takes <20s to complete here with the larger N but was shown as=20
"timed out" on the shootout when other programs were taking almost ten time=
s=20
as long.

> Bagley called it the Great Computer Programming Language Shootout
> because it compared a great many language implementations

As Bengt keeps saying, the solution is to generate data for a variety of N =
and=20
let people study what ever they want.

> - not just the 5 most optimised compilers.

Assuming the minimum time taken to perform a test is 1s and the timeout is=
=20
100s, languages just need to be within two orders of magnitude of the=20
performance of the fastest language to get on the shootout for that subset =
of=20
benchmarks. Most languages are that fast.

=46rom the results for heapsort, only six languages would time out.

=2D-=20
Dr Jon D Harrop, Flying Frog Consultancy Ltd.
Objective CAML for Scientists
http://www.ffconsultancy.com/products/ocaml_for_scientists