Performance of the Domori Cluster

The domori cluster, when fully operating (which has been for a total of 3 days total since we first obtained it in December 2006 due to various annoying reasons) has the following specifics:

46 nodes, for a total of 184 cores and 184GB of RAM.
each node has two, 2-core 3.46GHz Pentium D processors and 4GB of RAM.
Running hand-compiled Linux 2.6.23.9 with perfmon2 patches,
Gigabit ethernet interconnect

In the brief window it was up, I was running Linpack on it to burn it in and test it out. I managed to get ~250 Gflops when using 169 cores and about half of available RAM. I'm sure we could get faster if I had a chance to fine-tune the tests.

We used the "libgoto_prescottp-r1.10" BLAS, this HPL.dat file, and got these results: domori.linpack.

Here are some resource plots, taken while running the linpack results above.

Here's CPU load. You can see where I had to shut 1/3 of them off Friday afternoon.

For the below plot, ignore the purple. It wasn't swapping. This is an artifact in the resource-monitoring program.

MPI network traffic. I'm not sure how this is being calculated, as our theoretical max is 1Gbps = ~125 Megabytes/s. The tool is probably summing the packet count across all 46 machines:

Back to the fusion machines page