Forgot your password?
A Clash of Clusters Provides New Clue to Dark Matter
Document Actions
KIPAC Orange Cluster
KIPAC Cluster "orange"
The "orange" cluster will have 360 compute cores at 2.66GHz with 4GB/core to total 1.44TB of memory. Complementing the memory and compute capacity is an I/O system intended to allow memory <--> disk read/write cycles in a reasonable amount of time. The expected through put is 1 GB/s or better for the lustre version 1.6 based system. The nominal configuration will have 2 MDS/MGS machines as an HA pair, 6 OSS machines and 6 OST's connected via an FC switch to the OSS's. All nodes, compute and filesystem, will be interconnected via DDR Infiniband. The details of the components are shown in the table:
| item | qnty | description |
| interactive node | 1 | Sun X2200 w/2218 CPU, 16x1GB memory, 250 GB HD |
| compute node | 90 | Sun X2200 w/2218 CPU, 16x1GB memory, 250 GB HD |
| lustre MGS/MDS | 2 | Sun X2200 w/2218 CPU, 8x1GB memory, 250 GB HD |
| lustre OSS | 6 | Sun X2200 w/2218 CPU, 4x1GB memory, 250 GB HD |
| DISK Array | 3 | Sun 6140 w/2GB cache, 16x500 GB HD, dual controller, configured as 2x{6+1+1} RAID 5 |
| FC switch | 1 | 16 port McData FC switch |
| racks | 4 | Sun Rack 1000-38 w/power distribution etc. |
| IB switch | 11 | Cisco 7000D series DDR IB switches configured as 4 core + 7 leaf w/112 active ports and expandable to 12 leaf switch count |
| IB HCA | 100 | Cisco DDR HCA |
| IB cables | 156 | 100 1m, 16 3m, 40 5m DDR rated IB cables |
| Ethernet switch | 2 | 48 Port Cisco ~3500 class GigE switch used to uplink compute nodes to main network |
| management switch | 4 | Cisco unknown, for service processor (SP) connection |
| serial concentrator | 4|7 | various for console access and logging distribution |
KIPAC tea talk, Speaker: Gary Godfrey