You are here
The Bugaboo Dell Xeon cluster is comprised of 26 chassis. Ten of these contain 16 8-core blades each, for a total of 1280 cores. Each of these blades (compute node) contains two sockets, with each socket containing an Intel Xeon E5430 quad-core processor, running at 2.66 GHz. Each blade has 16 GB of memory that can be shared among the 8 cores on that node. Another 16 chassis contain a total of 254 12-core blades, for a total of 3048 cores. Each of these blades contains two sockets, with each socket containing an Intel Xeon X5650 6-core processor, running at 2.66 GHz. Each blade has 24 GB of memory that can be shared among the 12 cores on that node; 32 of these 12-core blades have twice as much memory, i.e., 48GB. In summary, there are a total of 4328 cores in the cluster with 2GB of memory per core (32 nodes with 4GB/core). The scheduler is configured such that it will never assign nodes with different processors to a single job. Thus, from a job perspective the cluster will always appear homogeneous, i.e., all processes run on the same type of processor.
The compute nodes are connected with Infiniband using a 288-port QLogic switch. The connection between nodes within a chassis is non-blocking, but, there is "2 to 1" blocking for connections that span chassis. That means that the maximum bandwidth for communications between nodes in different chassis is only half that for nodes within the same chassis.
April 1, 2018