France-Grilles | Université Toulouse 3
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
platform:platform [2016/01/30 12:40] francois [Hardware] |
platform:platform [2016/11/13 08:11] (current) francois [Platform details] |
||
---|---|---|---|
Line 5: | Line 5: | ||
<WRAP center round info 60%>//**__Virtualization__**// | <WRAP center round info 60%>//**__Virtualization__**// | ||
- | From a Virtual Machines point of view, CloudMIP is able to host up to **256 VMs** each featuring **1 physical CPU** and upto **4GB RAM** (stands for //Amazon medium instance//).</WRAP> | + | From a Virtual Machines point of view, CloudMIP is able to host up to **276 VMs** each featuring **1 physical CPU** and upto **4GB RAM** (stands for //Amazon medium instance//).</WRAP> |
\\ | \\ | ||
Below is an overview of the CloudMIP platform. | Below is an overview of the CloudMIP platform. | ||
- | {{ :platform:cloudmip_public_internals.png?direct |CloudMIP architecture overview.}} | + | {{ :platform:cloudmip_public_internals_sep16.png?direct |CloudMIP architecture overview.}} |
\\ | \\ | ||
Line 17: | Line 17: | ||
* a front-node, | * a front-node, | ||
* a NFS server, | * a NFS server, | ||
- | * 32 nodes (blades) dispatched within two DELL M1000e chassis.\\ | + | * 32 nodes (blades) dispatched within two DELL M1000e chassis, |
+ | * 1 additional hypervisor Dell R630 (20 cores, 128GB RAM).\\ | ||
**[1] Front-node**\\ | **[1] Front-node**\\ | ||
- | The front-node is a Dell R710 featuring 8 cores XEON@2.8GHz, 48GB DDR3 memory and 6 146GB 15ktpm SAS drives in a RAID6 setup. | + | The front-node is a Dell R710 featuring 8 cores XEON@2.8GHz, 48GB DDR3 memory and 6 x 146GB 15ktpm SAS drives in a RAID6 setup.\\ |
+ | This server is running a CentOS 7.2 Linux distribution. | ||
\\ | \\ | ||
** [2] NFS **\\ | ** [2] NFS **\\ | ||
- | The NFS server is a powerfull SUN x4500 featuring 48 x 1TB HDD. The setup makes use of the ZFS filesystem leading to a 18TB CloudMIP dedicated storage space with performances > 500MB/s I/O.\\ | + | Our new NFS server (bought by [[http://neocampus.univ-tlse3.fr|neOCampus]] and the [[https://www.irit.fr/FabSpace|EU Fabspace 2.0]] project) is a powerfull Dell R730xD featuring 16 x 4TB NL-SAS in a RAID6 configuration. The XFS filesystem gives access to more than 50TB of useful storage space featuring > 2GB/s throughput.\\ |
- | This server is running a Scientific Linux 6.4 distribution. | + | |
+ | * 16 cores Xeon E5-2620 v4 @ 2.10GHz, | ||
+ | * 32GB DDR4 2100MHz, | ||
+ | * Fedora Core 24 distribution. | ||
\\ | \\ | ||
Line 39: | Line 44: | ||
* 48GB DDR3 RAM, | * 48GB DDR3 RAM, | ||
* two gigabit Ethernet links, | * two gigabit Ethernet links, | ||
- | * two SAS 15ktpm 146GB hard drives. | + | * two SAS 15ktpm 146GB hard drives, |
+ | * [[http://centos.org|CentOS]] 7.2 | ||
+ | |||
+ | One additional hypervisor Dell R630 bought by CNRS Big Data Challenge [[http://www.cnrs.fr/mi/spip.php?article53|Mastodons]] : | ||
+ | * 20 cores Xeon E5-2640 v4 @ 2.40GHz, | ||
+ | * 128GB DDR4 2400MHz, | ||
+ | * CentOS 7.2 | ||
+ | \\ | ||
+ | With such configuration, the whole system features 276 physical cores and 1.6TB RAM. On its side, with drives in a RAID0 configuration, the achieved I/O throughput is over than 300MB/s.\\ | ||
+ | |||
+ | ===== Network ===== | ||
+ | \\ | ||
+ | To take advantage of the multiple embedded Gigabit Ethernet interfaces of our servers, we aggregated (i.e trunk) all of them into single devices. Then, vlans segmentation is applied.\\ | ||
+ | |||
+ | {{ :platform:cloudmip-network-arch_sep16.png?direct |[Dec.15]CloudMIP network architecture.}} | ||
- | With such configuration, the whole system features 256 physical cores and 1.5To RAM. On its side, with drives setup in a RAID0 configuration, the achieved I/O throughput is over than 300MB/s. | ||
- | ===== Software ===== | ||
- | All nodes feature a local installation of a 64 bits [[http://centos.org|CentOS]] 7.2 (RHEL clone). |