So after cursing around hopelessly, somehow this happened unexpectedly:
I was having problems with adding the host but then it suddenly worked.
And after hours and hours of small incremental steps towards working first instance I now have this:
But there are so many things I know nothing about. Networking is one of those things.
And here we have Windows Server 2008 R2 being installed:
Performance-wise the DL365 G1 with RAID1 10KRPM HP SAS drives is excellent as I get 160MB/s write – with encryption. So the Opteron 2356 is quite heavy performed in that sense too.
I am beginning to like CloudStack:
It has quite clean firewall built in. Obviously not very configurable but for basic usage.
And on Hypervisor I immediately started saving memory with ksm:
Shared Sharing Unshared Volatile Sharing:Shared Unshared:Sharing Saved
32,467 1,029,836 438,788 293,152 31.710000:1 0.420000:1 4,022M
And since swap is compressed I get some benefits there as well:
# zfs get compressratio dpool/swap
NAME PROPERTY VALUE SOURCE
dpool/swap compressratio 3.06x -
So the problem now is that because CloudStack will not allow over-subscription of thinly provisioned primary storage (more or less) the 68 available gigabytes won’t be enough for everything I want. So two 300GB SAS disks must be purchased ASAP to rectify the situation.
Also I am doubting my use of two servers, because to have one just for ESXi management is stupid. It can be used for other things but to have to have one to get ESXi souns like bad design. But I am not certain whether CloudStack is stable and quite frankly, interesting enough to only use that. ESXi is, still, a proper enterprise system.
One alternative to the 300GB disks is to use 4 73GB disks on RAIDZ1 which would be sub-optimal solution but might work. This would give me little over 200GiB of storage which would be enough.
So I made the changes I discussed above and I am getting excellent write performance:
capacity operations bandwidth
pool alloc free read write read write
---------- ----- ----- ----- ----- ----- -----
dpool 25.1G 247G 0 807 357 15.2M
dpool 25.1G 247G 0 1.24K 0 157M
dpool 25.1G 247G 0 1.29K 0 164M
dpool 25.1G 247G 0 1.61K 511 204M
dpool 25.1G 247G 0 1.30K 511 165M
dpool 25.1G 247G 0 1.80K 0 229M
dpool 25.2G 247G 0 3.27K 0 117M
dpool 25.2G 247G 0 12.3K 0 50.6M
dpool 25.2G 247G 0 12.2K 0 66.8M
dpool 25.2G 247G 0 9.29K 0 33.3M
dpool 25.2G 247G 1 9.59K 1022 30.2M
There is some “thing” with ZFS and QEMU or QCOW2, that makes it impossible to use RAW ZFS with some settings of QEMU, or what not, and so because I didn’t want to go there, I just planted ext4 on top of thinly provisoned ZFS block device. Should not affect performance at all and could even improve it.
And these speeds are with gzip-9 compression and individual LUKS encryption on each of the four disks. And I am just about CPU bound. So I am extremely impressed with this AMD Opteron 2356 and it isn’t the fastest Opteron I got available.
A lot of free space now.