Virtual test environment for Cluster 3.2

It’s been a while, yes as you can see I’m not a full tine blogger. 🙂
Anyway, due to the nature of my work I need to test some stuff first before applying them live. As such it’s a bit expensive to have several servers just for that.
It’s also good if we want to test something new like really brand new, a new feature, a patch that gets more things done and so on or even to get ready for a certification exam.
So this post will be mostly about the initial setup using the following Software

      1. Host: My laptop with Fedora 13 x86_64


      2. Virtualization Software: Oracle Virtual Box 3.2.8


      3. Arquichiture: 2-node cluster


      4. Software: Oracle Cluster 3.2u3


    5. Operating System: Oracle Solaris 10/09 x86

Initial difficulties that I had:

      1. Where would I put the /globaldevices filesystem?


      2. How would I configure the interconnect interface?


    3. What would be the quorum device?

And the answer that I found was as follows:

      1. Searching a bit I got the following link for the In here it states that we can use globaldevices with ZFS.

    2. Another thing I had doubt with was regarding the interconnect. At least the Virtual Box has a internal network interface and a host only interface. Since in the case of the interconnect they have to be completely isoladed from any traffic I had to create two internal networks. The command used was:

VBoxManage –modifyvm –intnet1 interconnect1
VBoxManage –modifyvm –intnet1 interconnect1
VBoxManage –modifyvm –intnet2 interconnect2
VBoxManage –modifyvm –intnet2 interconnect2

Afterwards in the GUI of VBOX just needed to add the interfaces adapter 2 and 3 to match the interconnects.
3. As for the Quorum device … well in here I had 3 choices:

        3.1 Quorum disk device


        3.2 Nas Server – Requires another vm


      3.3 Quorum server

I ended up going with Quorum disk device thanks to Virtual Box being able to share the same disk across Virtual Machines.
The requisites to be able to do this are:

      1. The disk image file


      be dinamycally.


      2. Before applying the disks to a Virtual Machine we need to execute the following command:

VBoxManage modifyhd --type shareable

After applying the change you can had normally to the Virtual Machine. In my case I added a SAS controller to each Virtual Machine and added the shared devices under that SAS controller.

Now …
From this point forward is quite simple. You just need to install each system accordingly.
So …

      1. Install Solaris in each node.


      2. Permit ssh login from one node to the other with ssh exchange keys

        2.1. Edit PermitRootLogin=no to yes in /etc/ssh/sshd_config


        2.2. Generate the ssh keys for user root:


        solaris10-1# ssh-keygen -t rsa


        2.3. Copy the .pub file to second node


        solaris10-1# scp root@solaris10-2:/.ssh/authorized_keys


        2.4. Repeat steps 1 to 3 from the second node

3. Install Cluster Software in each node and perform initial configuration.
NOTE: When performing the configuration it will ask for the interconnect devices. Don’t forget to specify the interconnects as the previous adapters that are under the Virtual Box internal network.
4. After all done, it’s time to specify the quorum device.

        4.1 Properly idenfify the shared devices. In my case they were under c2*


        4.2 Label each disk to be recognized by Solaris


        4.3 Create partitions as you wish.


      4.4 Execute in both nodes cldev populate; cldev show

From this point forth you are ready to toy a bit with your two node cluster. 🙂
By the way, you will have several messages regarding the system being unable to write the the keys to the quorum, at this point I haven’t looked into it properly. I will update when I have the time to take a depth look into it.


Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s