Other day, I had a very urgent requirement to implement VCS with guns pointing @ me :). When I checked for the hardware I found I can start the cluster only with one Private & one Public heartbeat link, which left the cluster in Jeopardy state the moment it started.
This was quiet obvious as VCS would atleast require two Private links with very less/minimal access to Low-priority links (Not recommended by Symantec) to have greater security and smooth functioning.
Mean while I got the hardware and wondered whether I can add them to cluster without any disruption to the running applications??? Thanks for the intuitive solution from Symantec team. !!!!.
Configuring heartbeat links is done as follows
Make sure your hardware is connected to the servers and OS can see it using dladm or kstat (Solaris 9 and less) or whichever is suitable.
# dladm show-dev
e1000g0 link: up speed: 1000 Mbps duplex: full
e1000g1 link: up speed: 1000 Mbps duplex: full
e1000g2 link: unknown speed: 0 Mbps duplex: half
#
To add a new high priority link (private heartbeat) while Low Latency transport is active, use the following command on each node:
# lltconfig -t <if alias name> -d <device> -b ether
Ex: # lltconfig -t e1000g2 -d /dev/e1000g2 -b ether
To add a new low priority link (utilizing a public interface),
# lltconfig -t <alias> -l -d <device> -b ether
Ex: lltconfig -t e1000g0 -l -d /dev/e1000g2 -b ether
NOTE: -l represents the low-priority link.
Here we are, now we can see the new NIC gets added under online private interconnect configuration on both the nodes,
# lltstat -l |grep link
link 0 e100g0 on etherfp lowpri
link 1 e1000g1 on etherfp hipri
link 2 e1000g2 on etherfp hipri -à Newly added.
link 0 e100g0 on etherfp lowpri
link 1 e1000g1 on etherfp hipri
link 2 e1000g2 on etherfp hipri -à Newly added.
But, there is a catch here. The word, I mentioned “ONLINE” means the configuration will only remain active till the server reboots or until the cluster is offline because, whenever LLT is started its reads the “/etc/llttab” file and loads the devices appropriately.
No were till now, we have added the new heartbeat link (e100g2) to “/etc/llttab”. Let’s pull the trigger.
Open the file using any UNIX editor (mostly vi) and before that, take a copy of LLT configuration file (/etc/llttab) it always saves you from troubles, otherwise. Then append the following entries on both the nodes.
After editing, the file looks as below.
# cat /etc/llttab
set-node testclus
set-cluster 100
link-lowpri e1000g0 /dev/e1000g0 - ether - -
link e1000g1 /dev/e1000g1 - ether - -
set-node testclus
set-cluster 100
link-lowpri e1000g0 /dev/e1000g0 - ether - -
link e1000g1 /dev/e1000g1 - ether - -
link e1000g2 /dev/e1000g2 - ether - - ]--à Newly appended.
Upon reboot of the system, the VCS configuration will read the additional link that was added to "/etc/llttab" in the above steps.
There you go we reached end of a hectic problem by a simple solution. The change to the link configuration is now permanent.