 | Caution: CXFS is a complex product. To ensure that it is installed and configured in an optimal manner, you must purchase initial setup services from SGI. This chapter is not intended to be used directly by the customer, but is provided for reference. |
On IRIX nodes, CXFS supports either an administration node (containing the complete set of CXFS cluster services and the cluster database) or a client-only node. The software you install on a node determines the node type.
Nodes that you intend to run as metadata servers must be installed as administration nodes; all other nodes should be client-only nodes.
You should read through this entire book, especially Chapter 18, “Troubleshooting”, before attempting to install and configure a CXFS cluster. If you are using coexecution with FailSafe, see the FailSafe Administrator's Guide for SGI InfiniteStorage. If you are using a multiOS cluster, see the CXFS MultiOS Client-Only Guide for SGI InfiniteStorage.
Any node that may be a CXFS metadata server must be installed as a CXFS administration node. All other nodes should be client-only nodes.
 | Note: An IRIX node can be either be a CXFS administration node (for which you install cluster_admin) or a client-only node (for which you install cxfs_client). You cannot install both cluster_admin and cxfs_client on the same node. This procedure installs an administration node; to install a client-only node, see “IRIX Client-only Software Installation”. |
Installing the CXFS base CD for a CXFS administration node requires approximately 30.3 MB of space.
To install the required IRIX software for a CXFS administration node, do the following:
On each CXFS administration node in the pool, upgrade to IRIX 6.5.24 according to the IRIX 6.5 Installation Instructions.
To verify that a given node has been upgraded, use the following command to display the currently installed system:
# uname -aR
(For sites with a serial port server) On each CXFS administration node, install the version of the serial port server driver that is appropriate to the operating system. Use the CD that accompanies the serial port server. Reboot the system after installation.
For more information, see the documentation provided with the serial port server.
On each CXFS administration node in the pool, do the following:
Install the CXFS license key. When you order a product that requires a license key, the key will be sent to you automatically through e-mail by the order desk along with instructions for installing it. If you do not have this information, contact SGI or your local support provider.
If the license is properly installed, you will see the following output from the cxfslicense command after the CXFS software installation is complete:
# /usr/cluster/bin/cxfslicense -d CXFS license granted.
If you do not have the CXFS license properly installed, you will see the following error on the console when trying to run CXFS:
Cluster services:CXFS not properly licensed for this host. Run '/usr/cluster/bin/cxfslicense -d' for detailed failure information. After fixing the license, please run '/etc/init.d/cxfs_cluster restart'.
An error such as the following example will appear in the SYSLOG file:
Mar 4 12:58:05 6X:typhoon-q32 crsd[533]: <<CI> N crs 0> Crsd restarted. Mar 4 12:58:05 6X:typhoon-q32 clconfd[537]: <<CI> N clconf 0> Mar 4 12:58:05 5B:typhoon-q32 CLCONFD failed the CXFS license check.Use the Mar 4 12:58:05 5B:typhoon-q32 '/usr/cluster/bin/cxfslicense -d' Mar 4 12:58:05 5B:typhoon-q32 command to diagnose the license problem.
If you increase the number of CPUs in your system, you may need a new license. Partitioned Origin 3000 and Onyx 3000 systems upgrading to IRIX 6.5.15f or later will require replacement licenses. Prior to IRIX 6.5.15f, these partitioned systems used the same lmhostID to license all the partitions in the system. For more information, see the 6.5.15 Start Here/Welcome and the following web page: http://www.sgi.com/support/licensing/partitionlic.html.
For more information about installing software licenses, see the IRIX 6.5 Installation Instructions booklet.
Insert CD-ROM #1 into the CD drive.
Instruct inst to read the already inserted CD-ROM as follows:
Inst> from /CDROM/dist
When you see the following message, press the Enter key to read the CD-ROM:
Install software from : [/CDROM/dist]
Install the XVM software:
Inst> keep * Inst> install eoe.sw.xvm Inst> install eoe.books.xvm Inst> go
The following subsystems will be installed:
eoe.sw.xvm eoe.books.xvm
If you want to use Performance Co-Pilot to run XVM statistics, install the default pcp_eoe subsystems and also select pcp_eoe.sw.xvm. This installs the Performance Co-Pilot PMDA (the agent to export XVM statistics) as an exit operation (exitop).
Exit from inst:
Inst> quit
The process may take a few minutes to complete.
After you have installed the software and quit the inst interface, you are prompted to reboot the system to apply the changes. However, you will reboot in the step documented by “Rebooting the System” in Chapter 8.
Insert CD-ROM #3 into the CD drive.
When you see the following message, press the Enter key to read the CD-ROM:
Install software from : [/CDROM/dist]
Install the base cluster software:
Inst> keep * Inst> install cluster_admin Inst> install cluster_control Inst> install cluster_services Inst> install sysadm_base Inst> install sysadm_cxfs Inst> install sysadm_cluster Inst> install sysadm_xvm Inst> go
The following subsystems will be installed:
cluster_admin.man.man cluster_admin.sw.base cluster_control.man.man cluster_control.sw.base cluster_control.sw.cli cluster_services.man.man cluster_services.sw.base cluster_services.sw.cli sysadm_base.man.priv sysadm_base.man.relnotes sysadm_base.man.server sysadm_base.sw.client sysadm_base.sw.dso sysadm_base.sw.priv sysadm_base.sw.server sysadm_cxfs.man.pages sysadm_cxfs.man.relnotes sysadm_cxfs.sw.client sysadm_cxfs.sw.desktop sysadm_cxfs.sw.server sysadm_cxfs.sw.web sysadm_cluster.man.relnotes sysadm_cluster.sw.client sysadm_cluster.sw.server sysadm_xvm.man.pages sysadm_xvm.man.relnotes sysadm_xvm.sw.client sysadm_xvm.sw.desktop sysadm_xvm.sw.server sysadm_xvm.sw.web
Insert the CXFS 3.2 IRIX Server and Client for IRIX 6.5.24 CD into the CD drive.
Note: If you have a system running an earlier version of IRIX with CXFS installed and try to upgrade IRIX without also installing the required CXFS CD, you will get a conflict. You must either install the CXFS CD or remove CXFS.
Instruct inst to read the already inserted CD as follows:
Inst> from /CDROM/dist
When you see the following message, press the Enter key to read the CD-ROM:
Install software from : [/CDROM/dist]
Install the CXFS software:
Inst> keep * Inst> install cxfs Inst> install cxfs_cluster Inst> install cxfs_util Inst> go
Caution: If you do not install cxfs_cluster, the inst utility will not detect a conflict, but the CXFS cluster will not work. You must install the cxfs_cluster subsystem. The following subsystems will be installed:
cxfs.books.CXFS_AG cxfs_cluster.man.man cxfs_cluster.sw.base cxfs_cluster.sw.cli cxfs.sw.cxfs cxfs.sw.xvm_cell cxfs_util.man.man cxfs_util.sw.base
When sysadm_base is installed, tcpmux service is added to the /etc/inetd.conf file.
If you want to use a web-based version of the GUI, the following subsystems must be installed on the CXFS administration nodes that you will connect to (by means of a Java-enabled web browser running on any platform) for performing administrative operations:
sysadm_base.sw.client sysadm_cxfs.sw.client sysadm_cxfs.sw.web sysadm_xvm.sw.client
These subsystems are part of the default software that was installed in step 3.
If you want to use a web-based version of the GUI, you must also have one of the following installed:
sgi_apache.sw.server
nss_enterprise.sw.server (from the Netscape CD-ROM)
If one of these subsystems is not already installed, you must load the appropriate CD-ROM and install the subsystem.
If you want to run the GUI client from an IRIX desktop (which can be a node in the cluster or outside of the cluster), install the following subsystems:
Inst> keep * Inst> install java2_eoe.sw Inst> install java2_eoe.sw32 Inst> install sysadm_base.man Inst> install sysadm_base.sw.client Inst> install sysadm_cluster.sw.client Inst> install sysadm_cxfs.man Inst> install sysadm_cxfs.sw.client Inst> install sysadm_cxfs.sw.desktop Inst> install sysadm_xvm.sw.client Inst> install sysadm_xvm.sw.desktop Inst> go
Caution: The GUI only operates with Java2 v1.4.1 Execution Environment (Sun JRE v1.4.1). This is the version of Java that is provided with the IRIX 6.5.24 release.
The SGI website also contains Java1. However, you cannot use this version of Java with the GUI. Using a Java version other than 1.4.1 will cause the GUI to fail.If the workstation is an IRIX machine that launches the GUI client from a web browser that supports Java, install the java_plugin subsystem from the IRIX 6.5.24 CD. This is the Runtime Plug-in for IRIX, Java Edition 1.4.1, which supports JRE 1.4.1. (However, launching the GUI from a web browser is not the recommended method on IRIX. Running the GUI client from an IRIX desktop, as in step 5 above, is preferred.)
After installing the Java plug-in, you must close all browser windows and restart the browser.
An IRIX node can be either be a CXFS administration node (for which you install cluster_admin) or a client-only node (for which you install cxfs_client). You cannot install both cluster_admin and cxfs_client on the same node. This procedure installs a client-only node; to install an administration node, see “IRIX Administration Software Installation”.
| Note: For information about installing software for a node running an operating system other than IRIX, see the CXFS MultiOS Client-Only Guide for SGI InfiniteStorage. |
To install the required IRIX software, do the following:
On each IRIX client-only node in the pool, upgrade to IRIX 6.5.24 according to the IRIX 6.5 Installation Instructions.
To verify that a given node has been upgraded, use the following command to display the currently installed system:
# uname -aR
(For sites with a serial port server) On each node, install the version of the serial port server driver that is appropriate to the operating system. Use the CD that accompanies the serial port server. Reboot the system after installation.
For more information, see the documentation provided with the serial port server.
On each IRIX client-only node in the pool, do the following:
Install the CXFS license key. When you order a product that requires a license key, the key will be sent to you automatically through e-mail by the order desk along with instructions for installing it. If you do not have this information, contact SGI or your local support provider.
If the license is properly installed, you will see the following output from the cxfslicense command:
# /usr/cluster/bin/cxfslicense -d CXFS license granted.
If you do not have the CXFS license properly installed, you will see the following error on the console when trying to run CXFS:
Cluster services:CXFS not properly licensed for this host. Run '/usr/cluster/bin/cxfslicense -d' for detailed failure information. After fixing the license, please run '/etc/init.d/cxfs_client restart'.
If you increase the number of CPUs in your system, you may need a new license. Partitioned Origin 3000 and Onyx 3000 systems upgrading to IRIX 6.5.15f or later will require replacement licenses. Prior to IRIX 6.5.15f, these partitioned systems used the same lmhostID to license all the partitions in the system. For more information, see the 6.5.15 Start Here/Welcome and the following web page: http://www.sgi.com/support/licensing/partitionlic.html.
For more information about installing software licenses, see the IRIX 6.5 Installation Instructions booklet.
Insert CD-ROM #1 into the CD drive.
Instruct inst to read the already inserted CD-ROM as follows:
Inst> from /CDROM/dist
Caution: Do not install to an alternate root using the inst -r option. Some of the exit operations (exitops) do not use pathnames relative to the alternate root, which can result in problems on both the main and alternate root filesystem if you use the -r option. For more information, see the inst man page.
When you see the following message, press the Enter key to read the CD-ROM:
Install software from : [/CDROM/dist]
Install the XVM software:
Inst> keep * Inst> install eoe.sw.xvm Inst> install eoe.books.xvm Inst> go
The following subsystem will be installed:
eoe.sw.xvm eoe.books.xvm
If you want to use Performance Co-Pilot to run XVM statistics, install the default pcp_eoe subsystems and also select pcp_eoe.sw.xvm. This installs the Performance Co-Pilot PMDA (the agent to export XVM statistics) as an exit operation (exitop).
Insert the CXFS 3.2 IRIX Server and Client for IRIX 6.5.24 CD into the CD drive.
Instruct inst to read the already inserted CD-ROM as follows:
Inst> from /CDROM/dist
Note: If you have a system running an earlier version of IRIX with CXFS installed and try to upgrade IRIX without also installing the required CXFS CD, you will get a conflict. You must either install the CXFS CD or remove CXFS. Caution: Do not install to an alternate root using the inst -r option. Some of the exit operations (exitops) do not use pathnames relative to the alternate root, which can result in problems on both the main and alternate root filesystem if you use the -r option. For more information, see the inst man page.
When you see the following message, press the Enter key to read the CD-ROM:
Install software from : [/CDROM/dist]
Install the CXFS software:
Inst> keep * Inst> install cxfs Inst> install cxfs_client Inst> install cxfs_util Inst> go
Caution: If you do not install cxfs_client, the inst utility will not detect a conflict, but the CXFS cluster will not work. You must install the cxfs_client subsystem. The following subsystems will be installed:
cxfs.books.CXFS_AG cxfs_client.man.man cxfs_client.sw.base cxfs.sw.cxfs cxfs.sw.xvm_cell cxfs_util.man.man cxfs_util.sw.base
Exit from inst:
Inst> quit
The process may take a few minutes to complete.
After you have installed the software and quit the inst interface, you are prompted to reboot the system to apply the changes. However, you will reboot in the step documented by “Rebooting the System” in Chapter 8.
If you want to use the connectivity diagnostics provided with CXFS, ensure that the /.rhosts file on each administration node allows all the nodes in the cluster to have access to each other in order to run remote commands such as rsh. The connectivity tests execute a ping command from the local node to all nodes and from all nodes to the local node. To execute ping on a remote node, CXFS uses rsh (user root). For example, suppose you have a cluster with three nodes: cxfs0, cxfs1, and cxfs2. The /.rhosts file on each administration node will be as follows (prompt denotes node name):
cxfs0# cat /.rhosts cxfs1 root cxfs1-priv root cxfs2 root cxfs2-priv root cxfs1# cat /.rhosts cxfs0 root cxfs0-priv root cxfs2 root cxfs2-priv root cxfs2# cat /.rhosts cxfs0 root cxfs0-priv root cxfs1 root cxfs1-priv root |
Make sure that the mode of the .rhosts file is set to 600 (read and write access for the owner only).
After you have completed running the connectivity tests, you may wish to disable rsh on all cluster nodes.