 | Caution: CXFS is a complex product. To ensure that it is installed and configured in an optimal manner, you must purchase initial setup services from SGI. This chapter is not intended to be used directly by the customer, but is provided for reference. |
On SGI Altix systems running SGI ProPack for Linux 64-bit, CXFS supports either an administration node (containing the complete set of CXFS cluster services and the cluster database) or a client-only node. The software you install on a node determines the node type.
 | Note: SGI ProPack for Linux is an overlay product that adds or enhances features in the supported Linux base distributions. |
Nodes that you intend to run as metadata servers must be installed as administration nodes; all other nodes should be client-only nodes.
This chapter discusses the following:
After completing these steps, see Chapter 9, “Initial Configuration of the Cluster”. For details about specific configuration tasks, see Chapter 10, “Reference to GUI Tasks for CXFS”, and Chapter 11, “Reference to cmgr Tasks for CXFS”.
You should read through this entire book, especially Chapter 18, “Troubleshooting”, before attempting to install and configure a CXFS cluster. If you are using coexecution with IRIS FailSafe, see the FailSafe Administrator's Guide for SGI InfiniteStorage. If you are using a multiOS cluster, see the CXFS MultiOS Client-Only Guide for SGI InfiniteStorage.
The following limitations and considerations apply to any Linux 64-bit node (client-only or administration):
CXFS filesystems with XFS version 1 directory format cannot be mounted on Linux 64-bit nodes.
All CXFS files have UNIX mode bits (read, write, and execute) and optionally an access control list (ACL). For details, see the chmod and setfacl man pages.
SGI ProPack file utilities do not provide ACL support, so commands such as ls and cp will not show or preserve ACLs. However, the commands in the acl package will allow manipulation of the ACLs of files on CXFS filesystems.
Client-only Linux 64-bit nodes have the following limitations and considerations:
Client-only nodes cannot view or edit user and group quotas. However, user and group quotas are enforced correctly by the metadata server.
To view or edit your quota information, you must log in to an administration node and make any necessary changes. If you would like to provide a viewing command such as repquota, you could construct shell script similar to the following on the Linux 64-bit node:
#! /bin/sh # # Where repquota lives on administration node repquota=/usr/etc/repquota # The name of an administration node in the cluster adminnode=cain rsh $adminnode "$repquota $*" exit
See also Appendix E, “Filesystem Specifications”.
The CXFS administration software will be initially installed and configured by SGI personnel. This section provides an overview of those procedures. You can use the information in this section to verify the installation.
| Note: Version numbers shown here are examples; your installed system may differ. |
Any node that may be a CXFS metadata server must be installed as a CXFS administration node. All other nodes should be client-only nodes.
| Note: A Linux 64-bit node can be either be a CXFS administration node (for which you install cluster_admin) or a client-only node (for which you install cxfs_client). You cannot install both cluster_admin and cxfs_client on the same node. This procedure installs an administration node; to install a client-only node, see “Linux 64-bit Client-only Software Installation”. |
Installing the CXFS software for a CXFS administration node requires approximately 65 MB of space.
Do the following to install the software required for a Linux 64-bit administration node:
Read the README file for the Linux 64-bit platform to learn about any late-breaking changes in the installation procedure.
Install SGI ProPack 3.0 for Linux release, according to the directions in the SGI ProPack documentation. Ensure that you select the SGI Licensed package group.
Ensure that the necessary XVM and GUI infrastructure packages from the SGI ProPack v3.0 for Linux - Proprietary Software CD have been installed:
XVM:
[root@linux-64 root]# rpm -q xvm-cmds xvm-cmds-3.0-sgi240c1
If this package is not installed, install the following RPMs from the SGI ProPack v3.0 for Linux - Proprietary Software CD:
[root@linux-64 PP_CDROM]# rpm -Uvh xvm-cmds-3.0-sgi300c1.ia64.rpm \ xvm-standalone-module-3.0-sgi240c1.ia64.rpm Preparing... ########################################### [100%] 1:xvm-standalone-module ########################################### [ 50%] 2:xvm-cmds ########################################### [100%]
Note: The xvm-standalone-module RPM is installed at this stage to satisfy package dependencies. It will be replaced in a subsequent step. GUI infrastructure:
[root@linux-64 PP_CDROM]# rpm -qa | grep sysadm sysadm_xvm-client-2.1-sgi300c1 sysadm_xvm-server-2.1-sgi300c1 sysadm_base-lib-3.0-sgi300c1 sysadm_base-tcpmux-3.0-sgi300c1 sysadm_xvm-web-2.1-sgi300c1 sysadm_base-server-3.0-sgi300c1 sysadm_base-client-3.0-sgi300c1
If these packages are not installed, install them from the SGI ProPack v3.0 for Linux - Proprietary Software CD:
[root@linux-64 PP_CDROM]# rpm -Uvh sysadm_* Preparing... ########################################### [100%] 1:sysadm_base-client ########################################### [ 14%] 2:sysadm_base-lib ########################################### [ 28%] 3:sysadm_base-tcpmux ########################################### [ 42%] 4:sysadm_base-server ########################################### [ 57%] 5:sysadm_xvm-client ########################################### [ 71%] 6:sysadm_xvm-server ########################################### [ 85%] 7:sysadm_xvm-web ########################################### [100%]
Install the CXFS kernel libraries from the CXFS 3.2 Altix Server/Client and XVM Plexing for SGI ProPack 3.0 CD:
[root@linux-64 CXFS_CDROM]# rpm -Uvh cxfs-modules-3.2-sgi300a12.ia64.rpm Preparing... ########################################### [100%] 1:cxfs-modules ########################################### [100%]
Install the CXFS application binaries, documentation, and support tools from the CXFS 3.2 Altix Server/Client and XVM Plexing for SGI ProPack 3.0 CD:
[root@linux-64 CXFS_CDROM]# rpm -Uvh cxfs_* cluster_* Preparing... ########################################### [100%] 1:cluster_admin ########################################### [ 16%] 2:cluster_docs ########################################### [ 32%] 3:cluster_control ########################################### [ 48%] 4:cluster_services ########################################### [ 64%] 5:cxfs_util ########################################### [ 80%] 6:cxfs_cluster ########################################### [100%]
Note: If you have not yet installed the FLEXlm license file, you may get a warning at this point. Install the CXFS graphical user interface (GUI) packages from the CXFS 3.2 Altix Server/Client and XVM Plexing for SGI ProPack 3.0 CD:
[root@linux-64 CXFS_CDROM]# rpm -Uvh sysadm_* Preparing... ########################################### [100%] 1:sysadm_cxfs-client ########################################### [ 20%] 2:sysadm_cxfs-web ########################################### [ 40%] 3:sysadm_cluster_base-cli########################################### [ 60%] 4:sysadm_cluster_base-ser########################################### [ 80%] 5:sysadm_cxfs-server ########################################### [100%]
Reboot the system.
Caution: If XVM standalone was in use prior to CXFS installation, you should reboot the system before starting CXFS services to ensure that the new xvm modules are loaded.
The CXFS client-only software will be initially installed and configured by SGI personnel. This section provides an overview of those procedures. You can use the information in this section to verify the installation.
| Note: Package version numbers shown here are examples; your installed system may differ. |
Installing the Linux 64-bit client requires approximately 60 MB of space, depending upon the packages installed at your site.
To install the required software on a Linux 64-bit node, SGI personnel will do the following:
Read the README file for the Linux 64-bit platform to learn about any late-breaking changes in the installation procedure.
Install SGI ProPack 3.0 for Linux release, according to the directions in the SGI ProPack documentation. Ensure that you select the SGI Licensed package group.
Ensure that the necessary XVM package from the SGI ProPack v3.0 for Linux - Proprietary Software CD has been installed:
[root@linux-64 root]# rpm -q xvm-cmds xvm-cmds-3.0-sgi300c1
If this package is not installed, install the following RPMs from the SGI ProPack v3.0 for Linux - Proprietary Software CD:
[root@linux-64 PP_CDROM]# rpm -Uvh xvm-cmds-3.0-sgi300c1.ia64.rpm \ xvm-standalone-module-3.0-sgi300c1.ia64.rpm Preparing... ########################################### [100%] 1:xvm-standalone-module ########################################### [ 50%] 2:xvm-cmds ########################################### [100%]
Note: The xvm-standalone-module RPM is installed at this stage to satisfy package dependencies. It will be replaced in a subsequent step. Install the CXFS kernel libraries from the CXFS 3.2 Altix Server/Client and XVM Plexing for SGI ProPack 3.0 CD:
[root@linux-64 CXFS_CDROM]# rpm -Uvh cxfs-modules-3.2-sgi300a12.ia64.rpm Preparing... ########################################### [100%] 1:cxfs-modules ########################################### [100%]
Install the CXFS application binaries, documentation, and support tools from the CXFS 3.2 Altix Server/Client and XVM Plexing for SGI ProPack 3.0 CD:
[root@linux-64 CXFS_CDROM]# rpm -Uvh cxfs_client-3.2-sgi300a4.ia64.rpm \ cxfs_util-3.2-sgi300a4.ia64.rpm \ cxfs_docs-3.2-sgi300a4.ia64.rpm Preparing... ########################################### [100%] 1:cxfs_util ########################################### [ 33%] 2:cxfs_client ########################################### [ 66%] 3:cxfs_docs ########################################### [100%]
Reboot the system.
Caution: If XVM standalone was in use prior to CXFS installation, you should reboot the system before starting CXFS services to ensure that the new xvm modules are loaded.
If you want to use the cluster diagnostics to test node connectivity, the root user on the node running the CXFS diagnostics must be able to access a remote shell using the rsh command (as root) on all other nodes in the cluster. There are several ways of accomplishing this, depending on the existing settings in the pluggable authentication modules (PAM) and other security configuration files.
Following is one possible method that works with default settings. Do the following on all administration nodes in the cluster:
After you have completed running the connectivity tests, you may wish to disable rsh on all cluster nodes.
For more information, see the Red Hat documentation and the hosts.equiv man page.