Chapter 4 Administering Sun Cluster Support for Oracle Real Application Clusters

This chapter explains how to administer Sun Cluster Support for Oracle Real Application Clusters on your Sun Cluster nodes.

• Overview of Administration Tasks for Sun Cluster Support for Oracle Real Application Clusters

• Tuning Sun Cluster Support for Oracle Real Application Clusters

• Removing Sun Cluster Support for Oracle Real Application Clusters

Overview of Administration Tasks for Sun Cluster Support for Oracle Real Application Clusters

Table 4–1 summarizes the administration tasks for Sun Cluster Support for Oracle Real Application Clusters.

Perform these tasks whenever they are required.

Tuning Sun Cluster Support for Oracle Real Application Clusters

To tune the Sun Cluster Support for Oracle Real Application Clusters data service, you modify the extension properties of the resources for this data service. For details about these extension properties, see Appendix A, Sun Cluster Support for Oracle Real Application Clusters Extension Properties. Typically, you use the command line scrgadm -x parameter=value to set extension properties when you create the Sun Cluster Support for Oracle Real Application Clusters resources. You can also use the procedures in Chapter 2, Administering Data Service Resources, in Sun Cluster Data Services Planning and Administration Guide for Solaris OS to configure the resources later.

Guidelines for Setting Timeouts

Many of the extension properties for Sun Cluster Support for Oracle Real Application Clusters specify timeouts for steps in reconfiguration processes. The optimum values for most of these timeouts are independent of your cluster configuration. Therefore, you should not need to change the timeouts from their default values.

Timeouts that depend on your cluster configuration are described in the subsections that follow. If timeouts occur during reconfiguration processes, increase the values of these timeout properties to accommodate your cluster configuration.

SPARC: VxVM Component Reconfiguration Step 4 Timeout

The time that is required for step 4 of a reconfiguration of the VxVM component of Sun Cluster Support for Oracle Real Application Clusters is affected by the size and complexity of your VERITAS shared-disk group configuration. If your VERITAS shared-disk group configuration is large or complex and the reconfiguration of the VxVM component times out, increase the timeout for step 4 of a reconfiguration of the VxVM component.

To increase the timeout for step 4 of a reconfiguration of the VxVM component, increase the value of the Cvm_step4_timeout extension property of the SUNW.rac_cvm resource.

For more information, see SPARC: SUNW.rac_cvm Extension Properties.

Example 4–1 Setting the VxVM Component Reconfiguration Step 4 Timeout

# scrgadm -c -j rac_cvm -x cvm_step4_timeout=1200

This example sets the timeout for step 4 of a reconfiguration of the VxVM component to 1200 seconds. This example assumes that the VxVM component is represented by an instance of the SUNW.rac_cvm resource type that is named rac_cvm.

Reservation Step Timeout

The time that is required for reservation commands to run is affected by the following factors:

• The number of shared physical disks in the cluster

• The load on the cluster

If the number of shared physical disks in the cluster is large, or if your cluster is heavily loaded, the reconfiguration of Sun Cluster Support for Oracle Real Application Clusters might time out. If such a timeout occurs, increase the reservation step timeout.

To increase the reservation step timeout, increase the Reservation_timeout extension property of the appropriate resource for your storage management scheme.

Details of the extension properties of these resource types are available in the following sections:

• SUNW.rac_svm Extension Properties

• SPARC: SUNW.rac_cvm Extension Properties

• SUNW.rac_hwraid Extension Properties

Example 4–2 Setting the Reservation Step Timeout

# scrgadm -c -j rac_hwraid -x reservation_timeout=350

This example sets the timeout for the reservation step of a reconfiguration of Sun Cluster Support for Oracle Real Application Clusters to 350 seconds. In this example, the cluster uses hardware RAID support. This example assumes that the hardware RAID component is represented by an instance of the SUNW.rac_hwraid resource type that is named rac_hwraid.

SPARC: Guidelines for Setting the Communications Port Range for the Oracle UDLM

An application other than the Oracle UDLM on a cluster node might use a range of communications ports that conflicts with the range for the Oracle UDLM. If such a conflict occurs, modify the range of communications ports that the Oracle UDLM uses.

The range of communications ports that the Oracle UDLM uses is determined by the values of the following extension properties of the SUNW.rac_udlm resource type:

• Port. Specifies the communications port number that the Oracle UDLM uses. The first number in the range of communications port numbers that the Oracle UDLM uses is the value of Port.

• Num_ports. Specifies the number of communications ports that the Oracle UDLM uses. The last number in the range of communications port numbers that the Oracle UDLM uses is the sum of the values of Port and Num_ports.

For more information, see SPARC: SUNW.rac_udlm Extension Properties.

Example 4–3 Setting the Communications Port Number for the Oracle UDLM

# scrgadm -c -j rac_udlm -x port=7000

This example sets the communications port number that the Oracle UDLM uses to 7000. The following assumptions apply to this example:

• The Oracle UDLM component is represented by an instance of the SUNW.rac_udlm resource type that is named rac_udlm.

• The command in this example is run as part of the procedure for modifying an extension property that is tunable only when disabled. For more information, see How to Modify an Extension Property That Is Tunable Only When a Resource Is Disabled.

How to Modify an Extension Property That Is Tunable Only When a Resource Is Disabled

Restrictions apply to the circumstances in which you can modify an extension property that is tunable only when a resource is disabled. Those circumstances depend on the resource type as follows:

• SUNW.rac_udlm – Only when the Oracle UDLM is not running on any cluster node

• SUNW.rac_cvm – Only when VxVM is not running in cluster mode on any cluster node

Steps

1. Disable each resource that the RAC framework resource group contains and bring the RAC framework resource group into the UNMANAGED state.

   Disable the instance of the SUNW.rac_framework resource only after you have disabled all other resources that the RAC framework resource group contains. The other resources in the RAC framework resource group depend on the SUNW.rac_framework resource.

   For detailed instructions, see Disabling Resources and Moving Their Resource Group Into the UNMANAGED State in Sun Cluster Data Services Planning and Administration Guide for Solaris OS.

2. Reboot all the nodes that are in the node list of the RAC framework resource group.

3. Use the scrgadm utility to set the property to its new value.

   # scrgadm -c -j resource -x property=value

   -j resource

   Specifies the name of the resource for which you are modifying an extension property. If this resource was created by using the scsetup utility, the name depends on the resource type, as shown in Names Assigned to RAC Framework Resources by scsetup.

   property

   Specifies the name of the extension property that you are changing.

   value

   The new value of the extension property.

4. Bring the RAC framework resource group and its resources online.

   # scswitch -Z -g resource-group

   -Z

   Enables the resource and monitor, moves the resource group to the MANAGED state, and brings the resource group online.

   -g resource-group

   Specifies the name of the RAC framework resource group that is to be moved to the MANAGED state and brought online. If this resource group was created by using the scsetup utility, the name of the resource group is rac-framework-rg.

Removing Sun Cluster Support for Oracle Real Application Clusters

You can remove Sun Cluster Support for Oracle Real Application Clusters from the following entities:

• A cluster. For more information, see How to Remove Sun Cluster Support for Oracle Real Application Clusters From a Cluster.

• Selected nodes in a cluster. For more information, see How to Remove Sun Cluster Support for Oracle Real Application Clusters From Selected Nodes.

How to Remove Sun Cluster Support for Oracle Real Application Clusters From a Cluster

The cluster node from which you perform this task must be booted in cluster mode.

Steps

1. On one node of the cluster, become superuser.

2. Remove all RAC server resource groups in the cluster.

   These resource groups were created as explained in How to Register and Configure Oracle RAC Server Resources.

   Remove each RAC server resource group as follows:

   1. Disable each RAC server resource in the resource group.

      For each resource, type the following command:

      # scswitch -n -j resource

      -j resource

      Specifies the resource that you are disabling

   2. Remove each RAC server resource in the resource group.

      For each resource, type the following command:

      # scrgadm -r -j resource

      -j resource

      Specifies the resource that you are removing

   3. Remove the RAC server resource group.

      # scrgadm -r -g rac-server-rg

      -g rac-server-rg

      Specifies the resource group that you are removing

3. Remove the RAC framework resource group.

   ---

   Note –

   The following instructions explain how to perform this operation by using the scsetup utility. For information about how to perform this operation by using the scrgadm utility, see How to Remove the RAC Framework Resource Group by Using the scrgadm Utility.

   ---

   1. Start the scsetup utility.

      # scsetup

      The scsetup main menu is displayed.

   2. Type the number that corresponds to the option for data services.

      The Data Services menu is displayed.

   3. Type the number that corresponds to the option for configuring Sun Cluster Support for Oracle Real Application Clusters.

      The Sun Cluster Support for Oracle RAC menu is displayed.

   4. Type the number that corresponds to the option for removing the RAC framework resource group.

      The scsetup utility displays a list of the cluster nodes on which the RAC framework resource group exists. The scsetup utility also asks you to confirm that the RAC framework resource group should be removed from these nodes.

   5. To confirm that the scsetup utility should remove the RAC framework resource group from the listed nodes, type y.

      The scsetup utility removes the RAC framework resource group and the resources that this resource group contains from the listed nodes.

4. Boot each node in the cluster in noncluster mode.

5. From each node in the cluster, uninstall the Sun Cluster Support for Oracle Real Application Clusters software packages for the storage management scheme that you are using for the Oracle Real Application Clusters database.

   ---

   x86 only –

   If you are using the x86 platform, ignore references to the SUNWudlm package and the SUNWudlm package in the commands that follow.

   ---

   • If you are using Solaris Volume Manager for Sun Cluster, type the following command:

     # pkgrm SUNWscucm SUNWudlm SUNWudlmr SUNWscmd

   • If you are using VxVM with the cluster feature, type the following command:

     # pkgrm SUNWscucm SUNWudlm SUNWudlmr SUNWcvmr SUNWcvm

   • If you are using hardware RAID, Sun StorEdge QFS, Network Appliance NAS devices, or ASM without a volume manager, run the following command:

     # pkgrm SUNWscucm SUNWudlm SUNWudlmr SUNWschwr

   ---

   Note –

   To prevent the userland cluster membership monitor (UCMM) daemon ucmmd from being started when the cluster is rebooted, you must uninstall the Sun Cluster Support for Oracle Real Application Clusters software packages.

   ---

How to Remove Sun Cluster Support for Oracle Real Application Clusters From Selected Nodes

Steps

1. Become superuser.

2. Boot in noncluster mode the nodes from which you are removing Sun Cluster Support for Oracle Real Application Clusters.

3. Remove the nodes from the RAC framework resource group.

   ---

   Note –

   The following instructions explain how to perform this operation by using the scsetup utility. For information about how to perform this operation by using the scrgadm utility, see How to Remove Nodes From the RAC Framework Resource Group by Using the scrgadm Utility.

   ---

   1. Start the scsetup utility.

      # scsetup

   2. Type the number that corresponds to the option for data services.

      The Data Services menu is displayed.

   3. Type the number that corresponds to the option for configuring Sun Cluster Support for Oracle Real Application Clusters.

      The Sun Cluster Support for Oracle RAC menu is displayed.

   4. Type the number that corresponds to the option for removing a node from the RAC framework resource group.

      The scsetup utility responds as follows:

      • The list of nodes in the RAC framework resource group is displayed.

      • The scsetup utility prompts you for the list of nodes that you are removing.

   5. Type a comma-separated list of the nodes that you removing from the RAC framework resource group.

4. (Optional) From each node that you removed, uninstall the Sun Cluster Support for Oracle Real Application Clusters software packages for the storage management scheme that you are using for the Oracle Real Application Clusters database.

   ---

   x86 only –

   If you are using the x86 platform, ignore references to the SUNWudlm package and the SUNWudlm package in the commands that follow.

   ---

   • If you are using Solaris Volume Manager for Sun Cluster, type the following command:

     # pkgrm SUNWscucm SUNWudlm SUNWudlmr SUNWscmd

   • If you are using VxVM with the cluster feature, type the following command:

     # pkgrm SUNWscucm SUNWudlm SUNWudlmr SUNWcvmr SUNWcvm

   • If you are using hardware RAID, Sun StorEdge QFS, Network Appliance NAS devices, or ASM without a volume manager, type the following command:

     # pkgrm SUNWscucm SUNWudlm SUNWudlmr SUNWschwr