10.1 Factory-Assembled SPARCcluster 2000 High Availability Hardware

The basic configuration is completely pre-assembled in two cabinets.

---

Note - If you are installing a customer-assembled system, see Section 10.2, "Customer-Assembled SPARCcluster 2000 High Availability Hardware."

---

10.1.1 Preparing the Cabinets

1. Unpack and inventory the equipment, if you have not already done so.

   See Chapter 1, "Checklist" for a list of equipment.

2. Move the cabinets to their designated installation locations.

   For site planning guidelines, Refer to Chapter 6, "SPARCcluster 2000 High Availability Configurations."

3. Turn front panel key switch to the standby position.

Figure 10-1

4. Set the LOCAL/REMOTE switch to REMOTE. See Figure 10-2.

10.1.2 Connecting the Power Cords

1. Remove the cabinet panels to access the power switches and cables.

   See Section 8.1, "Removing System and Expansion Cabinet Panels"

2. Level the cabinet.

   See Section 8.2, "Leveling the Cabinets"

3. Turn the AC distribution unit power switch to Off.

   The switch is at the rear of the cabinet. See Figure 10-3.

---

Warning - The power must be turned off at the AC distribution unit or risk of electrical shock to personnel exists.

---

---

Caution - Do not disconnect the power cord when working on the system. This connection provides a ground path that prevents damage from electrostatic discharge.

---

Figure 10-3

4. Uncoil the AC power cord and connect it to an AC outlet.

   As noted in Chapter 4, "Site Preparation and Planning," the AC outlet should be part of a circuit dedicated to this system. Do not connect electrical motors or heaters to this circuit.

5. Plug in AC cords to provide grounding for static electricity.

10.2 Customer-Assembled SPARCcluster 2000 High Availability Hardware

Do tasks in the order listed
Preparing the Cabinet	page 10-5
Accessing the Cabinets -- Removing the Panels	page 10-5
Installing the Cabinets	page 10-5
Connecting the Main AC Cord	page 10-6
Installing SPARCstorage Arrays	page 10-6
Installing the Terminal Concentrator	page 10-9
Installing the Boot Disks	page 10-14
Configuring the Card Cages	page 10-18
Cabling System Components	page 10-19

10.2.1 Preparing the Cabinet

10.2.1.1 Powering Off the Cabinets

If the SPARCcenter 2000 cabinets are powered and operating, halt the operating systems and power off the system and expansion cabinets. See Section 7.2, "SPARCcluster 2000 High Availability Server."

10.2.1.2 Accessing the Cabinets -- Removing the Panels

Remove the cabinet panels to access the power switches and cables. See Chapter 8, "Access."

10.2.2 Installing the Cabinets

1. Unplug AC cords and all cabling to allow repositioning of the cabinets.

2. Move the cabinets to their designated installation locations.

   See Chapter 4 for site planning guidelines.

---

Note - When moving the cabinets, it is advisable to replace all panels to protect inner components during transport.

---

3. Level the cabinet(s).

   See Chapter 8, Section 8.2, "Leveling the Cabinets."

10.2.3 Connecting the Main AC Cord

1. For all AC-powered internal components, plug in AC cords to provide grounding for static electricity.

---

Caution - Do not disconnect the power cord when working on the system. This connection provides a ground path that prevents damage from electrostatic discharge.

---

2. Turn front panel key switch (Figure 10-1) to the standby position.

3. Turn the AC distribution unit power switch to Off.

   The switch is at the rear of the cabinet. See Figure 10-3.

---

Warning - The switch must be turned off at the cabinet AC distribution unit or risk of electrical shock to personnel exists.

---

4. Uncoil the AC power cord and connect it to an AC outlet.

   The AC outlet should be part of a circuit dedicated to this system. Do not connect electrical motors or heaters to this circuit.

10.2.4 Installing SPARCstorage Arrays

Three or more SPARCstorage arrays are installed in the cluster. These devices provide storage for the high availability data -- NFS file systems and HA DBMS databases.

The cluster contains two identically-configured SPARCcenter 2000E systems.

10.2.4.1 Mounting in the Cabinet

* Install the rails in the cabinets and install the SPARCstorage arrays on the rails.

For these procedures, See Appendix A, "Air Baffle, Rack Mount Rail and Blower Assembly Installation."

10.2.4.2 Preparing the SPARCstorage Arrays

1. Locate the DIAG switch on the array rear panel.

   See Figure 10-4.

2. Ensure that the DIAG switch is set to DIAG and not to DIAG EXT.

   Do not use the DIAG EXT position as it will invoke extended diagnostics and prevent the SPARCstorage array from booting. Leave the switch only in the DIAG position for normal operation.

Number Label

3. Locate the serial number label on the rear panel of the chassis.

   See Figure 10-4.

4. Check the electrical ratings label on the serial number label. Verify that the stated rating matches your AC input voltage.

Table 10-1 provides maximum system operating voltage and frequency ranges.

Table 10-1

Configuration	Nominal AC Input Voltage Range - Single Phase	Operating Range	Operating Frequency Range
North American	100-120 VAC	90-264 VAC	47-63 Hz
International	220-240 VAC	90-264 VAC	47-63 Hz

Table 10-2 lists current requirements at nominal line voltage for a SPARCstorage array.

Table 10-2

Configuration	Maximum Current Requirement	Power Supply Output
North American, Japan, and International	6.5A	460W

5. Connect SPARCstorage array power cords.

   a. Plug a power cord into the connector at rear of each array.

   See Figure 10-5.

b. Route the power cords to the power distribution unit:

Dress the power cords down the left side of the rack. Roll any excess cord and tuck it into the space under the power distribution unit at the bottom of the cabinet. Secure in place using cable ties.

6. Plug in the SPARCstorage arrays.

   Plug the power cords from the chassis into the power distribution unit. Use the switched outlets identified in Figure 10-6 for SPARCstorage array 0 and 1.

Figure 10-6

Power Distribution Unit

7. Turn the AC power switch to ON on all SPARCstorage arrays and servers.

   See Figure 10-5.

10.2.5 Installing the Terminal Concentrator

Install the terminal concentrator mounting bracket in the primary cabinet.

1. Install the terminal concentrator bracket hinge:

   a. Locate the hinge portion of the terminal concentrator bracket assembly. b. Install the locator screws.

   Loosely install two locator screws in the right-hand rail in the rear of the cabinet. Thread them into holes 8 and 30 as shown in Figure 10-7.

---

Note - The locator screws will accept the slotted holes in the hinge piece.

---

c. Place slotted holes of the hinge over the locator screws and allow it to drop into place.

d. Install screws in holes 9 and 29.

Tighten these screws as well as those in holes 8 and 30. See Figure 10-7.

2. Install the terminal concentrator in the bracket and assemble the bracket.

   a. Place the side pieces of the bracket against the terminal concentrator as shown in Figure 10-8.

b. Lower the terminal concentrator (with side pieces) onto the bottom

plate. Align holes in the side pieces with those in the bottom plate.

c. Install three nuts on threaded studs penetrating through each side

plate. Tighten the nuts.

This completes assembly of the bracket assembly.

3. Install the terminal concentrator bracket onto the hinge in the chassis.

   Turn the terminal concentrator bracket on its side so the hinge-holes and

   cable connectors face right. Align bracket holes with boss pins in the hinge

   assembly and drop the bracket onto the hinge. See Figure 10-9.

4. Install the keeper screw in the shorter boss pin.

   This ensures the assembly will not be accidently knocked off the hinge.

5. Connect the power cord:

   a. At the rear of the terminal concentrator, install the power cord.

   See Figure 10-10.

   b. Plug the other end into the AC power distribution unit.

   See Figure 10-11.

6. Close the terminal concentrator bracket.

   Swing the bracket assembly closed and install screws in holes 8 and 30 on the left side rail.

into the AC Power Distribution Unit

10.2.6 Installing the Boot Disks

Install the boot disk bracket in the front of the cabinets.

10.2.6.1 Node 0 Cabinet

1. Locate the hinge portion of the boot disk bracket assembly.

2. Thread screws in a few turns in holes 27 and 11 on the side of the rail on the left side.

   These screws will be used to hang the hinge on. See Figure 10-12.

3. Hang the hinge on the two screws installed in step 2.

4. Install the remaining four screws:

• Holes 24 and 12 on the side
• Holes 26 and 10 from the front Tighten all screws. See Figure 10-12.

5. Determine if the SCSI addresses for the devices within the Multi-Disk Pack are correct.

   Since the Multi-Disk Pack can be ordered in a four or two disk drive version, the default factory-set addressing for devices within the unit differs between the two versions. Determine which version you have:

   a. Find the part number on the Multi-Disk Pack.

• Part Number X739A denotes the 4 disk drive version. SCSI addressing is factory set to 0 through 3. This is correct. Proceed to step 6.
• Part Number X738A denotes the 2 disk drive version. SCSI addressing is factory set to 1 and 3. This is incorrect. Proceed with step b.

  b. Set the SCSI addresses for the two drives to 0 and 1 for boot disks 0 and 1 respectively.

  For this procedure, refer to the Multi-Disk-Pack Installation and Service Guide, Part Number 801-6119, for SCSI address switch access and locations within the unit, and address setting information. Then, proceed to step 6.

6. Install the boot disk enclosure in the bracket and assemble the bracket.

   a. Lay the bottom plate on a surface as shown in Figure 10-13.

b. Place the boot disk on the bottom plate.

Orient the unit as shown in Figure 10-13.

c. Place the top plate over the enclosure and lower it so it contacts the bottom plate. Align holes with threaded studs in the bottom plate. d. Assemble the top and bottom plates.

Install four nuts (two on each side) on threaded studs which penetrate through holes in the top plate. Tighten the nuts.

This completes assembly of the bracket assembly.

7. Install the boot disk bracket onto the hinge in the chassis.

   Turn the boot disk bracket on its side so the hinge-holes and boot disk cable connectors face left. Align bracket holes with boss pins in the hinge assembly and drop the bracket onto the hinge. See Figure 10-14.

8. Install the keeper screw in the shorter boss pin.

   This ensures the assembly will not be accidently knocked off the hinge.

9. Connect the power cord.

   Plug the cord female end into boot disk power connector on the rear panel. Plug the male end into the AC power distribution unit. See Figure 10-11.

---

Note - The power cord may be a Y-block type cord with two female connectors. If it is, leave the second female connector unused, and secure it out of the way using cable ties as necessary.

---

10. Close the boot disk bracket.

    Swing the boot disk bracket assembly closed and install screws in holes 26 and 10 on the right-side rail.

10.2.6.2 Node 1 Cabinet

Repeat Section 10.2.6.1, "Node 0 Cabinet," for the node 1 cabinet.

10.2.7 Configuring the Card Cages

For instructions on removing the system board, refer to documentation supplied with the system boards or the SPARCcenter 2000 Service Manual.

10.2.7.1 SBus Cards

If SBus cards or other devices are to be installed, do it now.

1. Load the system boards 0 through 9 as appropriate with the intended SBus card complement.

   For SBus card installation procedures, refer to documentation supplied with the card(s) in question or the SPARCcenter 2000 Service Manual.

2. Configure card cages in both cabinets.

3. Once the system capacity is determined

   a. Install system boards in all indicated slots in both nodes b. Install the appropriate SBus cards to support the SPARCstorage arrays and other required functions in both nodes

---

Note - Load the respective system boards for both servers identically.

---

---

Note - Beyond minimum configuration it is recommended that FC/S cards be installed in the first available empty SBus slot, following all other boards in the system. This will ensure that the controller numbering is preserved if the Solaris Operating Environment is reinstalled. Refer to Section 2 of the SPARCcluster High Availability Software Administration Guide for a discussion of problems that can arise if this recommendation is ignored.

---

10.2.7.2 System Boards

1. Install the system boards loaded with SBus cards into the card cage.

   For system board installation procedures, refer to documentation supplied with the system boards or the SPARCcenter 2000 Service Manual.

2. Fill all unused slots with a filler panel. See Figure 10-15.

SBus Cards

10.2.8 Cabling System Components

Ethernet and SCSI II cabling is presented in Table 10-3. Procedures for connecting each cable follow the table.

---

Note - For fiber optic cable connections, refer to Table 10-4 and Table 10-5.

---

Table 10-3

Category	Step Interface type		Cable type	Part No.	From	To
Terminal Concentrator					Terminal concentrator
	1.	Serial	RS-232 and serial		Port 1	Admin. workstn. Serial A
	2.	Serial	RS-232 and serial		Port 2	Node 0, board 0, Serial A
	3.	Serial	RS-232 and serial		Port 3	Node 1, board 0, Serial A
	4.	Ethernet	AUI or TPE		Ethernet	Client network
Admin. Workstation	5.	Ethernet	AUI or TPE		Admin. workstation	Client network
Node-to- node	6.	SFE 100 Mbit Ethernet	TPE	530-2149 (short) 530-2150 (long)	Node 0, board 0, slot 1	Node 1, board 0, slot 1
	7.	Same		Same	Node 0, board 1, slot 0	Node 1, board 1, slot 0
Node-to- main network	8.	Ethernet	AUI or TPE		Node 0, board 0, slot 0 FSBE/S card -- le0	Main Ethernet network
	9.	Same	Same		Node 1, board 0, slot 0 FSBE/S card -- le0	Main Ethernet network
Client Net	10.	Client net Ethernet	TPE		Node 0, board 1, slot 2	Client network
	11.				Node 0, board 2, slot 2	Client network
	12.				Node 1, board 1, slot 2	Client network
	13.				Node 1, board 2, slot 2	Client network
SCSI Tray	14.	FSBE/S	SCSI II		Node 0, board 0, slot 3	SCSI II IN connector on bulkhead below cardcage

Table 10-3 (Continued)

Category	Step Interface type		Cable type	Part No.	From	To
	15.					Install terminator on SCSI II OUT connect. on bulkhead below cardcage
	16.	FSBE/S	SCSI II		Node 1, board 0, slot 3	SCSI II IN connector on bulkhead below cardcage
	17.					Install terminator on SCSI II OUT connect. on bulkhead below cardcage
Boot Disks	18.	FSBE/S	SCSI II		Node 0, board 0, slot 0	Boot disk IN
	19.					Install terminator on boot disk OUT
	20.	FSBE/S	SCSI II		Node 1, board 0, slot 0	Boot disk IN
	21.					Install terminator on boot disk OUT

10.2.8.1 Connecting the Administration workstation

---

Warning - DO NOT plug a keyboard directly to a node system board. If a keyboard is plugged into a system board, it then becomes the default for console input, thus preventing input from the system administration workstation/terminal concentrator serial port. In addition, plugging a keyboard directly into a node system board while power is applied to the node sends a break signal to the Solaris operating system, just as if you had typed a L1-A on the console.

---

1. Plug one end of cable PN 530-2152 into the terminal concentrator, Port 1. See Figure 10-16.

2. Plug the other end into the administration workstation RS-232 connector.

3. Plug the client network Ethernet cable into the administration workstation Ethernet socket.

10.2.8.2 Connecting the Terminal Concentrator

1. Node 0:

   a. Plug one end of the RJ-45 cable into the Serial A port on the system board in slot 0 in node 0. See Figure 10-16.

   b. Plug the other end of this cable into the terminal concentrator, port 2.

2. Node 1:

   a. Plug one end of the RJ-45 cable into the Serial A port on the system board in slot 0 in node 1. See Figure 10-17.

   b. Plug the other end of this cable into the terminal concentrator, port 3.

3. Public net Ethernet.

   Plug the public net Ethernet cable into the AUI or RJ-45 connector on the terminal concentrator. See Figure 10-17.

10.2.8.3 Connecting Node 0 to Node 1 -- Private Net Ethernet

With two Sun private net cables (short or long), connect one SPARCcluster 2000 High Availability node to the other.

---

Note - Use short and long Sun private net cables as appropriate: 530-2149 (short) 530-2150 (long).

---

1. First cable (see Figure 10-18):

   a. Connect one end of the Sun private net cable to the SFE 100 Mbit Ethernet card in system board slot 0, SBus position 1. b. Connect the other end to the identical system board and SBus card in the other node.

2. Second cable (refer to Figure 10-18):

   a. Connect one end of the Sun private net cable to the SFE 100 Mbit Ethernet card in system board slot 1, SBus position 0. b. Connect the other end to the identical system board and SBus card in the other node.

3. Connect any remaining cables.

   For your reference, Table 10-3 summarizes the cables that can be connected at this time. Your system may have more network cables listed in this table.

10.2.8.4 Boot Disks (in the Node 0 Cabinet)

Using one cable and a regulated terminator, connect the boot disk (see Figure 10-19 and Table 10-3).

1. Node 0 Cabinet:

   a. Plug one end of the SCSI cable into the FSBE/S card in board 0, slot 0. b. Plug the other end into the IN connector of the boot disk enclosure.

2. Install a regulated terminator on the OUT connector of the boot disk enclosure.

Node 1 * Repeat steps 1 and 2 on node 1.

10.2.8.5 Internal SCSI Tray

1. Plug one end of a cable into the FSBE/S card in board 0, slot 4.

   See Figure 10-20 and Table 10-3.

2. Plug the other end into the IN connector of the bulkhead SCSI II panel.

   This panel is located below the card cage and to the left.

3. Install a terminator on the OUT connector of the bulkhead SCSI II panel.

10.2.8.6 Connecting the SPARCstorage Arrays

Installing the Second FC/OM Optical Module in all SPARCstorage Arrays.

Install a second optical module in each SPARCstorage array using instructions provided with the FC/OM optical module.

Labeling Fiber Optic Cables Fiber optic cables must be labeled prior to installation. Labeling ensures accurate installation and eases system reconfiguration and expansion later.

The suggested fiber optic cable labeling scheme for any given cable is:

• one end connects to an FC/OM module in node 0 or 1 (cabinet A or B)

the other end connects to a FC/OM module in the SPARCstorage array of a given elevation in cabinet A through F (elevations are denoted by color from bottom to top, white, yellow, orange, red, and blue.

Affix labels to each cable, both ends, with the node, cabinet and elevation information imprinted on it. Use Figure 10-21 as a guide.

Labeling Detail

Cabling 1. Plug one end of the fiber cable into the FC/OM on the SBus card. See Figure 10-22.

2. Plug the other end of the fiber cable into the FC/OM connector or the SPARCstorage array rear panel.

   Plug node 0 into connector A and node 1 into connector B. Repeat to connect both nodes to all SPARCstorage arrays. See Figure 10-22. See Table 10-4 and Table 10-5 for list of all fiber optic cable connections. See Figure 10-23 for all point-to-point connections in a maximum configuration.

3. Repeat steps 1 and 2 for all FC/OM cables to be connected.

4. Dress and secure all cables using cable ties as required.

Table 10-4

	1 From Server				To SPARCstorage Array 100
	2 Node 0	4 Node 1	Cabinet A		Cabinet B	Cabinet C	Cabinet D	Cabinet E	Elevation
System Bd.	SBus Slot	SBus Slot	Array/Slot	Array/Slot		Array/Slot	Array/Slot	Array/Slot	(Color)
0	3 0	3 0
	3 1	3 1
	2		0 slot A						Yellow
		2	0 slot B						Yellow
	3 3	3 3
1	3 0	3 0
	1		1 slot A						White
		1	1 slot B						White
	3 2	3 2
	3 3	3 3
2	0				2 slot A				Yellow
		0			2 slot B				Yellow
	1				3 slot A				White
		1			3 slot B				White
	3 2	3 2
	3					4 slot A			Blue
		3				4 slot B			Blue
3	0					5 slot A			Red
		0				5 slot B			Red
	1					6 slot A			Orange
		1				6 slot B			Orange
	2					7 slot A			Yellow
		2				7 slot B			Yellow

Table 10-4 (Continued)

	1 From Server				To SPARCstorage Array 100
	2 Node 0	4 Node 1	Cabinet A		Cabinet B	Cabinet C	Cabinet D	Cabinet E	Elevation
System Bd.	SBus Slot	SBus Slot	Array/Slot	Array/Slot		Array/Slot	Array/Slot	Array/Slot	(Color)
	3					8 slot A			White
		3				8 slot A			White
4	0						9 slot A		Blue
		0					9 slot B		Blue
	1						10 slot A		Red
		1					10 slot B		Red
	2						11 slot A		Orange
		2					11 slot B		Orange
	3						12 slot A		Yellow
		3					12 slot B		Yellow
5	0						13 slot A		White
		0					13 slot A		White
	1							14 slot A	Blue
		1						14 slot B	Blue
	2							15 slot A	Red
		2						15 slot B	Red
	3							16 slot A	Orange
		3						16 slot B	Orange
6	0							17 slot A	Yellow
		0						17 slot B	Yellow
	1							18 slot A	White
		1						18 slot B	White

1. All connections are made by using optical fiber cable Part No. 537-1004, 2 meter or Part No. 537-1006. 15 meter as appropriate.

2. Cabinet A.

3. See Table 10-3.

4. Cabinet B.

Table 10-5

	1 From Server			To SPARCstorage Array 100
	2 Node 0	3 Node 1	Cabinet F				Elevation
System Bd.	SBus Slot	SBus Slot	Array #/Slot #				(Color)
6	2		19 slot A				Blue
		2	19 slot B				Blue

1. All connections are made by using optical fiber cable Part No. 537-1004, 2 meter or Part No. 537-1006. 15 meter as appropriate.

2. Cabinet A.

3. Cabinet B.

10.3 Closing the Cabinet

* Replace all panels on the cabinet.

See Chapter 8, "Access" for procedures.

Proceed to Chapter 11 for terminal concentrator configuration procedures.

For other software installation, refer to the

• SPARCcluster High Availability Software Planning and Installation Guide, or the
• SPARCcluster High Availability Server Administration Guide