Jump to content United States-English
HP.com Home Products and Services Support and Drivers Solutions How to Buy
» Contact HP
More options
HP.com home
HP XC System Software: Hardware Preparation Guide > Chapter 2 Making Node and Switch Connections

Switches

» 

Technical documentation

Complete book in PDF
» Feedback
Content starts here

 » Table of Contents

 » Glossary

 » Index

The following topics are addressed in this section:

Specialized Switch Use

The following describes the specialized uses of switches in an HP XC system.

IMPORTANT: Switch use is not strictly enforced on HP XC systems with HP server blades.

For more information about switch use with HP server blades, see the HP XC Systems With HP Server Blades and Enclosures HowTo, which is available at the following Web site:

http://www.docs.hp.com/en/highperfcomp.html

Super Root Switch,

This switch is the top level switch in a large-scale system, that is, an HP XC system with more than 512 nodes requiring more than one Root Administration switch. Root Administration switches are connected directly to this switch.

Root Administration Switch,

This switch connects directly to Gigabit Ethernet ports of the head node, the Root Console Switch, Branch Administration Switches, and other nodes in the utility cabinet.

Root Console Switch,

This switch connects to the Root Administration Switch, Branch Console Switches, and connects to the management console ports of nodes in the utility cabinet.

Branch Administration Switch,

This switch connects to the Gigabit Ethernet ports of compute nodes and connects to the Root Administration Switch.

Branch Console Switch,

This switch connects to the Root Console Switch and connects to the management console ports of the compute nodes.

Table 2-1 lists the switch models that are supported for each use.

Table 2-1 Supported Switch Models

Switch UseProCurve Switch Model
Administration SwitchProCurve 2848 or 2824
Console Switch ProCurve 2650 or 2626

 

Administrator Passwords on ProCurve Switches

The documentation that came with the ProCurve switch describes how to optionally set an administrator's password for the switch.

If you define and set a password on a ProCurve switch, you must set the same password on every ProCurve switch that is a component of the HP XC system.

During the hardware discovery phase of the system configuration process, you are prompted to supply the password for the ProCurve switch administrator, and the password on every switch must match.

Switch Port Connections

Most HP XC systems have at least one Root Administration Switch and one Root Console Switch. The number of Branch Administration Switches and Branch Console Switches depends upon the total number of nodes in the hardware configuration.

The Administration Network using the root and branch switches must be parallel to the Console Network root and branch switches. In other words, if a particular node uses port N on the Root Administration Switch, its management console port must be connected to port N on the Root Console Switch. If a particular node uses port N on the Branch Administration Switch, its management console port must be connected to port N on the corresponding Branch Console Switch.

A graphical representation of the logical layout of the switches and nodes is shown in Figure 2-2.

Figure 2-2  Node and Switch Connections on a Typical System

Node and Switch Connections on a Typical
System

Figure 2-3 shows a graphical representation of the logical layout of the switches and nodes in a large-scale system with a Super Root Switch.

Figure 2-3 Switch Connections for a Large-Scale System

Switch Connections For a Large-Scale System

Switch Connections and HP Workstations

HP model xw workstations do not have console ports. Only the Root Administration Switch supports mixing nodes without console management ports with nodes that have console management ports (that is, all other supported server models).

HP workstations connected to the Root Administration Switch must be connected to the next lower-numbered contiguous set of ports immediately below the nodes that have console management ports.

For example, if nodes with console management ports are connected to ports 42 through 36 on the Root Administration Switch, the console ports are connected to ports 42 through 36 on the Console Switch. Workstations must be connected starting at port 35 and lower to the Root Administration Switch; the corresponding ports on the Console Switch are empty.

Super Root Switch

Figure 2-4 shows the Super Root Switch, which is a ProCurve 2848. A Super Root switch configuration supports the use of trunking to expand the bandwidth of the connection between the Root Administration Switch and the Super Root Switch. The connection can be as simple as one wire and as complex as eight, which is the largest trunk size the ProCurve 2848 switch currently supports. See “Trunking and Switch Choices” for more information about trunking and the Super Root Switch.

You must configure trunks on both switches before plugging in the cables between the switches. Otherwise, a loop is created between the two switches.

Figure 2-4 illustrates a ProCurve 2848 Super Root Switch.

Figure 2-4 ProCurve 2848 Super Root Switch

ProCurve 2842 Super Root Switch

Table 2-2 shows how ports are allocated for large-scale systems with multiple regions.

Table 2-2 Trunking Port Use on Large-Scale Systems with Multiple Regions

Trunking TypePorts Used on Super Root SwitchPorts Used on Root Administration Switch
4-wire Trunking:  
Region 11 through 443 through 46
Region 25 through 8 43 through 46
Region 313 through 1643 through 46
2-wire Trunking:  
Region 11 and 245 and 46
Region 23 and 445 and 46
Region 35 and 645 and 46
Region 47 and 845 and 46
Region 59 and 1045 and 46
Region 613 and 1445 and 46

 

Root Administration Switch

The Root Administration Switch for the Administration Network of an HP XC system can be either a ProCurve 2848 switch or a ProCurve 2824 switch for small configurations.

If you are using a ProCurve 2848 switch as the switch at the center of the Administration Network, use Figure 2-5 to make the appropriate port connections. In the figure, white ports should not have connections, black ports can have connections, and ports with numbered callouts are used for specific purposes, described after the figure. Gray-colored ports are reserved for future use.

Figure 2-5 ProCurve 2848 Root Administration Switch

ProCurve 2848 Root Administration Switch

The callouts in the figure enumerate the following:

  1. Port 42 must be used for the administration port of the head node.

  2. Ports 43 through 46 are used for connecting to the Super Root Switch if you are configuring a large-scale system.

  3. Port 47 can be one of the following:

    • Connection (or line monitoring card) for the interconnect.

    • Connection to the Interconnect Ethernet Switch (IES), which connects to the management port of multiple interconnect switches.

  4. Port 48 is used for the interconnect to the Root Console Switch (ProCurve 2650 or ProCurve 2626).

The ports on this switch must be allocated as follows for maximum performance:

  • Ports 1–10, 13–22, 25–34, 37–42

    • Starting with port 1, the ports are used for links from Branch Administration Switches, which includes the use of trunking. Two-port trunking can be used for each Branch Administration Switch.

      NOTE: Trunking is restricted to within the same group of 10 (you cannot trunk with ports 10 and 13). HP recommends that all trunking use consecutive ports within the same group (1–10, 13–22, 25–34, or 37–42).
    • Starting with port 41 and in descending order, ports are assigned for use by individual nodes.

  • Ports 11, 12, 23, 24, 35, 36 are unused.

For size-limited configurations, the ProCurve 2824 switch is an alternative Root Administration Switch.

If you are using a ProCurve 2824 switch as the switch at the center of the Administration Network, use Figure 2-6 to make the appropriate port connections. In the figure, white ports should not have connections, black ports can have connections, and ports with numbered callouts are used for specific purposes, described after the figure.

Figure 2-6 ProCurve 2824 Root Administration Switch

ProCurve
2824 Root Administration Switch

The callouts in the figure enumerate the following:

  1. Uplinks from branches start at port 1 (ascending).

  2. 10/100/1000 Base-TX RJ-45 ports.

  3. Connections to node administration ports start at port 21 (descending).

  4. Port 22 is used for the administration port of the head node.

  5. Dual personality ports.

  6. Port 24 is used as the interconnect to the Root Console Switch (a ProCurve 2650 or ProCurve 2626 model switch).

As a result of performance considerations and given the number of ports available in the ProCurve 2824 switch, the allocation order of ports is:

  • Ports 1–10, 13–21

    • Starting with port 1, the ports are used for links from Branch Administration Switches which can include the use of trunking. For example, if two port trunking is used, the first Branch Administration Switch uses port 1 and 2 of the Root Administration Switch.

      NOTE: Trunking is restricted to within the same group of 10 (you cannot trunk with ports 10 and 13). HP recommends that all trunking use consecutive ports within the same group (1–10 or 13–21).
    • Starting with port 21 and descending, ports are assigned for use by individual root nodes. A root node is a node that is connected directly to the Root Administration Switch.

  • Ports 11 and 12 are unused.

  • Port 23 can be one of the following:

    • Console (or line monitoring card) for the interconnect

    • Connection to the Interconnect Ethernet Switch (IES), which connects to the management port of multiple interconnect switches.

  • Port 24 is used as the interconnect to the Root Console Switch

Root Console Switches

The following switches are supported as Root Console Switches for the Console Branch of the Administration Network:

ProCurve 2650 Switch

You can use a ProCurve 2650 switch as a Root Console Switch for the Console Branch of the Administration Network. The Console Branch functions at a lower speed (10/100 Mbps) than the rest of the Administration Network.

The ProCurve 2650 switch is shown in Figure 2-7. In the figure, white ports should not have connections, black ports can have connections, and ports with numbered callouts are used for specific purposes, described after the figure.

Figure 2-7 ProCurve 2650 Root Console Switch

ProCurve
2650 Root Console Switch

The callouts in the figure enumerate the following:

  1. Port 42 must be reserved for an optional connection to the console port on the head node.

  2. Port 49 is reserved.

  3. Port 50 is the Gigabit Ethernet link to the Root Administration Switch.

Allocate the ports on this switch for consistency with the administration switches, as follows:

  • Ports 1–10, 13–22, 25–34, 37–41

    • Starting with port 1, the ports are used for links from Branch Console Switches. Trunking is not used.

    • Starting with port 41 and in descending order, ports are assigned for use by individual nodes in the utility cabinet. Nodes in the utility cabinet are connected directly to the Root Administration Switch.

      NOTE: There must be at least one idle port in this set to indicate the dividing line between branch links and root node administration ports.
  • Ports 11, 12, 23, 24, 35, 36, and 43–48 are unused.

ProCurve 2626 Switch

You can use a ProCurve 2626 switch as a Root Console Switch for the Console Branch of the Administration Network. The ProCurve 2626 switch is shown in Figure 2-8. In the figure, white ports should not have connections, black ports can have connections, and ports with numbered callouts are used for specific purposes, described after the figure.

Figure 2-8 ProCurve 2626 Root Console Switch

ProCurve
2626 Root Console Switch

The callouts in the figure enumerate the following:

  1. Port 22 must be reserved for an optional connection to the console port on the head node.

  2. Port 25 is reserved.

  3. Port 26 is the Gigabit Ethernet link to the Root Administration Switch.

Allocate the ports on this switch for consistency with the administration switches, as follows:

  • Ports 1–10, 13–21

    • Starting with port 1, the ports are used for links from Branch Console Switches. Trunking is not used.

    • Starting with port 21 and in descending order, ports are assigned for use by individual nodes in the utility cabinet. Nodes in the utility cabinet are connected directly to the Root Administration Switch.

      NOTE: There must be at least one idle port in this set to indicate the dividing line between branch links and root node administration ports.
  • Ports 11, 12, 23, and 24, are unused.

Branch Administration Switches

The Branch Administration Switch of an HP XC system can be either a ProCurve 2848 switch or a ProCurve 2824 switch.

Figure 2-9 shows the ProCurve 2848 switch. In the figure, white ports should not have connections, black ports can have connections, and ports with numbered callouts are used for specific purposes, described after the figure.

Figure 2-9 ProCurve 2848 Branch Administration Switch

ProCurve
2848 Branch Administration Switch

The callouts in the figure enumerate the following:

  1. Port 45 is used for the trunked link to the Root Administration Switch.

  2. Port 46 is used for the trunked link to the Root Administration Switch.

Allocate the ports on this switch for maximum performance, as follows:

  • Ports 1–10, 13–22, 25–34, and 37–44 are used for the administration ports for the individual nodes (up to 38 nodes).

  • Ports 11, 12, 23, 24, 35, 36, 47, and 48 are unused.

The ProCurve 2824 switch is shown in Figure 2-10. In the figure, white ports should not have connections, black ports can have connections, and ports with numbered callouts are used for a specific purposes, described after the figure.

Figure 2-10 ProCurve 2824 Branch Administration Switch

ProCurve
2824 Branch Administration Switch

The callout in the figure enumerates the following:

  1. Port 22 is used for the link to the Root Administration Switch.

Allocate the ports on this switch for maximum performance, as follows:

  • Ports 1–10 and 13–21 are used for the administration ports for the individual nodes (up to 19 nodes).

  • Ports 11, 12, 23, and 24 are unused.

Branch Console Switches

The Branch Console Switch of an HP XC system is a ProCurve 2650 switch.

The connections to the ports must parallel the connections of the corresponding Branch Administration Switch. If a particular node uses port N on a Branch Administration Switch, its management console port must be connected to port N on the corresponding Branch Console Switch.

Figure 2-11 shows the ProCurve 2650 switch. In the figure, white ports should not have connections, black ports can have connections, and ports with numbered callouts are used for a specific purpose, described after the figure.

Figure 2-11 ProCurve 2650 Branch Console Switch

ProCurve
2650 Branch Console Switch

The callout in the figure enumerates the following:

  1. Port 50 is the link to the Root Console Switch.

Allocate the ports on this switch for maximum performance, as follows:

  • Ports 1–10, 13–22, 25–34, 37–44 are used for the console ports of individual nodes (up to 38 nodes).

  • Ports 11, 12, 23, 24, 35, 36, 45–49 are unused

Printable version
Privacy statement Using this site means you accept its terms Feedback to webmaster
© 2003 Hewlett-Packard Development Company, L.P.