Sun Fire Midrange Systems

Sun Fire Midrange Systems Status commands | Platform commands | Domain commands | COD commands | Keyswitch commands | Summary commands The Sun Fire midrange server consist of the E6900/6800/4810/4800/3800 system. Platform

The collection of resources such as power supplies, the centreplane and fans that are not for the exclusive use of a domain

Segment (partition)

A group of Sun FirePlane switches (repeater boards) that are used together to provide comms between CPU/Memory and I/O assemblies in the same domain

Domain

Instance of the Sun O/S using its own CPU/Memory and I/O.

System controller

Is an embedded ssytem that confgiures and monitors the platform. Like the SSP to a E10K chassis. The SC offers a CLI interface to the domains and the platform.

Repeater boards are used to connect the CPU/Mmeory of a domain to the I/O assemblies System

Boards required per partition

Total number of boards per system

E6900 and E6800

2

4 - RP0, RP1, RP2, RP3

E4900 and E4800

1

2 - RP0, RP2

E4810

1

2 - RP0, RP2

E3800

n/a

Equivalent of two repeater boards (RP0, RP2) are built into an active centerplane

Maximum number of partitions and domains per system E6900 and E6800 Number of partitions Number of active domains in dual-partition mode

E4900/4810/4800/3800

1 or 2

1 or 2

up to 4(A,B,C,D)

up to 2(A, C)

up to 2(A, B)

up to 2 (A, B)

Number of active domains in single-partition mode

System Controllers The platform can support upto to system controllers (used for failover). There are three methods to connect toa system controller: • • •

Serial connection (serial cable) - upto one connection only SSH connection (ethernet) - upto five connections Telnet connection (ethernet) - upto twelve connections

The platform shell administors the platform, the domains shell is were you can adiminstors the domains. There could be four domain shells. each domain has a virtual keyswitch which has five settings off, standby, on , diag and secure.

Hardware architecture Maximum CPU/Mmeory boards Max number of CPU/Memory boards

Max number of CPUs

E6900 and E6800

6

24

E4900 and E4800

3

12

E4810

3

12

E3800

2

8

System

Maximum I/O Assemblies System

Max I/O Assemblies

Number of PCI slots per assembly

E6900 and E6800

4

8 slots (6 full length and 2 short length) 4 slots Compact PCI

E4900 and E4800

2

8 slots (6 full length and 2 short length) 4 slots Compact PCI

E4810

2

8 slots (6 full length and 2 short length) 4 slots Compact PCI

E3800

2

6 slots Compact PCI

Minimum and redundant power supply requirements System

# of power grids per system

minimum # of power supplies in each power grid

Total # of supplies in each grid (including redundant PS)

E6900 and E6800

2

2 (grid0)

3

2 (grid1)

3

E6900 and E6800 E4810

1

2 (grid0)

3

E4900 and E4800

1

2 (grid0)

3

E3800

1

2 (grid0)

3

Repeater board assignment (E6900 and E6800) Partition mode

Repeater boards

Domains

Single partition

RP0, RP1, RP2, RP3

A, B

Dual partition

RP0, RP1

A, B

Dual partition

RP2, RP3

C, D

Componets that accessible for the platform (E6900 and E6800) Device description

Device name

Power grids

GRID0, GRID1

Power supplies

PS0, PS1, PS2, PS3, PS4, PS5

CPU/Memory boards

SB0, SB1, SB2, SB3, SB4, SB5

I/O assemblies

IB6, IB7, IB8, IB9

Repeater boards

RP0, RP1, RP2, RP3

ID/Source board

ID0

Fan trays

FT0, FT1, FT2, FT3

System controller

SSC0, SSC1

Partitioning The sun fire servers can be partitioned in either single mode or dual mode. In single domains A and B are available in dual mode domains A, B, C and D are available. The default setting are detailed below, however system boards can be moved from one domain to another and long as a domain has one system and i/o board. Single partition

Dual partition

Accessing the System Controller To setup the system controller interface use the setupplatform command, here you can setup the IP address of the network ports. Then to access the port use either ssh or telnet. You can by pass the main menu by using the the port number for the domain: Port Number 5000

Platform shell

5001

Domain A

5002

Domain B

5003

Domain C

5004

Domain D

Navigate between platform shell and a domain console

schostname:SC>console -d <domain_ID> connected to Domain A Domain Shell for domain A OK> or login:

Go from a domain console to a domain shell

#.

domain shell to a domain console

schostname:D> resume

set the domain to be active

schostname:D> setkeyswitch on

turn of the active domain

schostname:D> setkeyswitch off

disconnect from a platform or a domain shell schostname:D> disconnect

System Power on and Setup The following steps need to be taken to setup a domain • • • • • • • • • • • • •

Install and cable hardware Set up services before powering on the hardware Power on the hardware and power grid Set the date and time for the platform Set the password for the platform Set up platform-specific parameters using the setupplatform command Set the date and time for Domain A Set the power for Domain A Set up domain-specific parameters using the setupdomain command Save the system config by using the dumpconfig command Turn on the domain keyswitch Install the O/S if not installed Boot the domain

It would be wise to setup the following before you begin: DNS, Loghost, System controllers. To power on the Power grids: 1. Acces the system controller 2. connect to the platform shell 3. Power on the grid or grids schostname:SC>

poweron grid0 grid1 (for E4900/4810/4800/3800 these is only one grid)

To setup the platform time/date and configure the platform parameters you use the setupplatform command To setup the domain time/date and configure the domain parameters you use the setupdomain command

To create a second domain you delete systems boards and i/o assemblies from existing domains then add them to the new domains: schostname:SC> deleteboard sb ib schostname:SC> addboard -d <domain> sb ib

You will again need to set up the domain time/date and parameters using the setupdomain command and remember to backup the configuration using the dumpconfig command. If setting up three domains then the partition has to be in dual mode use the setupplatform command to configure the partition mode to dual. To startup a domain connect into the domains shell and use the setkeyswitch on command. Status Commands Platform status

Shell

Command

platform

showplatform -p status

List boards (display state, status domain platform info)

showboards

List the ACL (boards)

platform

showplatform -p acls

list the HostID/MAC addresses

platform

showplatform -p hostid

list all componets

platform

showcomponent

Display error information

platform

showerrorbuffer

Display system controller failover state

platform

showfailover -v

Display the platform messages

platform

showlogs

Display the firmware revision on boards platform

showboards -p version

Display the system controller revision, status and clock failover info.

platform

showsc -v

Display environmental status (temp, voltages, etc)

platform

showenvironment

Displayn the domain configuration parameters

platform

showdomain -v

Display the platform configuration parameters

platform

showplatform -v

Platform Commands Add a boards to the ACL list

setupplatform -p acls setupplatform -p hostid

swap the HostID/MAC address between to domains

HostID/MAC Adress Swap ----------------------------------------Domains to swap HostID/MAC address [A, B, C, D]: b Domains to swap HostID/MAC address with [A, B, C, D]: d commit to swap? [no]: y

Restore the HostID/MAC addresses

setupplatform -p hostid -m auto

Enable SSH on the platform (asked to complete some questions)

setupplatform -p network

set password for a domain

password -d <domain>

Backup the platform and domain settings

dumpconfig

Restore the platform and domain settings

restoreconfig

turn on power grids

poweron grid0 grid1

turn off power grids

poweroff grid0 grid1

power off the system controller

poweroff SSC0 or SCC1

power on a system controller

poweron SSC0 or SCC1

Assign a board to a domain

addboard -d <domain> sb ib

Remove a board from a domain

deleteboard -d <domain> sb ib

update firmware on a board

flashupdate -c <source board> <destination board>

Disable system controller failover

setfailover off

enable system controller failover

setfailover on

force a system controller failover

setfailover force

Domain Commands setupdomain -p loghost

setup a loghost for a domain

Loghosts -----------------Loghost [ ]: 192.168.0.1 Log facility for Domain A: local1

disconnect form a domain

disconnect

turn off a domain

setkeyswitch off

turn on a domain

setkeyswitch on

List available boards for a domain

showboards -a

List the ACL (boards)

showdomain -p acls

Assign a board to a domain

addboard sb ib

Remove a board from a domain

deleteboard sb ib

test a system board (no i/o bard testing)

testboard sb

display loghost for a domain

showdomain -p loghost

reset a hung domain

reset

Capacity on Demand (platform shell) Add a COD license

addcodlicense

delete a COD license

deletecodlicense

display all COD licenses

showcodlicense

display all COD licenses (raw format)

showcodlicense -r

Enables or disables instant access CPU's and allocates domain COD RTU licenses

setupplatform -p cod

Enables or disables instant access CPUS's

setupplatform -p cod

Reserves a specific quantity of COD RTU licenses for a particulr domain

setupplatform -p cod -d <domain>

Display the COD licenses

showplatform -p cod

View COD usage by resource

showcodusage -p resource

View COD usage by domain

showcodusage -p domains -v

View COD usage by resource and domain

showcodusage -v

Display infomation about COD events

showlogs

Display the status of COD RTU license reservations for the domain (domain shell)

showdomain

-d <domain>

Keyswitch commands Turn domain on (power on system and i/o boards)

setkeyswitch off

Turn domain off (power off system and i/o boards)

setkeyswitch on

Turn the systems and i/o boards on

setkeyswitch standby

Turn on POST diagnosics

setkeyswitch diag

Ignored the break and reset commands

setkeyswitch secure

Command Summary Command

Description

addboard

assigns a board to a domain

Platform shell Domain shell X

addcodlicense

Adds capacity on demand

X

break

sends a break signal to the domain console

connections

Displays connections to the system controller to a domain

X

console

Connects to a domain from the platform

X

deleteboard

Unassigns a board from a domain

X

deletecodlicense

Removes a COD license

X

disablecomponet

replaced with setls

X

X

disconnect

Disconnect the current connection

X

X

dumpconfig

saves the platform and domain configurations

X

enablecomponet

replaced with setls

X

flashupdate

updates firmware

X

help

provides help pages

X

X

history

Shows the command history with date and time stamps

X

X

password

sets the shell password

X

X

poweroff

powers off componets

X

X

poweron

powers on componets

X

X

reboot

Reboots the system controller

X

reset

Resets the domain in the domain shell

restartssh

Restarts SSh server

X

restoreconfig

Restores the platform and domain configurations

X

X X X X

X

X

resume

Exits the domain shell and resumes access to the domain console

X

setdate

sets the date and the time

X

X

setdefaults

sets the configuration to default values

X

X

setescape

sets the escape sequence

X

setfailover

Changes the state of the system controller failover

X

setkeyswitch

Sets the keyswitch position

X

X

setls

Sets the component location status

X

X

setupdomain

Configures the domain

setupplatform

Configure the platform

X

showboards

Displays the assignment info and status for all the components in the system

X

showcodlicenses

Display the COD licenses

X

showcodusage

Displays the current usage stats for COD resources

X

X

showcomponent

shows the state of a component

X

X

showdate

Shows the date and time

X

X

showdomain

Display the configuration and status of the domain

showenvironment

Shows fans, power and voltage details

X

showerrorbuffer

Shows the contents of the error buffer

X

showescape

Displays the escape sequence

X

showfailover

Displays system controller and clock failover status

X

showfru

Display the field replaceable units

X

showkeyswitch

Display the keyswitch position

X

X

showlogs

Displays the logs

X

X

showplatform

Displays the configuration and information for the platform and status of the domains

X

showresetstate

Shows CPU's after a reset or a RED MODE trap

showsc

shows the system controller version and update

X

ssh-keygen

Generates SSH host keys and displays hosts key fingerprint on the system controller

X

testboard

Tests the CPU/Memory board

X

X

X

The Sun Fire midrange server consist of the E6900/6800/4810/4800/3800 system and below are some common tasks that are used in every day administration of these servers. Create a new domain Powering off/on a domain Assign and Deassigning a system board from a domain Removing and Replacing a system board from a domain Testing a system board Replace a failed repeater board Firmware upgrade of a system board within a domain

Create a new domain

X X

X

Sun Fire Midrange Tasks

• • • • • • •

X

X

1. Determine how many domains you have in your system and how many partitions you need. For example if you require to setup 3 or 4 domains, you will need to setup dual-partition mode (see Sun Midrange web page - partitioning) . By default its best to automatically setup two domains. Use the setupplatform command to setup dual-partition mode. 2. Determine what you require in each domain i.e system boards, i/o assembly boards 3. If you need to setup dual-partition mode all domains (if any have been created) need to be powered off by using the setkeyswitch off command make sure that all domains are at the ok> prompt first. Single partition will create two domains A and B. Dual partition mode will create four domains A, B, C and D. 4. If you wish to add/remove boards form any of the domains use the belows commands schostname:SC> deleteboard sb1 ib1 schostname:SC> addboard -d b sb1 ib1

5. Access the new domain via the domain shell 6. Set the date, time and password of the new domain, using the setdate and password commands. 7. Configure the new domain by using the setupdomain command. 8. Once the domain has been configured it is best to save the configuration information by using the dumpconfig command from the platform shell. 9. Now the domain can be started by using the setkeyswitch on command. Powering off/on a domain 1. To power off a domain the domain O/S must be stopped first using the normal shutdown command to perform this. 2. Once at the OK> prompt use the setkeyswitch off to power down the domain 3. To power up the domain use the setkeyswitch on command 4. The domain should be access via the OK> and normal boot procedure resume. Assign and deassigning a system board from a domain 1. To move boards from one domain to another the board must not be assigned. To deassign a board from the ACL of a domain, from the domain shell list the boards that the domain can access schostname:A> showboards -a

2. If the board is not listed in the above command you need to deassign and then reassign the board making sure it is not in use first schostname:SC> setupplatform -p acls

3. Once the board is now assigned to the domain you can add the board to the domain note the new board assignment will not take affect until you change the domain keyswitch schostname:A> addboard sb2

4. Shutdown the O/S on the domain and set the keyswitch to the standby mode (does not need to power of the boards), then turn the domain back on using the setkeyswitch on command, the domain can now be booted in the normal way.

Removing and Replacing a system board from a domain 1. Login to the affect domain shell and shutdown the O/S in the normal way 2. Set the keyswitch in standby mode schostname:A> setkeyswitch standby

3. Power off the board schostname:A> poweroff sb0

4. The Sun engineer can now replace the affected board 5. Power on the replaced board from the platform shell schostname:SC> poweron sb0

6. Check the version of the new system board schostname:SC> showboards -p version

7. Update the firmware of the new system board, if require (if the board is in a failed state power off the board) schostname:SC> flashupdate -c <source_board> <destination_board>

8. power up the domain from the domain shell schostname:A> setkeyswitch on

9. Start the O/S in the normal way. Testing a system board 1. Login to the domain shell of the system board that is to be tested and shutdown the O/S in the normal way 2. Set the keyswitch in standby mode schostname:A> setkeyswitch standby

3. Test the system board schostname:A> testboard SB0

4. Start the domain schostname:A> setkeyswitch on

5. Start the O/S in the normal way Replace a failed repeater board 1. Determine which domains are affect by the failed repeater board by using the showplatform -p status command (see Sun Midrange web page - repeater board assignment) 2. Halt all the O/S on the affected domains and power off each domain (see Powering off/on a domain) 3. Power of the repeater board schostname:SC> poweroff rp0

4. Sun Engineer to replace the repeater board 5. Power on the repeater board then domains and finally start the O/S. schostname:SC> poweron rp0 schostname:A> setkeyswitch on schostname:B> setkeyswitch on