msgbartop
Tips and Tricks site for advanced HP-UX Engineers
msgbarbottom

17 Jun 20 HP-UX Serviceguard Missing node

If you have a hardware fault or other calamity in a HP-UX serviceguard cluster you lose the ability to make incremental changes to the cluster until that node comes back.

If you need to make a change to a cluster in this state and you don’t want to bring down the cluster, you have to do all your changes with one gigantic command line.

Lets say you have a 4 node cluster named cnode1,cnode2,cnode3, and cnode4.

cnode4 suffers a hardware fault and you packages fail over to cnode1-3. But your usage has grown and you have a package that is beating the hardware down and you want to move it from cnode2 to cnode1.

Well you can’t do it incrementally. You have to do it all at once. I recently ran into a situation where I had to modify 37 cluster environment files and the cluster configuration to remove a node cnode4.

That requires you to correctly type a command line that could easily be in excess of 4000 characters. Anybody who knows my typing skills knows this is beyond my abilities on my best day.

So I wrote a little assistant program.

It consists of three files two of which are scripts.

pkg-mod-list (A list of all the package configuration files, full path that need to be modified. It is your choice how to handle the editing. We used ansible last night when we did it in a DR cluster.

Contents …

/etc/cmcluster/nc-package-name/nc-package-name.env

/etc/cmcluster/sc-package-name/sc-package-name.env

Then we have helper scripts which put the command line together.

myclusterV6_prod.conf is the main cluster configuration file with the references to node cnode4 commented out.

cat missing-node-checkconf
MAIN=”cmcheckconf -C /etc/cmcluster/configs/myclusterV6_Prod.conf”
PCMD=””
cat pkg-mod-list | while read -r pfile
do
PCMD=”${PCMD} -P ${pfile}”
### echo “$PCMD”
done
MYCMD=”${MAIN} ${PCMD}”
echo $MYCMD

exec ${MYCMD}

MAIN=”cmapplyconf -C /etc/cmcluster/configs/myclusterV6_Prod.conf”
PCMD=””
cat pkg-mod-list | while read -r pfile
do
PCMD=”${PCMD} -P ${pfile}”
### echo “$PCMD”
done
MYCMD=”${MAIN} ${PCMD}”
echo $MYCMD

exec ${MYCMD}

10 Nov 19 How to be a yes man

Learning something new is great. Joe Geiger taught me something cool that I should have learned years ago.

Serviceguard users ever wanted to script a cluster change such as a node add.

cmapplyconf -v -P <package file>

Ends with a y/n prompt do you want to apply? Normally that requires input. Not with the yes command:

cmcheckconf -v -P <package file>

rc=$?

# Check return code if not zero stop

if [ ${rc} -ne 0 ]

then

echo “Checkconf error ${rc}”

exit ${rc}

fi

yes | cmapplyconf -v -P <package file>

# Check return code here as well

Tags: , , , ,

15 Aug 19 APA network pairings: How to find out fast what they are

Script for detecting APA network bonded pairs. It is already built into the cinam21t drd image. It will save you 3-5 hours of guess work on future builds.

Networking was changed to protect the innocent.

Here is an example:

[root@cinam21t]:/home/root # ./apanetwork_discover 142.18.1.26 142.18.1.96 ——————————————————— -This script figures out which NIC cards are APA paired.- -It has two inputs:……………………………….- -1- The assigned IP address of the APA Group lan90#…..-
-2- The known network address of an HP-UX server on net.- -ex ./apanetwork_discover 142.18.1.26 142.18.1.96 ……-
– These are cinam21t and stlam31t…………………..-
– The system must be OFF network for this to work ……-
– Instruction: …………………………………..-
– /sbin/init.d/net stop …………………………..-
– /sbin/init.d/vlan stop ………………………….-
– /sbin/init.d/hplm stop ………………………….-
– /sbin/init.d/hpapa stop (You may need to ctrl-break…-
– netstat -rn (ifconfig lan# down then unplumb any lans.-
– Wash,rinse and repeat for lan901,lan902,lan903 …….-
———————————————————
The LAN is lan0 Success lan0 as 142.18.1.26 was able to ping 142.18.1.96 The LAN is lan8 NO JOY lan8 as 142.18.1.26 was able NOT to ping 142.18.1.96
The LAN is lan16 NO JOY lan16 as 142.18.1.26 was able NOT to ping 142.18.1.96
The LAN is lan19 NO JOY lan19 as 142.18.1.26 was able NOT to ping 142.18.1.96
The LAN is lan2 NO JOY lan2 as 142.18.1.26 was able NOT to ping 142.18.1.96
The LAN is lan49 NO JOY lan49 as 142.18.1.26 was able NOT to ping 142.18.1.96
The LAN is lan52 NO JOY lan52 as 142.18.1.26 was able NOT to ping 142.18.1.96
The LAN is lan56 Success lan56 as 142.18.1.26 was able to ping 142.18.1.96 [root@cinam21t]:/home/root #

In this case lan0 are in the bonded pair (lan900)

Take a nwmgr output before bringing network down. Run from console only

Here is the script code

/root/build # cat apanetwork_discover

!/bin/ksh

#
echo “———————————————————“
echo “-This script figures out which NIC cards are APA paired.-“
echo “-It has two inputs:……………………………….-“
echo “-1- The assigned IP address of the APA Group lan90#…..-“
echo “-2- The known network address of an HP-UX server on net.-“
echo “-ex ./apanetwork_discover 172.19.1.26 172.19.1.96 ……-“
echo “- These are stlam34t and stlam31t…………………..-“
echo “- The system must be OFF network for this to work ……-“
echo “- Instruction: …………………………………..-“
echo “- /sbin/init.d/net stop …………………………..-“
echo “- /sbin/init.d/vlan stop ………………………….-“
echo “- /sbin/init.d/hplm stop ………………………….-“
echo “- /sbin/init.d/hpapa stop (You may need to ctrl-break…-“
echo “- netstat -rn (ifconfig lan# down then unplumb any lans.-“
echo “- Wash,rinse and repeat for lan901,lan902,lan903 …….-“
echo “———————————————————“
IP2=$2
IPADDY=$1

nwmgr | awk ‘!/hp_apa/{ printf “%s %s\n”, $1,$2 }’ | awk ‘/UP/{print $1}’ | while read -r LN
do

 sleep 1
 echo "The LAN is ${LN}"
 ifconfig ${LN} ${IPADDY} netmask 255.255.255.0 up > /dev/null
 ping ${IP2} -n 1 -m 5 > /dev/null
 rc=$?
 if [ $rc -eq 0 ]
 then
   echo "Success $LN as $IPADDY was able to ping $IP2"
 else
   echo "NO JOY $LN as $IPADDY was able NOT to ping $IP2"
 fi
 ifconfig ${LN} down
 ifconfig ${LN} unplumb

done

21 Jun 16 Removing a serviceguard package from a cluster.

First stop package

umount any filesysytem

Pull back vg’s and disk.

Then:
sglabn2:root > cmviewcl

CLUSTER STATUS
sglabn_cluster up

NODE STATUS STATE
sglabn1 up running
sglabn2 up running

PACKAGE STATUS STATE AUTO_RUN NODE
test_pkg up running enabled sglabn2

UNOWNED_PACKAGES

PACKAGE STATUS STATE AUTO_RUN NODE
dbciLP1 down failed disabled unowned
sglabn2:root > cmdeleteconf -v -p dbciLP1
Maximum configured packages parameter is 300.
Configuring 0 new packages.
Total number of packages configured in the cluster is 2.

Modify the package configuration ([y]/n)? y
Completed the package deletion
sglabn2:root > cmviewcl

CLUSTER STATUS
sglabn_cluster up

NODE STATUS STATE
sglabn1 up running
sglabn2 up running

PACKAGE STATUS STATE AUTO_RUN NODE
test_pkg up running enabled sglabn2
sglabn2:root >

Tags: ,

20 Apr 15 Serviceguard cluster creation:tip of the day

The following command conducts a cleanup and preparation step for any nodes named in a serviceguard cluster.

It is something I should have known, but learned recently:

cmpreparecl -n sgnode0 -n sgnode1

It does all the steps that would normally be done by hand.

Tags: , ,

11 Nov 14 Need a lot f detail on a serviceguard package/configuration

cmviewcl -v -f line
This is from a complex SAP environment. Instance name and networking has been changed for security reasons. Some important details highlighted below. The reason this command was run was to find out if the package was modular. The networking has been so thoroughly scrubbed as to be rendered useless.
name=STEVEN_Cluster
id=891327936
status=up
state=stable
summary=degraded
coordinator=node1
incarnation=18
cluster_formation_time=1413125162
configuration_data_version=93
member_timeout=14000000
io_timeout_extension=0
configured_io_timeout_extension=0
auto_start_timeout=600000000
network_polling_interval=2000000
network_failure_detection=inout
network_auto_failback=yes
hostname_address_family=ipv4
max_reformation_duration=22
cfs_online_timeout_changes=false
max_configured_packages=300
node:node0|name=node0
node:node0|status=up
node:node0|state=running
node:node0|initial_incarnation=18
node:node0|os_status=up
node:node0|summary=ok
node:node0|id=1
node:node0|sg_version=A.11.19.00
node:node0|sg_patch=PHSS_42988
node:node0|os_release=B.11.31
node:node0|cpu_architecture=IA64
node:node0|boot_timestamp=1413124030
node:node0|interface:lan1|name=lan1
node:node0|interface:lan1|id=1
node:node0|interface:lan1|status=up
node:node0|interface:lan1|disabled=false
node:node0|interface:lan1|mac_address=00:25:b3:e8:60:66
node:node0|interface:lan1|ppa=1
node:node0|interface:lan1|bridged_net=1
node:node0|interface:lan1|mac_type=Ethernet
node:node0|interface:lan1|hardware_path=3/0/2/1/0/6/0
node:node0|interface:lan1|nmid=1
node:node0|interface:lan1|type=primary
node:node0|interface:lan1|ip_address:11.9.0.95|name=11.9.0.95
node:node0|interface:lan1|ip_address:11.9.0.95|netmask=255.255.255.128
node:node0|interface:lan1|ip_address:11.9.0.95|subnet=11.9.0.0
node:node0|interface:lan1|ip_address:11.9.0.95|route_id=1
node:node0|interface:lan1|ip_address:11.9.0.95|heartbeat=true
node:node0|interface:lan2|name=lan2
node:node0|interface:lan2|id=3
node:node0|interface:lan2|status=up
node:node0|interface:lan2|disabled=false
node:node0|interface:lan2|mac_address=00:25:b3:e8:60:67
node:node0|interface:lan2|ppa=2
node:node0|interface:lan2|bridged_net=2
node:node0|interface:lan2|mac_type=Ethernet
node:node0|interface:lan2|hardware_path=3/0/2/1/0/6/1
node:node0|interface:lan2|nmid=2
node:node0|interface:lan2|type=primary
node:node0|interface:lan2|ip_address:11.103.3.71|name=11.103.3.71
node:node0|interface:lan2|ip_address:11.103.3.71|netmask=255.255.254.0
node:node0|interface:lan2|ip_address:11.103.3.71|subnet=11.103.2.0
node:node0|interface:lan2|ip_address:11.103.3.71|route_id=2
node:node0|interface:lan2|ip_address:11.103.3.71|heartbeat=true
node:node0|interface:lan3|name=lan3
node:node0|interface:lan3|id=5
node:node0|interface:lan3|status=up
node:node0|interface:lan3|disabled=false
node:node0|interface:lan3|mac_address=00:25:b3:e8:60:88
node:node0|interface:lan3|ppa=3
node:node0|interface:lan3|bridged_net=3
node:node0|interface:lan3|mac_type=Ethernet
node:node0|interface:lan3|hardware_path=3/0/8/1/0/6/0
node:node0|interface:lan3|nmid=7
node:node0|interface:lan3|type=primary
node:node0|interface:lan3|ip_address:145.109.44.111|name=145.109.44.111
node:node0|interface:lan3|ip_address:145.109.44.111|netmask=255.255.255.128
node:node0|interface:lan3|ip_address:145.109.44.111|subnet=145.109.44.0
node:node0|interface:lan3|ip_address:145.109.44.111|route_id=3
node:node0|interface:lan3|ip_address:145.109.44.111|heartbeat=true
node:node0|interface:lan4|name=lan4
node:node0|interface:lan4|id=7
node:node0|interface:lan4|status=up
node:node0|interface:lan4|disabled=false
node:node0|interface:lan4|mac_address=00:25:b3:e8:60:89
node:node0|interface:lan4|ppa=4
node:node0|interface:lan4|bridged_net=4
node:node0|interface:lan4|mac_type=Ethernet
node:node0|interface:lan4|hardware_path=3/0/8/1/0/6/1
node:node0|interface:lan4|nmid=8
node:node0|interface:lan4|type=primary
node:node0|interface:lan4|ip_address:11.103.0.155|name=11.103.0.155
node:node0|interface:lan4|ip_address:11.103.0.155|netmask=255.255.254.0
node:node0|interface:lan4|ip_address:11.103.0.155|subnet=11.103.0.0
node:node0|interface:lan4|ip_address:11.103.0.155|route_id=4
node:node0|interface:lan4|ip_address:11.103.0.155|heartbeat=true
node:node0|interface:lan5|name=lan5
node:node0|interface:lan5|id=2
node:node0|interface:lan5|status=up
node:node0|interface:lan5|disabled=false
node:node0|interface:lan5|mac_address=00:1e:0b:51:86:b4
node:node0|interface:lan5|ppa=5
node:node0|interface:lan5|bridged_net=1
node:node0|interface:lan5|mac_type=Ethernet
node:node0|interface:lan5|hardware_path=3/0/4/0/0/0/0/2/0/0/0
node:node0|interface:lan5|nmid=3
node:node0|interface:lan5|type=standby
node:node0|interface:lan6|name=lan6
node:node0|interface:lan6|id=4
node:node0|interface:lan6|status=up
node:node0|interface:lan6|disabled=false
node:node0|interface:lan6|mac_address=00:1e:0b:51:86:b5
node:node0|interface:lan6|ppa=6
node:node0|interface:lan6|bridged_net=1
node:node0|interface:lan6|mac_type=Ethernet
node:node0|interface:lan6|hardware_path=3/0/4/0/0/0/0/2/0/0/1
node:node0|interface:lan6|nmid=4
node:node0|interface:lan6|type=standby
node:node0|interface:lan8|name=lan8
node:node0|interface:lan8|id=8
node:node0|interface:lan8|status=up
node:node0|interface:lan8|disabled=false
node:node0|interface:lan8|mac_address=00:1e:0b:51:86:f1
node:node0|interface:lan8|ppa=8
node:node0|interface:lan8|bridged_net=3
node:node0|interface:lan8|mac_type=Ethernet
node:node0|interface:lan8|hardware_path=3/0/6/0/0/0/0/2/0/0/1
node:node0|interface:lan8|nmid=6
node:node0|interface:lan8|type=standby
node:node0|subnet:11.9.0.0|name=11.9.0.0
node:node0|subnet:11.9.0.0|route_id=1
node:node0|subnet:11.9.0.0|status=up
node:node0|subnet:11.9.0.0|ip_monitor=off
node:node0|subnet:11.1032.0|name=11.1032.0
node:node0|subnet:11.1032.0|route_id=2
node:node0|subnet:11.1032.0|status=up
node:node0|subnet:11.1032.0|ip_monitor=off
node:node0|subnet:145.109.44.0|name=145.109.44.0
node:node0|subnet:145.109.44.0|route_id=3
node:node0|subnet:145.109.44.0|status=up
node:node0|subnet:145.109.44.0|ip_monitor=on
node:node0|subnet:145.109.44.0|polling_target=145.109.44.5
node:node0|subnet:11.1030.0|name=11.1030.0
node:node0|subnet:11.1030.0|route_id=4
node:node0|subnet:11.1030.0|status=up
node:node0|subnet:11.1030.0|ip_monitor=off
node:node3|name=node3
node:node3|status=up
node:node3|state=running
node:node3|initial_incarnation=13
node:node3|os_status=up
node:node3|summary=ok
node:node3|id=4
node:node3|sg_version=A.11.19.00
node:node3|sg_patch=PHSS_41902
node:node3|os_release=B.11.31
node:node3|cpu_architecture=IA64
node:node3|boot_timestamp=1413108727
node:node3|interface:lan1|name=lan1
node:node3|interface:lan1|id=1
node:node3|interface:lan1|status=up
node:node3|interface:lan1|disabled=false
node:node3|interface:lan1|mac_address=00:25:b3:e8:70:32
node:node3|interface:lan1|ppa=1
node:node3|interface:lan1|bridged_net=1
node:node3|interface:lan1|mac_type=Ethernet
node:node3|interface:lan1|hardware_path=2/0/2/1/0/6/0
node:node3|interface:lan1|nmid=1
node:node3|interface:lan1|type=primary
node:node3|interface:lan1|ip_address:11.9.0.101|name=11.9.0.101
node:node3|interface:lan1|ip_address:11.9.0.101|netmask=255.255.255.128
node:node3|interface:lan1|ip_address:11.9.0.101|subnet=11.9.0.0
node:node3|interface:lan1|ip_address:11.9.0.101|route_id=1
node:node3|interface:lan1|ip_address:11.9.0.101|heartbeat=true
node:node3|interface:lan2|name=lan2
node:node3|interface:lan2|id=3
node:node3|interface:lan2|status=up
node:node3|interface:lan2|disabled=false
node:node3|interface:lan2|mac_address=00:25:b3:e8:70:33
node:node3|interface:lan2|ppa=2
node:node3|interface:lan2|bridged_net=2
node:node3|interface:lan2|mac_type=Ethernet
node:node3|interface:lan2|hardware_path=2/0/2/1/0/6/1
node:node3|interface:lan2|nmid=2
node:node3|interface:lan2|type=primary
node:node3|interface:lan2|ip_address:11.1033.95|name=11.1033.95
node:node3|interface:lan2|ip_address:11.1033.95|netmask=255.255.254.0
node:node3|interface:lan2|ip_address:11.1033.95|subnet=11.1032.0
node:node3|interface:lan2|ip_address:11.1033.95|route_id=2
node:node3|interface:lan2|ip_address:11.1033.95|heartbeat=true
node:node3|interface:lan3|name=lan3
node:node3|interface:lan3|id=5
node:node3|interface:lan3|status=up
node:node3|interface:lan3|disabled=false
node:node3|interface:lan3|mac_address=00:25:b3:e8:70:68
node:node3|interface:lan3|ppa=3
node:node3|interface:lan3|bridged_net=3
node:node3|interface:lan3|mac_type=Ethernet
node:node3|interface:lan3|hardware_path=2/0/8/1/0/6/0
node:node3|interface:lan3|nmid=5
node:node3|interface:lan3|type=primary
node:node3|interface:lan3|ip_address:145.109.44.125|name=145.109.44.125
node:node3|interface:lan3|ip_address:145.109.44.125|netmask=255.255.255.128
node:node3|interface:lan3|ip_address:145.109.44.125|subnet=145.109.44.0
node:node3|interface:lan3|ip_address:145.109.44.125|route_id=3
node:node3|interface:lan3|ip_address:145.109.44.125|heartbeat=true
node:node3|interface:lan4|name=lan4
node:node3|interface:lan4|id=7
node:node3|interface:lan4|status=up
node:node3|interface:lan4|disabled=false
node:node3|interface:lan4|mac_address=00:25:b3:e8:70:69
node:node3|interface:lan4|ppa=4
node:node3|interface:lan4|bridged_net=4
node:node3|interface:lan4|mac_type=Ethernet
node:node3|interface:lan4|hardware_path=2/0/8/1/0/6/1
node:node3|interface:lan4|nmid=6
node:node3|interface:lan4|type=primary
node:node3|interface:lan4|ip_address:11.1030.204|name=11.1030.204
node:node3|interface:lan4|ip_address:11.1030.204|netmask=255.255.254.0
node:node3|interface:lan4|ip_address:11.1030.204|subnet=11.1030.0
node:node3|interface:lan4|ip_address:11.1030.204|route_id=4
node:node3|interface:lan4|ip_address:11.1030.204|heartbeat=true
node:node3|interface:lan6|name=lan6
node:node3|interface:lan6|id=4
node:node3|interface:lan6|status=up
node:node3|interface:lan6|disabled=false
node:node3|interface:lan6|mac_address=00:1e:0b:51:86:d1
node:node3|interface:lan6|ppa=6
node:node3|interface:lan6|bridged_net=1
node:node3|interface:lan6|mac_type=Ethernet
node:node3|interface:lan6|hardware_path=2/0/4/0/0/0/0/2/0/0/1
node:node3|interface:lan6|nmid=4
node:node3|interface:lan6|type=standby
node:node3|interface:lan7|name=lan7
node:node3|interface:lan7|id=6
node:node3|interface:lan7|status=up
node:node3|interface:lan7|disabled=false
node:node3|interface:lan7|mac_address=00:1e:0b:51:86:f4
node:node3|interface:lan7|ppa=7
node:node3|interface:lan7|bridged_net=3
node:node3|interface:lan7|mac_type=Ethernet
node:node3|interface:lan7|hardware_path=2/0/12/0/0/0/0/2/0/0/0
node:node3|interface:lan7|nmid=7
node:node3|interface:lan7|type=standby
node:node3|interface:lan8|name=lan8
node:node3|interface:lan8|id=8
node:node3|interface:lan8|status=up
node:node3|interface:lan8|disabled=false
node:node3|interface:lan8|mac_address=00:1e:0b:51:86:f5
node:node3|interface:lan8|ppa=8
node:node3|interface:lan8|bridged_net=3
node:node3|interface:lan8|mac_type=Ethernet
node:node3|interface:lan8|hardware_path=2/0/12/0/0/0/0/2/0/0/1
node:node3|interface:lan8|nmid=8
node:node3|interface:lan8|type=standby
node:node3|subnet:11.9.0.0|name=11.9.0.0
node:node3|subnet:11.9.0.0|route_id=1
node:node3|subnet:11.9.0.0|status=up
node:node3|subnet:11.9.0.0|ip_monitor=off
node:node3|subnet:11.1032.0|name=11.1032.0
node:node3|subnet:11.1032.0|route_id=2
node:node3|subnet:11.1032.0|status=up
node:node3|subnet:11.1032.0|ip_monitor=off
node:node3|subnet:145.109.44.0|name=145.109.44.0
node:node3|subnet:145.109.44.0|route_id=3
node:node3|subnet:145.109.44.0|status=up
node:node3|subnet:145.109.44.0|ip_monitor=on
node:node3|subnet:145.109.44.0|polling_target=145.109.44.5
node:node3|subnet:11.1030.0|name=11.1030.0
node:node3|subnet:11.1030.0|route_id=4
node:node3|subnet:11.1030.0|status=up
node:node3|subnet:11.1030.0|ip_monitor=off
node:node1|name=node1
node:node1|status=up
node:node1|state=running
node:node1|initial_incarnation=17
node:node1|os_status=up
node:node1|summary=ok
node:node1|id=2
node:node1|sg_version=A.11.19.00
node:node1|sg_patch=PHSS_42988
node:node1|os_release=B.11.31
node:node1|cpu_architecture=IA64
node:node1|boot_timestamp=1413122845
node:node1|interface:lan2|name=lan2
node:node1|interface:lan2|id=5
node:node1|interface:lan2|status=up
node:node1|interface:lan2|disabled=false
node:node1|interface:lan2|mac_address=18:a9:05:4a:66:6c
node:node1|interface:lan2|ppa=2
node:node1|interface:lan2|bridged_net=1
node:node1|interface:lan2|mac_type=Ethernet
node:node1|interface:lan2|hardware_path=1/0/14/1/0/6/0
node:node1|interface:lan2|nmid=11
node:node1|interface:lan2|type=primary
node:node1|interface:lan2|ip_address:11.9.0.98|name=11.9.0.98
node:node1|interface:lan2|ip_address:11.9.0.98|netmask=255.255.255.128
node:node1|interface:lan2|ip_address:11.9.0.98|subnet=11.9.0.0
node:node1|interface:lan2|ip_address:11.9.0.98|route_id=1
node:node1|interface:lan2|ip_address:11.9.0.98|heartbeat=true
node:node1|interface:lan3|name=lan3
node:node1|interface:lan3|id=7
node:node1|interface:lan3|status=up
node:node1|interface:lan3|disabled=false
node:node1|interface:lan3|mac_address=18:a9:05:4a:66:6d
node:node1|interface:lan3|ppa=3
node:node1|interface:lan3|bridged_net=2
node:node1|interface:lan3|mac_type=Ethernet
node:node1|interface:lan3|hardware_path=1/0/14/1/0/6/1
node:node1|interface:lan3|nmid=12
node:node1|interface:lan3|type=primary
node:node1|interface:lan3|ip_address:11.1033.86|name=11.1033.86
node:node1|interface:lan3|ip_address:11.1033.86|netmask=255.255.254.0
node:node1|interface:lan3|ip_address:11.1033.86|subnet=11.1032.0
node:node1|interface:lan3|ip_address:11.1033.86|route_id=2
node:node1|interface:lan3|ip_address:11.1033.86|heartbeat=true
node:node1|interface:lan0|name=lan0
node:node1|interface:lan0|id=1
node:node1|interface:lan0|status=up
node:node1|interface:lan0|disabled=false
node:node1|interface:lan0|mac_address=18:a9:05:4a:56:86
node:node1|interface:lan0|ppa=0
node:node1|interface:lan0|bridged_net=3
node:node1|interface:lan0|mac_type=Ethernet
node:node1|interface:lan0|hardware_path=1/0/12/1/0/6/0
node:node1|interface:lan0|nmid=9
node:node1|interface:lan0|type=primary
node:node1|interface:lan0|ip_address:145.109.44.122|name=145.109.44.122
node:node1|interface:lan0|ip_address:145.109.44.122|netmask=255.255.255.128
node:node1|interface:lan0|ip_address:145.109.44.122|subnet=145.109.44.0
node:node1|interface:lan0|ip_address:145.109.44.122|route_id=3
node:node1|interface:lan0|ip_address:145.109.44.122|heartbeat=true
node:node1|interface:lan1|name=lan1
node:node1|interface:lan1|id=3
node:node1|interface:lan1|status=up
node:node1|interface:lan1|disabled=false
node:node1|interface:lan1|mac_address=18:a9:05:4a:56:87
node:node1|interface:lan1|ppa=1
node:node1|interface:lan1|bridged_net=4
node:node1|interface:lan1|mac_type=Ethernet
node:node1|interface:lan1|hardware_path=1/0/12/1/0/6/1
node:node1|interface:lan1|nmid=10
node:node1|interface:lan1|type=primary
node:node1|interface:lan1|ip_address:11.103.0.192|name=11.1030.192
node:node1|interface:lan1|ip_address:11.103.0.192|netmask=255.255.254.0
node:node1|interface:lan1|ip_address:11.103..0.192|subnet=11.103.0.0
node:node1|interface:lan1|ip_address:11.103.0.192|route_id=4
node:node1|interface:lan1|ip_address:11.103.0.192|heartbeat=true
node:node1|interface:lan7|name=lan7
node:node1|interface:lan7|id=4
node:node1|interface:lan7|status=up
node:node1|interface:lan7|disabled=false
node:node1|interface:lan7|mac_address=00:1e:0b:45:58:b9
node:node1|interface:lan7|ppa=7
node:node1|interface:lan7|bridged_net=1
node:node1|interface:lan7|mac_type=Ethernet
node:node1|interface:lan7|hardware_path=0/0/12/1/0/6/1
node:node1|interface:lan7|nmid=4
node:node1|interface:lan7|type=standby
node:node1|interface:lan9|name=lan9
node:node1|interface:lan9|id=6
node:node1|interface:lan9|status=up
node:node1|interface:lan9|disabled=false
node:node1|interface:lan9|mac_address=00:1e:0b:45:58:a3
node:node1|interface:lan9|ppa=9
node:node1|interface:lan9|bridged_net=3
node:node1|interface:lan9|mac_type=Ethernet
node:node1|interface:lan9|hardware_path=0/0/14/1/0/6/1
node:node1|interface:lan9|nmid=6
node:node1|interface:lan9|type=standby
node:node1|interface:lan8|name=lan8
node:node1|interface:lan8|id=8
node:node1|interface:lan8|status=up
node:node1|interface:lan8|disabled=false
node:node1|interface:lan8|mac_address=00:1e:0b:45:58:a2
node:node1|interface:lan8|ppa=8
node:node1|interface:lan8|bridged_net=3
node:node1|interface:lan8|mac_type=Ethernet
node:node1|interface:lan8|hardware_path=0/0/14/1/0/6/0
node:node1|interface:lan8|nmid=5
node:node1|interface:lan8|type=standby
node:node1|interface:lan6|name=lan6
node:node1|interface:lan6|id=2
node:node1|interface:lan6|status=up
node:node1|interface:lan6|disabled=false
node:node1|interface:lan6|mac_address=00:1e:0b:45:58:b8
node:node1|interface:lan6|ppa=6
node:node1|interface:lan6|bridged_net=3
node:node1|interface:lan6|mac_type=Ethernet
node:node1|interface:lan6|hardware_path=0/0/12/1/0/6/0
node:node1|interface:lan6|nmid=3
node:node1|interface:lan6|type=standby
node:node1|subnet:11.9.0.0|name=11.9.0.0
node:node1|subnet:11.9.0.0|route_id=1
node:node1|subnet:11.9.0.0|status=up
node:node1|subnet:11.9.0.0|ip_monitor=off
node:node1|subnet:11.103.2.0|name=11.103.2.0
node:node1|subnet:11.103.2.0|route_id=2
node:node1|subnet:11.103.2.0|status=up
node:node1|subnet:11.103.2.0|ip_monitor=off
node:node1|subnet:145.109.44.0|name=145.109.44.0
node:node1|subnet:145.109.44.0|route_id=3
node:node1|subnet:145.109.44.0|status=up
node:node1|subnet:145.109.44.0|ip_monitor=on
node:node1|subnet:145.109.44.0|polling_target=145.109.44.5
node:node1|subnet:11.103.0.0|name=11.103.0.0
node:node1|subnet:11.103.0.0|route_id=4
node:node1|subnet:11.103.0.0|status=up
node:node1|subnet:11.103.0.0|ip_monitor=off
node:node2|name=node2
node:node2|status=up
node:node2|state=running
node:node2|initial_incarnation=8
node:node2|os_status=up
node:node2|summary=ok
node:node2|id=3
node:node2|sg_version=A.11.19.00
node:node2|sg_patch=PHSS_42988
node:node2|os_release=B.11.31
node:node2|cpu_architecture=IA64
node:node2|boot_timestamp=1413098149
node:node2|interface:lan4|name=lan4
node:node2|interface:lan4|id=5
node:node2|interface:lan4|status=up
node:node2|interface:lan4|disabled=false
node:node2|interface:lan4|mac_address=18:a9:05:4a:e6:d2
node:node2|interface:lan4|ppa=4
node:node2|interface:lan4|bridged_net=1
node:node2|interface:lan4|mac_type=Ethernet
node:node2|interface:lan4|hardware_path=0/0/14/1/0/6/0
node:node2|interface:lan4|nmid=5
node:node2|interface:lan4|type=primary
node:node2|interface:lan4|ip_address:11.9.0.99|name=11.9.0.99
node:node2|interface:lan4|ip_address:11.9.0.99|netmask=255.255.255.128
node:node2|interface:lan4|ip_address:11.9.0.99|subnet=11.9.0.0
node:node2|interface:lan4|ip_address:11.9.0.99|route_id=1
node:node2|interface:lan4|ip_address:11.9.0.99|heartbeat=true
node:node2|interface:lan5|name=lan5
node:node2|interface:lan5|id=7
node:node2|interface:lan5|status=up
node:node2|interface:lan5|disabled=false
node:node2|interface:lan5|mac_address=18:a9:05:4a:e6:d3
node:node2|interface:lan5|ppa=5
node:node2|interface:lan5|bridged_net=2
node:node2|interface:lan5|mac_type=Ethernet
node:node2|interface:lan5|hardware_path=0/0/14/1/0/6/1
node:node2|interface:lan5|nmid=6
node:node2|interface:lan5|type=primary
node:node2|interface:lan5|ip_address:11.103.3.87|name=11.103.3.87
node:node2|interface:lan5|ip_address:11.103.3.87|netmask=255.255.254.0
node:node2|interface:lan5|ip_address:11.103.3.87|subnet=11.103.2.0
node:node2|interface:lan5|ip_address:11.103.3.87|route_id=2
node:node2|interface:lan5|ip_address:11.103.3.87|heartbeat=true
node:node2|interface:lan2|name=lan2
node:node2|interface:lan2|id=1
node:node2|interface:lan2|status=up
node:node2|interface:lan2|disabled=false
node:node2|interface:lan2|mac_address=18:a9:05:4a:e6:5c
node:node2|interface:lan2|ppa=2
node:node2|interface:lan2|bridged_net=3
node:node2|interface:lan2|mac_type=Ethernet
node:node2|interface:lan2|hardware_path=0/0/12/1/0/6/0
node:node2|interface:lan2|nmid=3
node:node2|interface:lan2|type=primary
node:node2|interface:lan2|ip_address:145.109.44.123|name=145.109.44.123
node:node2|interface:lan2|ip_address:145.109.44.123|netmask=255.255.255.128
node:node2|interface:lan2|ip_address:145.109.44.123|subnet=145.109.44.0
node:node2|interface:lan2|ip_address:145.109.44.123|route_id=3
node:node2|interface:lan2|ip_address:145.109.44.123|heartbeat=true
node:node2|interface:lan3|name=lan3
node:node2|interface:lan3|id=3
node:node2|interface:lan3|status=up
node:node2|interface:lan3|disabled=false
node:node2|interface:lan3|mac_address=18:a9:05:4a:e6:5d
node:node2|interface:lan3|ppa=3
node:node2|interface:lan3|bridged_net=4
node:node2|interface:lan3|mac_type=Ethernet
node:node2|interface:lan3|hardware_path=0/0/12/1/0/6/1
node:node2|interface:lan3|nmid=4
node:node2|interface:lan3|type=primary
node:node2|interface:lan3|ip_address:11.103.0.193|name=11.103.0.193
node:node2|interface:lan3|ip_address:11.103.0.193|netmask=255.255.254.0
node:node2|interface:lan3|ip_address:11.103.0.193|subnet=11.103.0.0
node:node2|interface:lan3|ip_address:11.103.0.193|route_id=4
node:node2|interface:lan3|ip_address:11.103.0.193|heartbeat=true
node:node2|interface:lan11|name=lan11
node:node2|interface:lan11|id=6
node:node2|interface:lan11|status=up
node:node2|interface:lan11|disabled=false
node:node2|interface:lan11|mac_address=18:a9:05:4a:e6:d7
node:node2|interface:lan11|ppa=11
node:node2|interface:lan11|bridged_net=1
node:node2|interface:lan11|mac_type=Ethernet
node:node2|interface:lan11|hardware_path=1/0/14/1/0/6/1
node:node2|interface:lan11|nmid=12
node:node2|interface:lan11|type=standby
node:node2|interface:lan8|name=lan8
node:node2|interface:lan8|id=2
node:node2|interface:lan8|status=up
node:node2|interface:lan8|disabled=false
node:node2|interface:lan8|mac_address=00:1e:0b:45:58:d4
node:node2|interface:lan8|ppa=8
node:node2|interface:lan8|bridged_net=1
node:node2|interface:lan8|mac_type=Ethernet
node:node2|interface:lan8|hardware_path=1/0/12/1/0/6/0
node:node2|interface:lan8|nmid=9
node:node2|interface:lan8|type=standby
node:node2|interface:lan9|name=lan9
node:node2|interface:lan9|id=4
node:node2|interface:lan9|status=up
node:node2|interface:lan9|disabled=false
node:node2|interface:lan9|mac_address=00:1e:0b:45:58:d5
node:node2|interface:lan9|ppa=9
node:node2|interface:lan9|bridged_net=3
node:node2|interface:lan9|mac_type=Ethernet
node:node2|interface:lan9|hardware_path=1/0/12/1/0/6/1
node:node2|interface:lan9|nmid=10
node:node2|interface:lan9|type=standby
node:node2|subnet:11.9.0.0|name=11.9.0.0
node:node2|subnet:11.9.0.0|route_id=1
node:node2|subnet:11.9.0.0|status=up
node:node2|subnet:11.9.0.0|ip_monitor=off
node:node2|subnet:11.103.2.0|name=11.103.2.0
node:node2|subnet:11.103.2.0|route_id=2
node:node2|subnet:11.103.2.0|status=up
node:node2|subnet:11.103.2.0|ip_monitor=off
node:node2|subnet:145.109.44.0|name=145.109.44.0
node:node2|subnet:145.109.44.0|route_id=3
node:node2|subnet:145.109.44.0|status=up
node:node2|subnet:145.109.44.0|ip_monitor=on
node:node2|subnet:145.109.44.0|polling_target=145.109.44.5
node:node2|subnet:11.103.0.0|name=11.103.0.0
node:node2|subnet:11.103.0.0|route_id=4
node:node2|subnet:11.103.0.0|status=up
node:node2|subnet:11.103.0.0|ip_monitor=off
package:dbciZP1|name=dbciZP1
package:dbciZP1|style=modular
package:dbciZP1|type=failover
package:dbciZP1|status=up
package:dbciZP1|state=maintenance
package:dbciZP1|highly_available=no
package:dbciZP1|summary=degraded
package:dbciZP1|autorun=disabled
package:dbciZP1|owner=node0
package:dbciZP1|id=22017
package:dbciZP1|initial_autorun=enabled
package:dbciZP1|failover_policy=configured_node
package:dbciZP1|failback_policy=manual
package:dbciZP1|local_lan_failover_allowed=enabled
package:dbciZP1|failfast=disabled
package:dbciZP1|run_script_timeout=no_timeout
package:dbciZP1|halt_script_timeout=no_timeout
package:dbciZP1|priority=no_priority
package:dbciZP1|successor_halt_timeout=no_timeout
package:dbciZP1|script_log_file=/var/adm/cmcluster/log/dbciZP1.log
package:dbciZP1|node:node0|name=node0
package:dbciZP1|node:node0|status=up
package:dbciZP1|node:node0|state=maintenance
package:dbciZP1|node:node0|switching=disabled
package:dbciZP1|node:node0|last_run_time=1413125815
package:dbciZP1|node:node0|last_halt_time=0
package:dbciZP1|node:node0|available=yes
package:dbciZP1|node:node0|last_halt_failed=no
package:dbciZP1|node:node0|type=Primary
package:dbciZP1|node:node0|order=1
package:dbciZP1|node:node3|name=node3
package:dbciZP1|node:node3|status=down
package:dbciZP1|node:node3|state=halted
package:dbciZP1|node:node3|switching=enabled
package:dbciZP1|node:node3|last_run_time=1413116711
package:dbciZP1|node:node3|last_halt_time=1413125587
package:dbciZP1|node:node3|available=yes
package:dbciZP1|node:node3|last_halt_failed=yes
package:dbciZP1|node:node3|type=Alternate
package:dbciZP1|node:node3|order=2
package:dbciZP1|service:nfs.monitor|name=nfs.monitor
package:dbciZP1|service:nfs.monitor|id=1
package:dbciZP1|service:nfs.monitor|failfast=disabled
package:dbciZP1|service:nfs.monitor|halt_timeout=0
package:dbciZP1|service:nfs.monitor|command=”$SGCONF/scripts/nfs/nfs_upcc.mon”
package:dbciZP1|service:nfs.monitor|restart=none
package:dbciZP1|service:nfs.monitor|node:node0|status=unknown
package:dbciZP1|service:nfs.monitor|node:node0|restart_limit=unknown
package:dbciZP1|service:nfs.monitor|node:node0|restart_count=0
package:dbciZP1|service:nfs.monitor|node:node3|status=down
package:dbciZP1|service:nfs.monitor|node:node3|restart_limit=unknown
package:dbciZP1|service:nfs.monitor|node:node3|restart_count=0
package:dbciZP1|ip_address:145.109.44.124|name=145.109.44.124
package:dbciZP1|ip_address:11.9.0.96|name=11.9.0.96
package:dbciZP1|package_description=”ZP1 Package”
package:dbciZP1|module_name:sg/basic|module_name=sg/basic
package:dbciZP1|module_name:sg/basic|module_version=1
package:dbciZP1|module_name:sg/all|module_name=sg/all
package:dbciZP1|module_name:sg/all|module_version=1
package:dbciZP1|module_name:sg/failover|module_name=sg/failover
package:dbciZP1|module_name:sg/failover|module_version=1
package:dbciZP1|module_name:sg/priority|module_name=sg/priority
package:dbciZP1|module_name:sg/priority|module_version=1
package:dbciZP1|module_name:sg/dependency|module_name=sg/dependency
package:dbciZP1|module_name:sg/dependency|module_version=1
package:dbciZP1|module_name:sg/weight|module_name=sg/weight
package:dbciZP1|module_name:sg/weight|module_version=1
package:dbciZP1|module_name:sg/monitor_subnet|module_name=sg/monitor_subnet
package:dbciZP1|module_name:sg/monitor_subnet|module_version=1
package:dbciZP1|module_name:sg/package_ip|module_name=sg/package_ip
package:dbciZP1|module_name:sg/package_ip|module_version=1
package:dbciZP1|module_name:sg/package_ip|module_scripts=$SGCONF/scripts/sg/package_ip.sh
package:dbciZP1|module_name:sg/service|module_name=sg/service
package:dbciZP1|module_name:sg/service|module_version=1
package:dbciZP1|module_name:sg/service|module_scripts=$SGCONF/scripts/sg/service.sh
package:dbciZP1|module_name:sg/resource|module_name=sg/resource
package:dbciZP1|module_name:sg/resource|module_version=1
package:dbciZP1|module_name:sg/resource|module_scripts=$SGCONF/scripts/sg/resource.sh
package:dbciZP1|module_name:sg/volume_group|module_name=sg/volume_group
package:dbciZP1|module_name:sg/volume_group|module_version=1
package:dbciZP1|module_name:sg/volume_group|module_scripts=$SGCONF/scripts/sg/volume_group.sh
package:dbciZP1|module_name:sg/filesystem|module_name=sg/filesystem
package:dbciZP1|module_name:sg/filesystem|module_version=1
package:dbciZP1|module_name:sg/filesystem|module_scripts=$SGCONF/scripts/sg/filesystem.sh
package:dbciZP1|module_name:sg/pev|module_name=sg/pev
package:dbciZP1|module_name:sg/pev|module_version=1
package:dbciZP1|module_name:sg/external_pre|module_name=sg/external_pre
package:dbciZP1|module_name:sg/external_pre|module_version=1
package:dbciZP1|module_name:sg/external_pre|module_scripts=$SGCONF/scripts/sg/external_pre.sh
package:dbciZP1|module_name:sg/external|module_name=sg/external
package:dbciZP1|module_name:sg/external|module_version=1
package:dbciZP1|module_name:sg/external|module_scripts=$SGCONF/scripts/sg/external.sh
package:dbciZP1|module_name:sg/acp|module_name=sg/acp
package:dbciZP1|module_name:sg/acp|module_version=1
package:dbciZP1|module_name:sgesap/all|module_name=sgesap/all
package:dbciZP1|module_name:sgesap/all|module_version=1
package:dbciZP1|module_name:sgesap/dbinstance|module_name=sgesap/dbinstance
package:dbciZP1|module_name:sgesap/dbinstance|module_version=1
package:dbciZP1|module_name:sgesap/dbinstance|module_scripts=$SGCONF/scripts/sgesap/dbinstance.sh
package:dbciZP1|module_name:sgesap/db_global|module_name=sgesap/db_global
package:dbciZP1|module_name:sgesap/db_global|module_version=1
package:dbciZP1|module_name:sgesap/oracledb_spec|module_name=sgesap/oracledb_spec
package:dbciZP1|module_name:sgesap/oracledb_spec|module_version=1
package:dbciZP1|module_name:sgesap/sapinstance|module_name=sgesap/sapinstance
package:dbciZP1|module_name:sgesap/sapinstance|module_version=1
package:dbciZP1|module_name:sgesap/sap_global|module_name=sgesap/sap_global
package:dbciZP1|module_name:sgesap/sap_global|module_version=1
package:dbciZP1|module_name:sgesap/stack|module_name=sgesap/stack
package:dbciZP1|module_name:sgesap/stack|module_version=1
package:dbciZP1|module_name:sgesap/stack|module_scripts=$SGCONF/scripts/sgesap/sapinstance.sh
package:dbciZP1|module_name:sgesap/sapextinstance|module_name=sgesap/sapextinstance
package:dbciZP1|module_name:sgesap/sapextinstance|module_version=1
package:dbciZP1|module_name:sgesap/sapextinstance_pre|module_name=sgesap/sapextinstance_pre
package:dbciZP1|module_name:sgesap/sapextinstance_pre|module_version=1
package:dbciZP1|module_name:sgesap/sapextinstance_pre|module_scripts=$SGCONF/scripts/sgesap/sapextinstance_pre.sh
package:dbciZP1|module_name:sgesap/sapextinstance_post|module_name=sgesap/sapextinstance_post
package:dbciZP1|module_name:sgesap/sapextinstance_post|module_version=1
package:dbciZP1|module_name:sgesap/sapextinstance_post|module_scripts=$SGCONF/scripts/sgesap/sapextinstance_post.sh
package:dbciZP1|module_name:sgesap/sapinfra|module_name=sgesap/sapinfra
package:dbciZP1|module_name:sgesap/sapinfra|module_version=1
package:dbciZP1|module_name:sgesap/sapinfra_pre|module_name=sgesap/sapinfra_pre
package:dbciZP1|module_name:sgesap/sapinfra_pre|module_version=1
package:dbciZP1|module_name:sgesap/sapinfra_pre|module_scripts=$SGCONF/scripts/sgesap/infra_pre.sh
package:dbciZP1|module_name:sgesap/sapinfra_post|module_name=sgesap/sapinfra_post
package:dbciZP1|module_name:sgesap/sapinfra_post|module_version=1
package:dbciZP1|module_name:sgesap/sapinfra_post|module_scripts=$SGCONF/scripts/sgesap/infra_post.sh
package:dbciZP1|module_name:sgesap/mdm|module_name=sgesap/mdm
package:dbciZP1|module_name:sgesap/mdm|module_version=1
package:dbciZP1|module_name:sgesap/mdm|module_scripts=$SGCONF/scripts/sgesap/mdm.sh
package:dbciZP1|module_name:nfs/hanfs|module_name=nfs/hanfs
package:dbciZP1|module_name:nfs/hanfs|module_version=1
package:dbciZP1|module_name:nfs/hanfs_export|module_name=nfs/hanfs_export
package:dbciZP1|module_name:nfs/hanfs_export|module_version=1
package:dbciZP1|module_name:nfs/hanfs_export|module_scripts=$SGCONF/scripts/nfs/hanfs_export.sh
package:dbciZP1|module_name:nfs/hanfs_flm|module_name=nfs/hanfs_flm
package:dbciZP1|module_name:nfs/hanfs_flm|module_version=1
package:dbciZP1|module_name:nfs/hanfs_flm|module_scripts=$SGCONF/scripts/nfs/hanfs_flm.sh
package:dbciZP1|operation_sequence:$SGCONF/scripts/sg/external_pre.sh|operation_sequence=$SGCONF/scripts/sg/external_pre.sh
package:dbciZP1|operation_sequence:$SGCONF/scripts/sg/volume_group.sh|operation_sequence=$SGCONF/scripts/sg/volume_group.sh
package:dbciZP1|operation_sequence:$SGCONF/scripts/sg/filesystem.sh|operation_sequence=$SGCONF/scripts/sg/filesystem.sh
package:dbciZP1|operation_sequence:$SGCONF/scripts/nfs/hanfs_export.sh|operation_sequence=$SGCONF/scripts/nfs/hanfs_export.sh
package:dbciZP1|operation_sequence:$SGCONF/scripts/sg/package_ip.sh|operation_sequence=$SGCONF/scripts/sg/package_ip.sh
package:dbciZP1|operation_sequence:$SGCONF/scripts/nfs/hanfs_flm.sh|operation_sequence=$SGCONF/scripts/nfs/hanfs_flm.sh
package:dbciZP1|operation_sequence:$SGCONF/scripts/sgesap/infra_pre.sh|operation_sequence=$SGCONF/scripts/sgesap/infra_pre.sh
package:dbciZP1|operation_sequence:$SGCONF/scripts/sgesap/sapextinstance_pre.sh|operation_sequence=$SGCONF/scripts/sgesap/sapextinstance_pre.sh
package:dbciZP1|operation_sequence:$SGCONF/scripts/sgesap/dbinstance.sh|operation_sequence=$SGCONF/scripts/sgesap/dbinstance.sh
package:dbciZP1|operation_sequence:$SGCONF/scripts/sgesap/sapinstance.sh|operation_sequence=$SGCONF/scripts/sgesap/sapinstance.sh
package:dbciZP1|operation_sequence:$SGCONF/scripts/sgesap/sapextinstance_post.sh|operation_sequence=$SGCONF/scripts/sgesap/sapextinstance_post.sh
package:dbciZP1|operation_sequence:$SGCONF/scripts/sgesap/infra_post.sh|operation_sequence=$SGCONF/scripts/sgesap/infra_post.sh
package:dbciZP1|operation_sequence:$SGCONF/scripts/sg/external.sh|operation_sequence=$SGCONF/scripts/sg/external.sh
package:dbciZP1|ip_subnet:145.109.44.0|ip_subnet=145.109.44.0
package:dbciZP1|ip_subnet:145.109.44.0|ip_address=145.109.44.124
package:dbciZP1|ip_subnet:11.9.0.0|ip_subnet=11.9.0.0
package:dbciZP1|ip_subnet:11.9.0.0|ip_address=11.9.0.96
package:dbciZP1|concurrent_vgchange_operations=1
package:dbciZP1|enable_threaded_vgchange=0
package:dbciZP1|vgchange_cmd=”vgchange -a e”
package:dbciZP1|cvm_activation_cmd=”vxdg -g \${DiskGroup} set activation=exclusivewrite”
package:dbciZP1|vxvol_cmd=”vxvol -g \${DiskGroup} startall”
package:dbciZP1|vg:vgsapZP1|vg=vgsapZP1
package:dbciZP1|vg:vgZP1|vg=vgZP1
package:dbciZP1|vxvm_dg_retry=no
package:dbciZP1|deactivation_retry_count=2
package:dbciZP1|kill_processes_accessing_raw_devices=no
package:dbciZP1|concurrent_fsck_operations=1
package:dbciZP1|concurrent_mount_and_umount_operations=1
package:dbciZP1|fs_mount_retry_count=3
package:dbciZP1|fs_umount_retry_count=5
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_sapmnt_ZP1|fs_name=/dev/vgsapZP1/lv_sapmnt_ZP1
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_sapmnt_ZP1|fs_directory=/export/sapmnt/ZP1
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_sapmnt_ZP1|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_sapmnt_ZP1|fs_mount_opt=”-o rw,largefiles,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_sapmnt_ZP1|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_sapmnt_ZP1|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_usr_sap_ZP1_DVEBMGS00|fs_name=/dev/vgsapZP1/lv_usr_sap_ZP1_DVEBMGS00
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_usr_sap_ZP1_DVEBMGS00|fs_directory=/usr/sap/ZP1/DVEBMGS00
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_usr_sap_ZP1_DVEBMGS00|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_usr_sap_ZP1_DVEBMGS00|fs_mount_opt=”-o rw,largefiles,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_usr_sap_ZP1_DVEBMGS00|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_usr_sap_ZP1_DVEBMGS00|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_usr_sap_ZP1_ASCS01|fs_name=/dev/vgsapZP1/lv_usr_sap_ZP1_ASCS01
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_usr_sap_ZP1_ASCS01|fs_directory=/usr/sap/ZP1/ASCS01
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_usr_sap_ZP1_ASCS01|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_usr_sap_ZP1_ASCS01|fs_mount_opt=”-o rw,largefiles,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_usr_sap_ZP1_ASCS01|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_usr_sap_ZP1_ASCS01|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1|fs_name=/dev/vgsapZP1/lv_oracle_ZP1
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1|fs_directory=/oracle/ZP1
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1|fs_mount_opt=”-o rw,largefiles,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_origlogB|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_origlogB
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_origlogB|fs_directory=/oracle/ZP1/origlogB
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_origlogB|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_origlogB|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_origlogB|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_origlogB|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_origlogA|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_origlogA
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_origlogA|fs_directory=/oracle/ZP1/origlogA
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_origlogA|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_origlogA|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_origlogA|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_origlogA|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_mirrlogB|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_mirrlogB
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_mirrlogB|fs_directory=/oracle/ZP1/mirrlogB
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_mirrlogB|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_mirrlogB|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_mirrlogB|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_mirrlogB|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_mirrlogA|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_mirrlogA
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_mirrlogA|fs_directory=/oracle/ZP1/mirrlogA
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_mirrlogA|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_mirrlogA|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_mirrlogA|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_mirrlogA|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_saparch|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_saparch
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_saparch|fs_directory=/oracle/ZP1/saparch
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_saparch|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_saparch|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_saparch|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_saparch|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_oraarch|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_oraarch
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_oraarch|fs_directory=/oracle/ZP1/oraarch
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_oraarch|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_oraarch|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_oraarch|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_oraarch|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapreorg|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapreorg
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapreorg|fs_directory=/oracle/ZP1/sapreorg
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapreorg|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapreorg|fs_mount_opt=”-o rw,largefiles,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapreorg|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapreorg|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_sapedi_ZP1|fs_name=/dev/vgsapZP1/lv_sapedi_ZP1
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_sapedi_ZP1|fs_directory=/sapedi/ZP1
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_sapedi_ZP1|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_sapedi_ZP1|fs_mount_opt=”-o rw,largefiles,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_sapedi_ZP1|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_sapedi_ZP1|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata1|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapdata1
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata1|fs_directory=/oracle/ZP1/sapdata1
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata1|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata1|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata1|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata1|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata2|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapdata2
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata2|fs_directory=/oracle/ZP1/sapdata2
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata2|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata2|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata2|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata2|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata3|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapdata3
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata3|fs_directory=/oracle/ZP1/sapdata3
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata3|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata3|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata3|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata3|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata4|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapdata4
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata4|fs_directory=/oracle/ZP1/sapdata4
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata4|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata4|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata4|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata4|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata5|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapdata5
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata5|fs_directory=/oracle/ZP1/sapdata5
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata5|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata5|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata5|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata5|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata6|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapdata6
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata6|fs_directory=/oracle/ZP1/sapdata6
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata6|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata6|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata6|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata6|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata7|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapdata7
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata7|fs_directory=/oracle/ZP1/sapdata7
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata7|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata7|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata7|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata7|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata8|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapdata8
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata8|fs_directory=/oracle/ZP1/sapdata8
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata8|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata8|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata8|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata8|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata9|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapdata9
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata9|fs_directory=/oracle/ZP1/sapdata9
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata9|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata9|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata9|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata9|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata10|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapdata10
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata10|fs_directory=/oracle/ZP1/sapdata10
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata10|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata10|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata10|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata10|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata11|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapdata11
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata11|fs_directory=/oracle/ZP1/sapdata11
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata11|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata11|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata11|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata11|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata12|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapdata12
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata12|fs_directory=/oracle/ZP1/sapdata12
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata12|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata12|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata12|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata12|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata13|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapdata13
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata13|fs_directory=/oracle/ZP1/sapdata13
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata13|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata13|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata13|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata13|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata14|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapdata14
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata14|fs_directory=/oracle/ZP1/sapdata14
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata14|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata14|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata14|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata14|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata15|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapdata15
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata15|fs_directory=/oracle/ZP1/sapdata15
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata15|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata15|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata15|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata15|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata16|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapdata16
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata16|fs_directory=/oracle/ZP1/sapdata16
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata16|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata16|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata16|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata16|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata17|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapdata17
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata17|fs_directory=/oracle/ZP1/sapdata17
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata17|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata17|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata17|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata17|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata18|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapdata18
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata18|fs_directory=/oracle/ZP1/sapdata18
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata18|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata18|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata18|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata18|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata19|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapdata19
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata19|fs_directory=/oracle/ZP1/sapdata19
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata19|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata19|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata19|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata19|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata20|fs_name=/dev/vgsapZP1/lv_oracle_ZP1_sapdata20
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata20|fs_directory=/oracle/ZP1/sapdata20
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata20|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata20|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata20|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_oracle_ZP1_sapdata20|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_opt_BMC|fs_name=/dev/vgsapZP1/lv_opt_BMC
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_opt_BMC|fs_directory=/opt/BMC
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_opt_BMC|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_opt_BMC|fs_mount_opt=”-o rw,largefiles,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_opt_BMC|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_opt_BMC|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_usr_sap_SMD|fs_name=/dev/vgsapZP1/lv_usr_sap_SMD
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_usr_sap_SMD|fs_directory=/usr/sap/SMD
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_usr_sap_SMD|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_usr_sap_SMD|fs_mount_opt=”-o rw,largefiles,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_usr_sap_SMD|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgsapZP1/lv_usr_sap_SMD|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgZP1/lv_oracle_ZP1_sapdata21|fs_name=/dev/vgZP1/lv_oracle_ZP1_sapdata21
package:dbciZP1|fs_name:/dev/vgZP1/lv_oracle_ZP1_sapdata21|fs_directory=/oracle/ZP1/sapdata21
package:dbciZP1|fs_name:/dev/vgZP1/lv_oracle_ZP1_sapdata21|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgZP1/lv_oracle_ZP1_sapdata21|fs_mount_opt=”-o rw,largefiles,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgZP1/lv_oracle_ZP1_sapdata21|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgZP1/lv_oracle_ZP1_sapdata21|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgZP1/lv_oracle_ZP1_sapdata22|fs_name=/dev/vgZP1/lv_oracle_ZP1_sapdata22
package:dbciZP1|fs_name:/dev/vgZP1/lv_oracle_ZP1_sapdata22|fs_directory=/oracle/ZP1/sapdata22
package:dbciZP1|fs_name:/dev/vgZP1/lv_oracle_ZP1_sapdata22|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgZP1/lv_oracle_ZP1_sapdata22|fs_mount_opt=”-o rw,largefiles,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgZP1/lv_oracle_ZP1_sapdata22|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgZP1/lv_oracle_ZP1_sapdata22|fs_fsck_opt=””
package:dbciZP1|fs_name:/dev/vgZP1/lv_oracle_ZP1_sapdata23|fs_name=/dev/vgZP1/lv_oracle_ZP1_sapdata23
package:dbciZP1|fs_name:/dev/vgZP1/lv_oracle_ZP1_sapdata23|fs_directory=/oracle/ZP1/sapdata23
package:dbciZP1|fs_name:/dev/vgZP1/lv_oracle_ZP1_sapdata23|fs_type=”vxfs”
package:dbciZP1|fs_name:/dev/vgZP1/lv_oracle_ZP1_sapdata23|fs_mount_opt=”-o rw,largefiles,delaylog,nodatainlog”
package:dbciZP1|fs_name:/dev/vgZP1/lv_oracle_ZP1_sapdata23|fs_umount_opt=””
package:dbciZP1|fs_name:/dev/vgZP1/lv_oracle_ZP1_sapdata23|fs_fsck_opt=””
package:dbciZP1|external_pre_script:/etc/cmcluster/ZP1/force_umount.sh|external_pre_script=/etc/cmcluster/ZP1/force_umount.sh
package:dbciZP1|external_script:/etc/cmcluster/ZP1/manage_DVEBMGS00.sh|external_script=/etc/cmcluster/ZP1/manage_DVEBMGS00.sh
package:dbciZP1|sgesap/db_global/db_vendor=oracle
package:dbciZP1|sgesap/db_global/db_system=ZP1
package:dbciZP1|sgesap/oracledb_spec/listener_name=LISTENER
package:dbciZP1|sgesap/sap_global/sap_system=ZP1
package:dbciZP1|sgesap/sap_global/rem_comm=ssh
package:dbciZP1|sgesap/sap_global/cleanup_policy=normal
package:dbciZP1|sgesap/sap_global/retry_count=5
package:dbciZP1|sgesap/stack/sap_instance:ASCS01|sgesap/stack/sap_instance=ASCS01
package:dbciZP1|sgesap/stack/sap_instance:ASCS01|sgesap/stack/sap_virtual_hostname=dbciZP1d
package:dbciZP1|sgesap/sapextinstance/sap_ext_instance:D02|sgesap/sapextinstance/sap_ext_instance=D02
package:dbciZP1|sgesap/sapextinstance/sap_ext_instance:D02|sgesap/sapextinstance/sap_ext_system=ZP1
package:dbciZP1|sgesap/sapextinstance/sap_ext_instance:D02|sgesap/sapextinstance/sap_ext_host=node2
package:dbciZP1|sgesap/sapextinstance/sap_ext_instance:D02|sgesap/sapextinstance/sap_ext_treat=yyynn
package:dbciZP1|sgesap/sapextinstance/sap_ext_instance:D03|sgesap/sapextinstance/sap_ext_instance=D03
package:dbciZP1|sgesap/sapextinstance/sap_ext_instance:D03|sgesap/sapextinstance/sap_ext_system=ZP1
package:dbciZP1|sgesap/sapextinstance/sap_ext_instance:D03|sgesap/sapextinstance/sap_ext_host=node2
package:dbciZP1|sgesap/sapextinstance/sap_ext_instance:D03|sgesap/sapextinstance/sap_ext_treat=yyynn
package:dbciZP1|sgesap/sapextinstance/sap_ext_instance:D04|sgesap/sapextinstance/sap_ext_instance=D04
package:dbciZP1|sgesap/sapextinstance/sap_ext_instance:D04|sgesap/sapextinstance/sap_ext_system=ZP1
package:dbciZP1|sgesap/sapextinstance/sap_ext_instance:D04|sgesap/sapextinstance/sap_ext_host=node3
package:dbciZP1|sgesap/sapextinstance/sap_ext_instance:D04|sgesap/sapextinstance/sap_ext_treat=yyynn
package:dbciZP1|sgesap/sapextinstance/sap_ext_instance:D05|sgesap/sapextinstance/sap_ext_instance=D05
package:dbciZP1|sgesap/sapextinstance/sap_ext_instance:D05|sgesap/sapextinstance/sap_ext_system=ZP1
package:dbciZP1|sgesap/sapextinstance/sap_ext_instance:D05|sgesap/sapextinstance/sap_ext_host=node3
package:dbciZP1|sgesap/sapextinstance/sap_ext_instance:D05|sgesap/sapextinstance/sap_ext_treat=yyynn
package:dbciZP1|sgesap/sapinfra/sap_infra_sw_type:saposcol|sgesap/sapinfra/sap_infra_sw_type=saposcol
package:dbciZP1|sgesap/sapinfra/sap_infra_sw_type:saposcol|sgesap/sapinfra/sap_infra_sw_treat=startnstop
package:dbciZP1|sgesap/sapinfra/sap_infra_sw_type:saposcol|sgesap/sapinfra/sap_infra_sw_host=dbciZP1d
package:dbciZP1|nfs/hanfs_export/XFS:”-o anon=0,root=dbciZP1c:dbciZP1c.protter.com:dbciZP1d:dbciZP1d.protter.com:node0:node0.protter.com:node1:node1.protter.com:node1d:node1d.protter.com:node2:node2.protter.com:node2d:node2d.protter.com:node3:node3.protter.com:node0d:node0d.protter.com:node3d:node3d.protter.com,access=dbciZP1c:dbciZP1c.protter.com:dbciZP1d:dbciZP1d.protter.com:node0:node0.protter.com:node1:node1.protter.com:node1d:node1d.protter.com:node2:node2.protter.com:node2d:node2d.protter.com:node3:node3.protter.com:node0d:node0d.protter.com:node3d:node3d.protter.com /export/sapmnt/ZP1″|nfs/hanfs_export/XFS=”-o anon=0,root=dbciZP1c:dbciZP1c.protter.com:dbciZP1d:dbciZP1d.protter.com:node0:node0.protter.com:node1:node1.protter.com:node1d:node1d.protter.com:node2:node2.protter.com:node2d:node2d.protter.com:node3:node3.protter.com:node0d:node0d.protter.com:node3d:node3d.protter.com,access=dbciZP1c:dbciZP1c.protter.com:dbciZP1d:dbciZP1d.protter.com:node0:node0.protter.com:node1:node1.protter.com:node1d:node1d.protter.com:node2:node2.protter.com:node2d:node2d.protter.com:node3:node3.protter.com:node0d:node0d.protter.com:node3d:node3d.protter.com /export/sapmnt/ZP1″
package:dbciZP1|nfs/hanfs_export/FILE_LOCK_MIGRATION=0
package:dbciZP1|nfs/hanfs_export/MONITOR_INTERVAL=10
package:dbciZP1|nfs/hanfs_export/MONITOR_LOCKD_RETRY=4
package:dbciZP1|nfs/hanfs_export/MONITOR_DAEMONS_RETRY=4
package:dbciZP1|nfs/hanfs_export/PORTMAP_RETRY=4
package:dbciZP1|nfs/hanfs_flm/FLM_HOLDING_DIR=””
package:dbciZP1|nfs/hanfs_flm/NFSV4_FLM_HOLDING_DIR=””
package:dbciZP1|nfs/hanfs_flm/PROPAGATE_INTERVAL=5
package:dbciZP1|nfs/hanfs_flm/STATMON_WAITTIME=90
package:dbciXP1|name=dbciXP1
package:dbciXP1|style=modular
package:dbciXP1|type=failover
package:dbciXP1|status=up
package:dbciXP1|state=running
package:dbciXP1|highly_available=yes
package:dbciXP1|summary=ok
package:dbciXP1|autorun=enabled
package:dbciXP1|owner=node1
package:dbciXP1|id=91138
package:dbciXP1|initial_autorun=enabled
package:dbciXP1|failover_policy=configured_node
package:dbciXP1|failback_policy=manual
package:dbciXP1|local_lan_failover_allowed=enabled
package:dbciXP1|failfast=disabled
package:dbciXP1|run_script_timeout=no_timeout
package:dbciXP1|halt_script_timeout=no_timeout
package:dbciXP1|priority=no_priority
package:dbciXP1|successor_halt_timeout=no_timeout
package:dbciXP1|script_log_file=/var/adm/cmcluster/log/dbciXP1.log
package:dbciXP1|node:node1|name=node1
package:dbciXP1|node:node1|status=up
package:dbciXP1|node:node1|state=running
package:dbciXP1|node:node1|switching=enabled
package:dbciXP1|node:node1|last_run_time=1413125021
package:dbciXP1|node:node1|last_halt_time=0
package:dbciXP1|node:node1|available=yes
package:dbciXP1|node:node1|last_halt_failed=no
package:dbciXP1|node:node1|type=Primary
package:dbciXP1|node:node1|order=1
package:dbciXP1|node:node2|name=node2
package:dbciXP1|node:node2|status=down
package:dbciXP1|node:node2|state=halted
package:dbciXP1|node:node2|switching=enabled
package:dbciXP1|node:node2|last_run_time=1413102139
package:dbciXP1|node:node2|last_halt_time=1413124849
package:dbciXP1|node:node2|available=yes
package:dbciXP1|node:node2|last_halt_failed=no
package:dbciXP1|node:node2|type=Alternate
package:dbciXP1|node:node2|order=2
package:dbciXP1|service:nfs.monitor2|name=nfs.monitor2
package:dbciXP1|service:nfs.monitor2|id=1
package:dbciXP1|service:nfs.monitor2|failfast=disabled
package:dbciXP1|service:nfs.monitor2|halt_timeout=0
package:dbciXP1|service:nfs.monitor2|command=”$SGCONF/scripts/nfs/nfs_upcc.mon”
package:dbciXP1|service:nfs.monitor2|restart=none
package:dbciXP1|service:nfs.monitor2|node:node1|status=unknown
package:dbciXP1|service:nfs.monitor2|node:node1|restart_limit=unknown
package:dbciXP1|service:nfs.monitor2|node:node1|restart_count=0
package:dbciXP1|service:nfs.monitor2|node:node2|status=down
package:dbciXP1|service:nfs.monitor2|node:node2|restart_limit=unknown
package:dbciXP1|service:nfs.monitor2|node:node2|restart_count=0
package:dbciXP1|ip_address:145.109.44.126|name=145.109.44.126
package:dbciXP1|ip_address:11.9.0.97|name=11.9.0.97
package:dbciXP1|package_description=”XP1 Package”
package:dbciXP1|module_name:sg/basic|module_name=sg/basic
package:dbciXP1|module_name:sg/basic|module_version=1
package:dbciXP1|module_name:sg/all|module_name=sg/all
package:dbciXP1|module_name:sg/all|module_version=1
package:dbciXP1|module_name:sg/failover|module_name=sg/failover
package:dbciXP1|module_name:sg/failover|module_version=1
package:dbciXP1|module_name:sg/priority|module_name=sg/priority
package:dbciXP1|module_name:sg/priority|module_version=1
package:dbciXP1|module_name:sg/dependency|module_name=sg/dependency
package:dbciXP1|module_name:sg/dependency|module_version=1
package:dbciXP1|module_name:sg/weight|module_name=sg/weight
package:dbciXP1|module_name:sg/weight|module_version=1
package:dbciXP1|module_name:sg/monitor_subnet|module_name=sg/monitor_subnet
package:dbciXP1|module_name:sg/monitor_subnet|module_version=1
package:dbciXP1|module_name:sg/package_ip|module_name=sg/package_ip
package:dbciXP1|module_name:sg/package_ip|module_version=1
package:dbciXP1|module_name:sg/package_ip|module_scripts=$SGCONF/scripts/sg/package_ip.sh
package:dbciXP1|module_name:sg/service|module_name=sg/service
package:dbciXP1|module_name:sg/service|module_version=1
package:dbciXP1|module_name:sg/service|module_scripts=$SGCONF/scripts/sg/service.sh
package:dbciXP1|module_name:sg/resource|module_name=sg/resource
package:dbciXP1|module_name:sg/resource|module_version=1
package:dbciXP1|module_name:sg/resource|module_scripts=$SGCONF/scripts/sg/resource.sh
package:dbciXP1|module_name:sg/volume_group|module_name=sg/volume_group
package:dbciXP1|module_name:sg/volume_group|module_version=1
package:dbciXP1|module_name:sg/volume_group|module_scripts=$SGCONF/scripts/sg/volume_group.sh
package:dbciXP1|module_name:sg/filesystem|module_name=sg/filesystem
package:dbciXP1|module_name:sg/filesystem|module_version=1
package:dbciXP1|module_name:sg/filesystem|module_scripts=$SGCONF/scripts/sg/filesystem.sh
package:dbciXP1|module_name:sg/pev|module_name=sg/pev
package:dbciXP1|module_name:sg/pev|module_version=1
package:dbciXP1|module_name:sg/external_pre|module_name=sg/external_pre
package:dbciXP1|module_name:sg/external_pre|module_version=1
package:dbciXP1|module_name:sg/external_pre|module_scripts=$SGCONF/scripts/sg/external_pre.sh
package:dbciXP1|module_name:sg/external|module_name=sg/external
package:dbciXP1|module_name:sg/external|module_version=1
package:dbciXP1|module_name:sg/external|module_scripts=$SGCONF/scripts/sg/external.sh
package:dbciXP1|module_name:sg/acp|module_name=sg/acp
package:dbciXP1|module_name:sg/acp|module_version=1
package:dbciXP1|module_name:sgesap/all|module_name=sgesap/all
package:dbciXP1|module_name:sgesap/all|module_version=1
package:dbciXP1|module_name:sgesap/dbinstance|module_name=sgesap/dbinstance
package:dbciXP1|module_name:sgesap/dbinstance|module_version=1
package:dbciXP1|module_name:sgesap/dbinstance|module_scripts=$SGCONF/scripts/sgesap/dbinstance.sh
package:dbciXP1|module_name:sgesap/db_global|module_name=sgesap/db_global
package:dbciXP1|module_name:sgesap/db_global|module_version=1
package:dbciXP1|module_name:sgesap/oracledb_spec|module_name=sgesap/oracledb_spec
package:dbciXP1|module_name:sgesap/oracledb_spec|module_version=1
package:dbciXP1|module_name:sgesap/maxdb_spec|module_name=sgesap/maxdb_spec
package:dbciXP1|module_name:sgesap/maxdb_spec|module_version=1
package:dbciXP1|module_name:sgesap/sapinstance|module_name=sgesap/sapinstance
package:dbciXP1|module_name:sgesap/sapinstance|module_version=1
package:dbciXP1|module_name:sgesap/sap_global|module_name=sgesap/sap_global
package:dbciXP1|module_name:sgesap/sap_global|module_version=1
package:dbciXP1|module_name:sgesap/stack|module_name=sgesap/stack
package:dbciXP1|module_name:sgesap/stack|module_version=1
package:dbciXP1|module_name:sgesap/stack|module_scripts=$SGCONF/scripts/sgesap/sapinstance.sh
package:dbciXP1|module_name:sgesap/sapextinstance|module_name=sgesap/sapextinstance
package:dbciXP1|module_name:sgesap/sapextinstance|module_version=1
package:dbciXP1|module_name:sgesap/sapextinstance_pre|module_name=sgesap/sapextinstance_pre
package:dbciXP1|module_name:sgesap/sapextinstance_pre|module_version=1
package:dbciXP1|module_name:sgesap/sapextinstance_pre|module_scripts=$SGCONF/scripts/sgesap/sapextinstance_pre.sh
package:dbciXP1|module_name:sgesap/sapextinstance_post|module_name=sgesap/sapextinstance_post
package:dbciXP1|module_name:sgesap/sapextinstance_post|module_version=1
package:dbciXP1|module_name:sgesap/sapextinstance_post|module_scripts=$SGCONF/scripts/sgesap/sapextinstance_post.sh
package:dbciXP1|module_name:sgesap/livecache|module_name=sgesap/livecache
package:dbciXP1|module_name:sgesap/livecache|module_version=1
package:dbciXP1|module_name:sgesap/livecache|module_scripts=$SGCONF/scripts/sgesap/livecache.sh
package:dbciXP1|module_name:sgesap/sapinfra|module_name=sgesap/sapinfra
package:dbciXP1|module_name:sgesap/sapinfra|module_version=1
package:dbciXP1|module_name:sgesap/sapinfra_pre|module_name=sgesap/sapinfra_pre
package:dbciXP1|module_name:sgesap/sapinfra_pre|module_version=1
package:dbciXP1|module_name:sgesap/sapinfra_pre|module_scripts=$SGCONF/scripts/sgesap/infra_pre.sh
package:dbciXP1|module_name:sgesap/sapinfra_post|module_name=sgesap/sapinfra_post
package:dbciXP1|module_name:sgesap/sapinfra_post|module_version=1
package:dbciXP1|module_name:sgesap/sapinfra_post|module_scripts=$SGCONF/scripts/sgesap/infra_post.sh
package:dbciXP1|module_name:sgesap/mdm|module_name=sgesap/mdm
package:dbciXP1|module_name:sgesap/mdm|module_version=1
package:dbciXP1|module_name:sgesap/mdm|module_scripts=$SGCONF/scripts/sgesap/mdm.sh
package:dbciXP1|module_name:nfs/hanfs|module_name=nfs/hanfs
package:dbciXP1|module_name:nfs/hanfs|module_version=1
package:dbciXP1|module_name:nfs/hanfs_export|module_name=nfs/hanfs_export
package:dbciXP1|module_name:nfs/hanfs_export|module_version=1
package:dbciXP1|module_name:nfs/hanfs_export|module_scripts=$SGCONF/scripts/nfs/hanfs_export.sh
package:dbciXP1|module_name:nfs/hanfs_flm|module_name=nfs/hanfs_flm
package:dbciXP1|module_name:nfs/hanfs_flm|module_version=1
package:dbciXP1|module_name:nfs/hanfs_flm|module_scripts=$SGCONF/scripts/nfs/hanfs_flm.sh
package:dbciXP1|operation_sequence:$SGCONF/scripts/sg/external_pre.sh|operation_sequence=$SGCONF/scripts/sg/external_pre.sh
package:dbciXP1|operation_sequence:$SGCONF/scripts/sg/volume_group.sh|operation_sequence=$SGCONF/scripts/sg/volume_group.sh
package:dbciXP1|operation_sequence:$SGCONF/scripts/sg/filesystem.sh|operation_sequence=$SGCONF/scripts/sg/filesystem.sh
package:dbciXP1|operation_sequence:$SGCONF/scripts/nfs/hanfs_export.sh|operation_sequence=$SGCONF/scripts/nfs/hanfs_export.sh
package:dbciXP1|operation_sequence:$SGCONF/scripts/sg/package_ip.sh|operation_sequence=$SGCONF/scripts/sg/package_ip.sh
package:dbciXP1|operation_sequence:$SGCONF/scripts/nfs/hanfs_flm.sh|operation_sequence=$SGCONF/scripts/nfs/hanfs_flm.sh
package:dbciXP1|operation_sequence:$SGCONF/scripts/sgesap/livecache.sh|operation_sequence=$SGCONF/scripts/sgesap/livecache.sh
package:dbciXP1|ip_subnet:145.109.44.0|ip_subnet=145.109.44.0
package:dbciXP1|ip_subnet:145.109.44.0|ip_address=145.109.44.126
package:dbciXP1|ip_subnet:11.9.0.0|ip_subnet=11.9.0.0
package:dbciXP1|ip_subnet:11.9.0.0|ip_address=11.9.0.97
package:dbciXP1|concurrent_vgchange_operations=1
package:dbciXP1|enable_threaded_vgchange=0
package:dbciXP1|vgchange_cmd=”vgchange -a e”
package:dbciXP1|cvm_activation_cmd=”vxdg -g \${DiskGroup} set activation=exclusivewrite”
package:dbciXP1|vxvol_cmd=”vxvol -g \${DiskGroup} startall”
package:dbciXP1|vg:vgsapXP1|vg=vgsapXP1
package:dbciXP1|vxvm_dg_retry=no
package:dbciXP1|deactivation_retry_count=2
package:dbciXP1|kill_processes_accessing_raw_devices=yes
package:dbciXP1|concurrent_fsck_operations=1
package:dbciXP1|concurrent_mount_and_umount_operations=1
package:dbciXP1|fs_mount_retry_count=3
package:dbciXP1|fs_umount_retry_count=5
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_usr_sap_XP1|fs_name=/dev/vgsapXP1/lv_usr_sap_XP1
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_usr_sap_XP1|fs_directory=/usr/sap/XP1
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_usr_sap_XP1|fs_type=”vxfs”
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_usr_sap_XP1|fs_mount_opt=”-o rw,largefiles,delaylog,nodatainlog”
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_usr_sap_XP1|fs_umount_opt=””
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_usr_sap_XP1|fs_fsck_opt=””
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_XP1|fs_name=/dev/vgsapXP1/lv_sapdb_XP1
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_XP1|fs_directory=/sapdb/XP1
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_XP1|fs_type=”vxfs”
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_XP1|fs_mount_opt=”-o rw,largefiles,delaylog,nodatainlog”
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_XP1|fs_umount_opt=””
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_XP1|fs_fsck_opt=””
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_backup_logs|fs_name=/dev/vgsapXP1/lv_sapdb_backup_logs
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_backup_logs|fs_directory=/sapdb/backup_logs
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_backup_logs|fs_type=”vxfs”
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_backup_logs|fs_mount_opt=”-o rw,largefiles,delaylog,nodatainlog”
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_backup_logs|fs_umount_opt=””
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_backup_logs|fs_fsck_opt=””
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_backupa|fs_name=/dev/vgsapXP1/lv_sapdb_backupa
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_backupa|fs_directory=/sapdb/backupa
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_backupa|fs_type=”vxfs”
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_backupa|fs_mount_opt=”-o rw,largefiles,delaylog,nodatainlog”
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_backupa|fs_umount_opt=””
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_backupa|fs_fsck_opt=””
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_data_wrk_XP1|fs_name=/dev/vgsapXP1/lv_sapdb_data_wrk_XP1
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_data_wrk_XP1|fs_directory=/sapdb/data/wrk/XP1
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_data_wrk_XP1|fs_type=”vxfs”
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_data_wrk_XP1|fs_mount_opt=”-o rw,largefiles,convosync=direct,mincache=direct,delaylog,nodatainlog”
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_data_wrk_XP1|fs_umount_opt=””
package:dbciXP1|fs_name:/dev/vgsapXP1/lv_sapdb_data_wrk_XP1|fs_fsck_opt=””
package:dbciXP1|sgesap/db_global/db_vendor=maxdb
package:dbciXP1|sgesap/db_global/db_system=XP1
package:dbciXP1|sgesap/maxdb_spec/maxdb_userkey=DEFAULT
package:dbciXP1|sgesap/sap_global/sap_system=XP1
package:dbciXP1|sgesap/sap_global/rem_comm=ssh
package:dbciXP1|sgesap/sap_global/cleanup_policy=normal
package:dbciXP1|sgesap/sap_global/retry_count=5
package:dbciXP1|sgesap/livecache/lc_system:XP1|sgesap/livecache/lc_system=XP1
package:dbciXP1|sgesap/livecache/lc_system:XP1|sgesap/livecache/lc_virtual_hostname=dbciXP1d
package:dbciXP1|sgesap/livecache/lc_system:XP1|sgesap/livecache/lc_startmode=online
package:dbciXP1|sgesap/livecache/lc_system:XP1|sgesap/livecache/lc_userkey=DEFAULT
package:dbciXP1|sgesap/sapinfra/sap_infra_sw_type:saposcol|sgesap/sapinfra/sap_infra_sw_type=saposcol
package:dbciXP1|sgesap/sapinfra/sap_infra_sw_type:saposcol|sgesap/sapinfra/sap_infra_sw_treat=startnstop
package:dbciXP1|nfs/hanfs_export/FILE_LOCK_MIGRATION=0
package:dbciXP1|nfs/hanfs_export/MONITOR_INTERVAL=10
package:dbciXP1|nfs/hanfs_export/MONITOR_LOCKD_RETRY=4
package:dbciXP1|nfs/hanfs_export/MONITOR_DAEMONS_RETRY=4
package:dbciXP1|nfs/hanfs_export/PORTMAP_RETRY=4
package:dbciXP1|nfs/hanfs_flm/FLM_HOLDING_DIR=””
package:dbciXP1|nfs/hanfs_flm/NFSV4_FLM_HOLDING_DIR=””
package:dbciXP1|nfs/hanfs_flm/PROPAGATE_INTERVAL=5
package:dbciXP1|nfs/hanfs_flm/STATMON_WAITTIME=90
quorum_server:qserver|name=qserver
quorum_server:qserver|polling_interval=300000000
quorum_server:qserver|node:node0|status=up
quorum_server:qserver|node:node0|state=running
quorum_server:qserver|node:node3|status=up
quorum_server:qserver|node:node3|state=running
quorum_server:qserver|node:node1|status=up
quorum_server:qserver|node:node1|state=running
quorum_server:qserver|node:node2|status=up
quorum_server:qserver|node:node2|state=running
quorum_server:qserver|ip_address:145.109.30.178|name=145.109.30.178
quorum_server:qserver|ip_address:145.109.30.178|node:node0|name=node0
quorum_server:qserver|ip_address:145.109.30.178|node:node0|status=up
quorum_server:qserver|ip_address:145.109.30.178|node:node0|state=running
quorum_server:qserver|ip_address:145.109.30.178|node:node3|name=node3
quorum_server:qserver|ip_address:145.109.30.178|node:node3|status=up
quorum_server:qserver|ip_address:145.109.30.178|node:node3|state=running
quorum_server:qserver|ip_address:145.109.30.178|node:node1|name=node1
quorum_server:qserver|ip_address:145.109.30.178|node:node1|status=up
quorum_server:qserver|ip_address:145.109.30.178|node:node1|state=running
quorum_server:qserver|ip_address:145.109.30.178|node:node2|name=node2
quorum_server:qserver|ip_address:145.109.30.178|node:node2|status=up
quorum_server:qserver|ip_address:145.109.30.178|node:node2|state=running
authorized_host:node0|name=node0
authorized_host:node0|user:orazp1|name=orazp1
authorized_host:node0|user:orazp1|role=monitor
authorized_host:node1|name=node1
authorized_host:node1|user:orazp1|name=orazp1
authorized_host:node1|user:orazp1|role=monitor
authorized_host:node2|name=node2
authorized_host:node2|user:orazp1|name=orazp1
authorized_host:node2|user:orazp1|role=monitor
authorized_host:node3|name=node3
authorized_host:node3|user:orazp1|name=orazp1
authorized_host:node3|user:orazp1|role=monitor

Tags: , , , ,

06 Mar 14 Serviceguard complete cluster standup (Long article)

Serviceguard stand up Notes:

Important parts of the .ascii file.

CLUSTER_NAME prod_sgcluster

HOSTNAME_ADDRESS_FAMILY IPV4

FIRST_CLUSTER_LOCK_VG /dev/vgsgpackagename

## Is it safer to maybe use a dedicated SG Lock disk.

NODE_NAME sgclusternode01

NETWORK_INTERFACE lan900

HEARTBEAT_IP 192.168.208.209

NETWORK_INTERFACE lan901

HEARTBEAT_IP 10.43.128.209

# CLUSTER_LOCK_LUN

FIRST_CLUSTER_LOCK_PV /dev/disk/disk20

# Link Aggregate lan900 contains the following port(s): lan0,lan4

# Warning: There are no standby network interfaces for lan900.

# Link Aggregate lan901 contains the following port(s): lan8,lan12

# Warning: There are no standby network interfaces for lan901.

NODE_NAME sgclusternode02

NETWORK_INTERFACE lan900

HEARTBEAT_IP 192.168.209.98

NETWORK_INTERFACE lan901

HEARTBEAT_IP 10.43.128.210

# CLUSTER_LOCK_LUN

FIRST_CLUSTER_LOCK_PV /dev/disk/disk59

MEMBER_TIMEOUT 14000000

# Configuration/Reconfiguration Timing Parameters (microseconds).

AUTO_START_TIMEOUT 600000000

NETWORK_POLLING_INTERVAL 2000000

NETWORK_FAILURE_DETECTION INOUT

# NETWORK_AUTO_FAILBACK

# When set to YES a recovery of the primary LAN interface will cause failback

# from the standby LAN interface to the primary.

# When set to NO a recovery of the primary LAN interface will do nothing and

# the standby LAN interface will continue to be used until cmmodnet -e lanX

# is issued for the primary LAN interface.

NETWORK_AUTO_FAILBACK YES

SUBNET 192.168.208.0

IP_MONITOR ON

POLLING_TARGET 192.168.208.1

SUBNET 192.168.0.0

IP_MONITOR OFF

# Package Configuration Parameters.

# Enter the maximum number of packages which will be configured in the cluster.

# You can not add packages beyond this limit.

# This parameter is required.

MAX_CONFIGURED_PACKAGES 300

You will want to make sure both nodes of the cluster are running and the volume group that the lock disks belongs to is cluster aware.

NOTE: When standing up a one node cluster cmquerycl will remove lock disk configuration and a lock disk is not needed for such a configuration.

cmrunnode #on each node

vgchange –a n vgsgpackagename

vgchange –c y vgsgpackagename

cmquerycl -v -C prod_sgcluster.ascii -n sgclusternode01 -n sgclusternode02

cmcheckconf -v -C prod_sgcluster.ascii

cmapplyconf -v -C prod_sgcluster.ascii

Cluster should look roughly like this:

root@sgclusternode02:/root> cmviewcl

CLUSTER STATUS

prod_sgcluster up

NODE STATUS STATE

sgclusternode01 up running

sgclusternode02 up running

PACKAGE STATUS STATE AUTO_RUN NODE

root@sgclusternode02:/root>

Standing up your first package.

Scenario assumes you are standing up a package named sgpackagename.

mkdir –p /etc/cmcluster/packages/sgpackagename

cd /etc/cmcluster/packages/sgpackagename

Using your method of choice, copy in a package conference file and a task0 (external script to start Oracle. Choose your clone source carefully. Make sure you choose a working package to template. If you are standing up an SAP instance choose an SAP package to clone, sgpackagename is a standard database package and a better template candidate.

Permissions may matter:

oot@sgclusternode02:/etc/cmcluster/packages/sgpackagename> ll

total 176

-rw——- 1 root sys 71668 Dec 3 16:12 sgpackagename.conf

-r-x—— 1 root sys 11005 Dec 9 11:35 task0

root@sgclusternode02:/etc/cmcluster/packages/sgpackagename>

Use the method of choice to modify your configuration files:

Here is what needs to be changed ( In bold ):

package_name sgpackagename

package_description “sgpackagename Instance”

package_type failover

node_name sgclusternode01

node_name sgclusternode02

ip_subnet 192.168.208.0

ip_address 192.168.209.48

Change the bold values below for each file system.

fs_name /dev/vgsgpackagename/oraarch

fs_server “”

fs_directory /data/oracle/sgpackagename/arch

fs_type “vxfs”

fs_mount_opt “-o ioerror=mwdisable,largefiles,delaylog,cio”

fs_umount_opt “”

fs_fsck_opt “”

The actual data may vary. The fs_mount_opt are important and may change. The parameter cio is necessary for Oracle to have asynchronous I/O.

external_script /etc/cmcluster/packages/sgpackagename/task0

Create the mount points and change permission to oracle:dba. Again there are many ways to do this, your mileage may vary. You can check return codes if you are particularly precise, echo $?

awk ‘/^fs_dir/{print $NF}’ sgpackagename.conf | while read –r mp

do

mkdir –p $mp

ll –d $mp

chown oracle:dba $mp

ll –d $mp

done

Your final output from the ll –d command should look this

drwxr-xr-x 3 oracle dba 96 Dec 9 11:04 /data/oracle/sgpackagename/arch

drwxr-xr-x 4 oracle dba 96 Dec 10 11:40 /data/oracle/sgpackagename/export

drwxr-xr-x 3 oracle dba 96 Dec 9 11:04 /data/oracle/sgpackagename/undo1

drwxr-xr-x 3 oracle dba 96 Dec 9 11:04 /data/oracle/sgpackagename/redo1

drwxr-xr-x 3 oracle dba 96 Dec 9 11:04 /data/oracle/sgpackagename/redo2

drwxr-xr-x 3 oracle dba 96 Dec 9 11:04 /data/oracle/sgpackagename/ctrl1

drwxr-xr-x 3 oracle dba 96 Dec 9 11:04 /data/oracle/sgpackagename/ctrl2

drwxr-xr-x 3 oracle dba 96 Dec 9 11:04 /data/oracle/sgpackagename/data1

drwxr-xr-x 3 oracle dba 96 Dec 9 11:04 /data/oracle/sgpackagename/index1

drwxr-xr-x 4 oracle dba 96 Dec 10 13:59 /apps/oracle/sgpackagename

drwxr-xr-x 3 oracle dba 96 Dec 9 11:04 /data/oracle/sgpackagename/system

drwxr-xr-x 3 oracle dba 96 Dec 9 11:04 /data/oracle/sgpackagename/temp1

drwxr-xr-x 3 oracle dba 96 Dec 9 11:04 /data/oracle/sgpackagename/users

drwxr-xr-x 3 oracle dba 96 Dec 9 11:04 /data/oracle/sgpackagename/tools

drwxr-xr-x 3 oracle dba 96 Dec 9 11:04 /data/oracle/sgpackagename/fra

drwxr-xr-x 3 oracle dba 96 Dec 9 11:04 /data/oracle/sgpackagename/diag

drwxr-xr-x 3 oracle dba 96 Dec 9 11:04 /data/oracle/sgpackagename/admin

edit the task0 file

function start_commmand

su oracle -c “/apps/oracle/general/sh/change_backup_mode.ksh sgpackagename cold end”

Note this section is different for SAP. Change the instance name.

function stop_command

#### Database startup script, normally created by dba#####

su oracle -c “/apps/oracle/general/sh/change_backup_mode.ksh sgpackagename cold begin”

Comment out (in bold) the start/stop code so first package run only stands up the filesystems:

case ${1} in

start)

# start_command $*

# exit_val=$?

;;

stop)

# stop_command $*

# exit_val=$?

;;

Detect your storage from storage system.

ioscan –fnNC disk

# detects the storage

For this example we detected the following agile devices:

disk59

disk60

disk61

disk62

disk63

disk64

disk65

disk66

get the EMC serial number of each of the disks and match it against the serial number list given to you by storage in the dashboard request.

This is a bit tedious so I created a simple script for the job:

dislev.ksh

#!/usr/bin/ksh

args=$#

if [ $args -ne 1 ];then echo “1 argument last part of disk ex disk60”;exit 1;fi

dv=$1

diskinfo /dev/rdisk/${dv}

ldev=$(/usr/bin/inq -nodots -sym_wwn | grep “$dv ” | grep -v rdsk |awk ‘{print $3}’ |awk ‘{print substr($0,length($0) – 3,length($0))}’);

echo “LDEV is: ${ldev}”

root@sgclusternode02:/root/shuffle> ./disldev.ksh disk59

SCSI describe of /dev/rdisk/disk59:

vendor: EMC

product id: SYMMETRIX

type: direct access

size: 154176000 Kbytes

bytes per sector: 512

LDEV is: 4F2F

The size is a reality check. You can also use inq utility to get the size. By using a second utility (diskinfo) this creates a natural double check. There are probably a dozen different right ways to complete this task.

My disk list is kept for verification purposes in a text file root@sgclusternode02:/root/shuffle> cat request.610.dlist.txt

610 is the request from the stand up rquest.

awk ‘{print $NF}’ request.610.dlist.txt | while read –r dvn

do

pvcreate $dvn

rc=$?

echo “RC from pvcreate is ${rc}”

done

Create the volume group using LVM 2.2

vgcreate –V <version number> -s <pe size> -S <Max size in TB> <volume group name> <disk list>

vgcreate -V 2.2 -s 32 -S 2t vgsgpackagename /dev/disk/disk59 …. /dev/disk/disk66

The next step is best scripted:

<command> -n name –L <size in MB> <volume group name>

lvcreate -n oraadmin -L 10000 vgsgpackagename

echo $?

newfs -F vxfs -o largefiles /dev/sgpackagename/roraadmin

echo $?

.. repeat for every file system defined in the storage dashboard request .. I have scripted this entire process based on dashboard input and will provide the script as an appendix.

Volume group must be exported in preview mode:

vgexport -v -s -p -m vgsgpackagename.map vgsgpackagename

Use scp to copy the map file to the failover node

On failover node:

vgimport -v -s -N -m vgsgpackagename.map vgsgpackagename

vgchange –a y vgsgpackagename

vgdisplay –v vgsgpackagename (Look for logical volumes disks being correct)

vgchange –a n vgsgpackagename

vgchange –c y vgsgpackagename (Must be successful check return code $? )

vgchange –c n vgsgpackagename

On primary node (either will work but being consistent is helpful).

vgchange –c y vgsgpackagename

cd /etc/cmcluster/packages/sgpackagename

cmcheckconf –P sgpackagename.conf

(When all cmcheckconf issues are resolved)

cmapplyconf –P sgpackagename.conf

cmrunpckg –v –n <node_hostname> sgpackagename

cmmodpkg –e sgpackagename

cmviewcl (Look for your package to be running)

Error logs live: /var/adm/cmcluster/log/<packagename>.log

Setting up asynchronous I/O

root@sat1hcmdb090:/root> getprivgrp

global privileges: CHOWN

dba: MLOCK

getprivgroup is a display command use command:

setprivgrp dba MLOCK

Standing up your first package:

Make sure you are in the directory: /etc/cmcluster/packages/sgpackagename

root@sgclusternode02:/etc/cmcluster/packages/sgpackagename> cmcheckconf -P sgpackagename.conf

cmcheckconf: Verification completed. No errors found.

Use the cmapplyconf command to apply the configuration.

root@sgclusternode02:/etc/cmcluster/packages/sgpackagename> cmapplyconf -P sgpackagename.conf

One or more of the specified packages are running. Any error in the

proposed configuration change could cause these packages to fail.

Ensure configuration changes have been tested before applying them.

Modify the package configuration ([y]/n)? y

Completed the cluster update

root@sgclusternode02:/etc/cmcluster/packages/sgpackagename> cmmodpkg -e sgpackagename

cmmodpkg: Completed successfully on all packages specified

root@sgclusternode02:/etc/cmcluster/packages/sgpackagename> cmviewcl -v

CLUSTER STATUS

prod_sgcluster up

NODE STATUS STATE

sgclusternode01 up running

Cluster_Lock_LVM:

VOLUME_GROUP PHYSICAL_VOLUME STATUS

/dev/vgsgpackagename /dev/disk/disk20 up

Network_Parameters:

INTERFACE STATUS PATH NAME

PRIMARY up LinkAgg0 lan900

PRIMARY up LinkAgg1 lan901

NODE STATUS STATE

sgclusternode02 up running

Cluster_Lock_LVM:

VOLUME_GROUP PHYSICAL_VOLUME STATUS

/dev/vgsgpackagename /dev/disk/disk59 up

Network_Parameters:

INTERFACE STATUS PATH NAME

PRIMARY up LinkAgg0 lan900

PRIMARY up LinkAgg1 lan901

PACKAGE STATUS STATE AUTO_RUN NODE

sgpackagename up running enabled sgclusternode02

Policy_Parameters:

POLICY_NAME CONFIGURED_VALUE

Failover configured_node

Failback manual

Node_Switching_Parameters:

NODE_TYPE STATUS SWITCHING NAME

Primary up enabled sgclusternode01

Alternate up enabled sgclusternode02 (current)

Other_Attributes:

ATTRIBUTE_NAME ATTRIBUTE_VALUE

Style modular

Priority no_priority

Check that your file systems are mounted (About a dozen different ways to do this):

root@sgclusternode02:/etc/cmcluster/packages/sgpackagename> bdf | grep sgpackagename

102400000 91742 95913999 0% /data/oracle/sgpackagename/arch

102400000 13178819 83644864 14% /data/oracle/sgpackagename/export

102400000 91742 95913999 0% /data/oracle/sgpackagename/undo1

10256384 20006 9596612 0% /data/oracle/sgpackagename/redo1

10256384 20006 9596612 0% /data/oracle/sgpackagename/redo2

10256384 20006 9596612 0% /data/oracle/sgpackagename/ctrl1

10256384 20006 9596612 0% /data/oracle/sgpackagename/ctrl2

307200000 141939 287866940 0% /data/oracle/sgpackagename/data1

204800000 116841 191890469 0% /data/oracle/sgpackagename/index1

20480000 3972498 15475861 20% /apps/oracle/sgpackagename

10256384 20006 9596612 0% /data/oracle/sgpackagename/system

102400000 91742 95913999 0% /data/oracle/sgpackagename/temp1

10256384 20006 9596612 0% /data/oracle/sgpackagename/users

10256384 20006 9596612 0% /data/oracle/sgpackagename/tools

102400000 91742 95913999 0% /data/oracle/sgpackagename/fra

10256384 20006 9596612 0% /data/oracle/sgpackagename/diag

10256384 20006 9596612 0% /data/oracle/sgpackagename/admin

root@sgclusternode02:/etc/cmcluster/packages/sgpackagename> mount | grep sgpackagename

/data/oracle/sgpackagename/arch on /dev/vgsgpackagename/oraarch ioerror=mwdisable,largefiles,delaylog,cio,dev=80000002 on Mon Dec 9 11:41:17 2013

/data/oracle/sgpackagename/export on /dev/vgsgpackagename/oraexport ioerror=mwdisable,largefiles,delaylog,cio,dev=80000009 on Mon Dec 9 11:41:17 2013

/data/oracle/sgpackagename/undo1 on /dev/vgsgpackagename/oraundo1 ioerror=mwdisable,largefiles,delaylog,cio,dev=8000000c on Mon Dec 9 11:41:17 2013

/data/oracle/sgpackagename/redo1 on /dev/vgsgpackagename/oraredo1 ioerror=mwdisable,largefiles,delaylog,cio,dev=80000005 on Mon Dec 9 11:41:17 2013

/data/oracle/sgpackagename/redo2 on /dev/vgsgpackagename/oraredo2 ioerror=mwdisable,largefiles,delaylog,cio,dev=80000004 on Mon Dec 9 11:41:17 2013

/data/oracle/sgpackagename/ctrl1 on /dev/vgsgpackagename/oractrl1 ioerror=mwdisable,largefiles,delaylog,cio,dev=80000006 on Mon Dec 9 11:41:18 2013

/data/oracle/sgpackagename/ctrl2 on /dev/vgsgpackagename/oractrl2 ioerror=mwdisable,largefiles,delaylog,cio,dev=80000007 on Mon Dec 9 11:41:18 2013

/data/oracle/sgpackagename/data1 on /dev/vgsgpackagename/oradata1 ioerror=mwdisable,largefiles,delaylog,cio,dev=80000003 on Mon Dec 9 11:41:18 2013

/data/oracle/sgpackagename/index1 on /dev/vgsgpackagename/oraindex1 ioerror=mwdisable,largefiles,delaylog,cio,dev=80000008 on Mon Dec 9 11:41:18 2013

/apps/oracle/sgpackagename on /dev/vgsgpackagename/orabin ioerror=mwdisable,largefiles,delaylog,nodatainlog,dev=80000001 on Mon Dec 9 11:41:18 2013

/data/oracle/sgpackagename/system on /dev/vgsgpackagename/orasystem ioerror=mwdisable,largefiles,delaylog,cio,dev=8000000a on Mon Dec 9 11:41:18 2013

/data/oracle/sgpackagename/temp1 on /dev/vgsgpackagename/oratemp1 ioerror=mwdisable,largefiles,delaylog,cio,dev=8000000b on Mon Dec 9 11:41:18 2013

/data/oracle/sgpackagename/users on /dev/vgsgpackagename/orausers ioerror=mwdisable,largefiles,delaylog,cio,dev=8000000d on Mon Dec 9 11:41:18 2013

/data/oracle/sgpackagename/tools on /dev/vgsgpackagename/oratools ioerror=mwdisable,largefiles,delaylog,cio,dev=8000000e on Mon Dec 9 11:41:19 2013

/data/oracle/sgpackagename/fra on /dev/vgsgpackagename/orafra ioerror=mwdisable,largefiles,delaylog,cio,dev=8000000f on Mon Dec 9 11:41:19 2013

/data/oracle/sgpackagename/diag on /dev/vgsgpackagename/oradiag ioerror=mwdisable,largefiles,delaylog,cio,dev=80000010 on Mon Dec 9 11:41:19 2013

/data/oracle/sgpackagename/admin on /dev/vgsgpackagename/oraadmin ioerror=mwdisable,largefiles,delaylog,cio,dev=80000011 on Mon Dec 9 11:41:19 2013

Conduct failover test (Pre-installation)

root@sgclusternode02:/etc/cmcluster/packages/sgpackagename> cmhaltpkg -v sgpackagename

Disabling automatic failover for failover packages to be halted.

Halting package sgpackagename

Successfully halted package sgpackagename

One or more packages or package instances have been halted.

The failover packages have AUTO_RUN disabled and no new instance can start automatically. To allow automatic start, enable AUTO_RUN via cmmodpkg -e <package_name>

cmhaltpkg: Completed successfully on all packages specified

root@sgclusternode02:/etc/cmcluster/packages/sgpackagename> cmviewcl

CLUSTER STATUS

prod_sgcluster up

NODE STATUS STATE

sgclusternode01 up running

sgclusternode02 up running

UNOWNED_PACKAGES

PACKAGE STATUS STATE AUTO_RUN NODE

sgpackagename down halted disabled unowned

root@sgclusternode02:/etc/cmcluster/packages/sgpackagename> cmrunpkg -v -n sgclusternode01 sgpackagename

Running package sgpackagename on node sgclusternode01

Successfully started package sgpackagename on node sgclusternode01

cmrunpkg: All specified packages are running

root@sgclusternode02:/etc/cmcluster/packages/sgpackagename> cmviewcl

CLUSTER STATUS

prod_sgcluster up

NODE STATUS STATE

sgclusternode01 up running

PACKAGE STATUS STATE AUTO_RUN NODE

sgpackagename up running disabled sgclusternode01

NODE STATUS STATE

sgclusternode02 up running

Re run your mount test on the node the package is now running on (see above).

You may wish to leave package failover set to disabled to avoid surprises.

Email your DBA give them the file system(s) to do installation. Flip the database dashboard request to “Application installation & configuration”

Notify your IA/PM via email.

Be prepared to run root.sh when your DBA needs it run.

Steps after DBA completion

Modify task 0 uncomment the 4 lines of code you commented.

case ${1} in

start)

start_command $*

exit_val=$?

;;

stop)

stop_command $*

exit_val=$?

Check your package changes:

cmcheckconf –P sgpackagename.conf

cmapplyconf –P sgpackagename.conf

Make sure backups are configured before the next step. Also have storage test DR backup of LUNS if applicable (Model and dev usually do not have DR).

Re-run the failover tests. Check log files:

/var/adm/cmcluster/log/sgpackagename.log

Check database run status.

ps –ef | grep sgpackagename

Lessons learned:

· DBA’s do not necessarily understand clustering. If they say the start/stop script works but you are getting errors in Serviceguard testing, ask them to check the return code (echo $?). Explain t the DBA that Serviceguard will not function correctly if it receives non-zero return codes.

· Try not to modify task0 to default to zero return codes. This defeats the purpose of Serviceguard checking return codes.

· Never run pvcreate –f (If you feel the need, deconstruct your volume group and use pvremve)

· Never run cmdisklock -f reset <disk device>, this destroys all data on the lock disk and generally there is data on the lock disk. Note: Maybe a better design would be a dedicated lock disk.

Appendix 1 Additional automation.

This is optional, but making processes repeatable is important so you might like this.

While validating the request on the storage dashboard, I noted (and slightly massaged) the data to make it machine (awk) readable. Scripts are local, I use them in /root/shuffle.

root@sgclusternode02:/root/shuffle> cat request.610.data.txt

sgclusternode01|NEW|/apps/oracle/sgpackagename | 20 GB

sgclusternode01|NEW|/data/oracle/sgpackagename/arch | 100 GB

sgclusternode01|NEW|/data/oracle/sgpackagename/data1 | 300 GB

sgclusternode01|NEW|/data/oracle/sgpackagename/redo2 | 10 GB

sgclusternode01|NEW|/data/oracle/sgpackagename/redo1 | 10 GB

sgclusternode01|NEW|/data/oracle/sgpackagename/ctrl1 | 10 GB

sgclusternode01|NEW|/data/oracle/sgpackagename/ctrl2 | 10 GB

sgclusternode01|NEW|/data/oracle/sgpackagename/index1 | 200 GB

sgclusternode01|NEW|/data/oracle/sgpackagename/export | 100 GB

sgclusternode01|NEW|/data/oracle/sgpackagename/SYSTEM | 10 GB

sgclusternode01|NEW|/data/oracle/sgpackagename/temp1 | 100 GB

sgclusternode01|NEW|/data/oracle/sgpackagename/undo1 | 100 GB

sgclusternode01|NEW|/data/oracle/sgpackagename/users | 10 GB

sgclusternode01|NEW|/data/oracle/sgpackagename/tools | 10 GB

sgclusternode01|NEW|/data/oracle/sgpackagename/fra | 100 GB

sgclusternode01|NEW|/data/oracle/sgpackagename/diag | 10 GB

sgclusternode01|NEW|/data/oracle/sgpackagename/admin | 10 GB

The following script reads the earlier request.{request number}.dlist.txt file to get its device list, reads the data.txt file and completely automates the VG build including the map export.

Script requires the instance name (not the vg name, it does that itself) and the request number from the dashboard. Use it or not, the choice is yours.

#!/usr/bin/ksh

args=$#

if [ $args -ne 2 ];then echo “2 arguments instance name and request ### required”;exit 1;fi

inn=$1

vgn=”vg${inn}”

req=$2

disklist=”request.${req}.dlist.txt”

actonreturn()

{

rcc=$1

if [ $rcc -ne 0 ];then echo “FAIL FAIL $0 FAILED”; exit 1;fi

}

devl=””

# pvcreate

awk ‘{ print $1 }’ ${disklist} | while read -r dv

do

devr=”/dev/rdisk/${dv}”

echo “pvcreate ${devr}”

pvcreate ${devr}

rc=$?

echo “pvcreate rc:${rc}”

actonreturn ${rc}

devl=”$devl /dev/disk/${dv}”

done

#vgcreate -V 2.2 -s 32 -S 1t <vg name> disks in /dev/disk/disk### format

echo “vgcreate -V 2.2 -s 32 -S 1t ${vgn} ${devl}”

vgcreate -V 2.2 -s 32 -S 2t ${vgn} ${devl}

rc=$?

echo “vgcreate rc:${rc}”

actonreturn ${rc}

infile=”request.${req}.data.txt”

if [ -f ${infile} ]

then

echo “- pass – file ${infile} found”

else

echo “- FAIL – file ${infile} MIA”

exit 1

fi

fstabstub=fstab.${vgn}

echo “##### New Oracle Instance vg ${vgn} ####” > ${fstabstub}

innu=$(echo ${inn} | awk ‘{print toupper($0)}’);

echo “Instance Name: ${inn} ${innu}”

awk ‘{print}’ ${infile} | while read -r DL

do

# echo “Data Line ${DL}”

mp=$(echo ${DL} | awk -F\| ‘{ print $3}’);

# echo “mount point is ${mp}”

mpszg=$(echo ${DL} | awk ‘{ print $3}’);

mpszm=”${mpszg}000″

# echo “mount point size in GB ${mpszg} in fake MB ${mpszm}”

mpname=$(echo ${mp} | awk -F\/ ‘{print $NF}’);

if [ “${mpname}” = “${innu}” ]

then

mpname=”orabin”

else

mpname=$(echo ${mpname} | awk ‘{print tolower($0)}’);

mpname=”ora${mpname}”

fi

mkdir -p ${mp}

chown oracle:dba ${mp}

# echo “mount point name is ${mpname}”

echo “lvcreate command is : lvcreate -n ${mpname} -L ${mpszm} ${vgn}”

#### uncomment for realrun ###

lvcreate -n ${mpname} -L ${mpszm} ${vgn}

rc=$?

actonreturn ${rc}

echo “newfs command is : newfs -F vxfs -o largefiles /dev/${vgn}/r${mpname}”

newfs -F vxfs -o largefiles /dev/${vgn}/r${mpname}

rc=$?

actonreturn ${rc}

done

vgexport -v -s -p -m ${vgn}.map ${vgn}

1.

WhatsApp chat