8 Nodes Cluster Upgrade from 12.1.0.2 to 12.2.0.1

Here there,
This a from scratch first test case I am trying to upgrade my 12.1.0.2 cluster lab to 12.2.0.1 just downloaded!
Here are some specification:
Main Host is Red Hat Enterprise Linux Server release 6.6 (Santiago)

  • VMWare Workstation 10
    • 8 nodes cluster under Oracle Red Hat Enterprise Linux Server release 6.5 (Santiago)

Cluster inventory
Local Resources
[code language=”sql”]
————————————————
ora.ASMNET1LSNR_ASM.lsnr
ONLINE ONLINE node1 STABLE
ONLINE ONLINE node2 STABLE
ONLINE ONLINE node3 STABLE
ONLINE ONLINE node4 STABLE
ONLINE ONLINE node5 STABLE
ONLINE ONLINE node6 STABLE
ONLINE ONLINE node7 STABLE
ONLINE ONLINE node8 STABLE
ora.DATA.dg
OFFLINE OFFLINE node1 STABLE
ONLINE ONLINE node2 STABLE
ONLINE OFFLINE node3 STABLE
ONLINE ONLINE node4 STABLE
ONLINE ONLINE node5 STABLE
ONLINE OFFLINE node6 STABLE
ONLINE OFFLINE node7 STABLE
ONLINE OFFLINE node8 STABLE
ora.GRID.dg
OFFLINE OFFLINE node1 STABLE
ONLINE ONLINE node2 STABLE
OFFLINE OFFLINE node3 STABLE
ONLINE ONLINE node4 STABLE
ONLINE ONLINE node5 STABLE
OFFLINE OFFLINE node6 STABLE
OFFLINE OFFLINE node7 STABLE
OFFLINE OFFLINE node8 STABLE
ora.LISTENER.lsnr
ONLINE ONLINE node1 STABLE
ONLINE ONLINE node2 STABLE
ONLINE ONLINE node3 STABLE
ONLINE ONLINE node4 STABLE
ONLINE ONLINE node5 STABLE
ONLINE ONLINE node6 STABLE
ONLINE ONLINE node7 STABLE
ONLINE ONLINE node8 STABLE
ora.net1.network
ONLINE ONLINE node1 STABLE
ONLINE ONLINE node2 STABLE
ONLINE ONLINE node3 STABLE
ONLINE ONLINE node4 STABLE
ONLINE ONLINE node5 STABLE
ONLINE ONLINE node6 STABLE
ONLINE ONLINE node7 STABLE
ONLINE ONLINE node8 STABLE
ora.ons
ONLINE ONLINE node1 STABLE
ONLINE ONLINE node2 STABLE
ONLINE ONLINE node3 STABLE
ONLINE ONLINE node4 STABLE
ONLINE ONLINE node5 STABLE
ONLINE ONLINE node6 STABLE
ONLINE ONLINE node7 STABLE
ONLINE ONLINE node8 STABLE
———————————————–
[/code]
Cluster resources
[code language=”sql”]
Cluster Resources
——————————————————
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE node2 STABLE
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE node3 STABLE
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE node4 STABLE
ora.MGMTLSNR
1 ONLINE ONLINE node6 169.254.91.188 192.168.2.106,STABLE
ora.asm
1 ONLINE ONLINE node4 Started,STABLE
4 ONLINE ONLINE node5 Started,STABLE
5 ONLINE ONLINE node2 Started,STABLE
ora.bi.db
1 ONLINE ONLINE node4 Open,STABLE
2 ONLINE ONLINE node6 Open,STABLE
ora.crm.db
1 ONLINE ONLINE node5 Open,STABLE
2 ONLINE ONLINE node3 Open,STABLE
ora.cvu
1 ONLINE ONLINE node8 STABLE
ora.ecom.db
1 ONLINE ONLINE node2 Open,STABLE
2 ONLINE ONLINE node7 Open,STABLE
ora.hr.db
1 ONLINE ONLINE node1 Open,STABLE
2 ONLINE ONLINE node8 Open,STABLE
ora.mgmtdb
1 ONLINE ONLINE node6 Open,STABLE
ora.node1.vip
1 ONLINE ONLINE node1 STABLE
ora.node2.vip
1 ONLINE ONLINE node2 STABLE
ora.node3.vip
1 ONLINE ONLINE node3 STABLE
ora.node4.vip
1 ONLINE ONLINE node4 STABLE
ora.node5.vip
1 ONLINE ONLINE node5 STABLE
ora.node6.vip
1 ONLINE ONLINE node6 STABLE
ora.node7.vip
1 ONLINE ONLINE node7 STABLE
ora.node8.vip
1 ONLINE ONLINE node8 STABLE
ora.oc4j
1 ONLINE ONLINE node8 STABLE
ora.sales.db
1 ONLINE ONLINE node7 Open,STABLE
2 ONLINE ONLINE node2 Open,STABLE
ora.scan1.vip
1 ONLINE ONLINE node2 STABLE
ora.scan2.vip
1 ONLINE ONLINE node3 STABLE
ora.scan3.vip
1 ONLINE ONLINE node4 STABLE
———————————————–
[/code]
Server pools
[code language=”sql”]
Server pool name: Free
Importance: 0, Min: 0, Max: -1
Category:
Candidate server names:
Server pool name: Generic
Importance: 0, Min: 0, Max: -1
Category:
Candidate server names:
Server pool name: Pool_BI
Importance: 2, Min: 2, Max: 2
Category: hub
Candidate server names:
Server pool name: Pool_CRM
Importance: 2, Min: 2, Max: 2
Category: hub
Candidate server names:
Server pool name: Pool_ECOM
Importance: 3, Min: 2, Max: 2
Category: hub
Candidate server names:
Server pool name: Pool_HR
Importance: 1, Min: 2, Max: 2
Category: hub
Candidate server names:
[/code]
Databases
[code language=”sql”]
Database unique name: ECOM
Database name: ECOM
Oracle home: /u01/app/oracle/product/12.1.0.2/rdbms
Oracle user: oracle
Spfile: +DATA/ECOM/PARAMETERFILE/spfile.276.932381511
Password file: +DATA/ECOM/PASSWORD/pwdecom.256.932380909
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: Pool_ECOM
Disk Groups: DATA
Mount point paths:
Services:
Type: RAC
Start concurrency:
Stop concurrency:
OSDBA group: dba
OSOPER group: oinstall
Database instances:
Configured nodes:
Database is policy managed
Database unique name: BI
Database name: BI
Oracle home: /u01/app/oracle/product/12.1.0.2/rdbms
Oracle user: oracle
Spfile: +DATA/BI/PARAMETERFILE/spfile.306.932385447
Password file: +DATA/BI/PASSWORD/pwdbi.285.932384881
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: Pool_BI
Disk Groups: DATA
Mount point paths:
Services:
Type: RAC
Start concurrency:
Stop concurrency:
OSDBA group: dba
OSOPER group: oinstall
Database instances:
Configured nodes:
Database is policy managed
Database unique name: CRM
Database name: CRM
Oracle home: /u01/app/oracle/product/12.1.0.2/rdbms
Oracle user: oracle
Spfile: +DATA/CRM/PARAMETERFILE/spfile.418.932464087
Password file: +DATA/CRM/PASSWORD/pwdcrm.398.932463453
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: Pool_CRM
Disk Groups: DATA
Mount point paths:
Services:
Type: RAC
Start concurrency:
Stop concurrency:
OSDBA group: dba
OSOPER group: oinstall
Database instances:
Configured nodes:
Database is policy managed
Database unique name: HR
Database name: HR
Oracle home: /u01/app/oracle/product/12.1.0.2/rdbms
Oracle user: oracle
Spfile: +DATA/HR/PARAMETERFILE/spfile.364.932416107
Password file: +DATA/HR/PASSWORD/pwdhr.343.932415493
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: Pool_HR
Disk Groups: DATA
Mount point paths:
Services:
Type: RAC
Start concurrency:
Stop concurrency:
OSDBA group: dba
OSOPER group: oinstall
Database instances:
Configured nodes:
Database is policy managed
Database unique name: SALES
Database name: SALES
Oracle home: /u01/app/oracle/product/12.1.0.2/rdbms
Oracle user: oracle
Spfile: +DATA/SALES/PARAMETERFILE/spfile.333.932407199
Password file: +DATA/SALES/PASSWORD/pwdsales.313.932406567
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: Pool_ECOM
Disk Groups: DATA
Mount point paths:
Services:
Type: RAC
Start concurrency:
Stop concurrency:
OSDBA group: dba
OSOPER group: oinstall
Database instances:
Configured nodes:
Database is policy managed
[/code]
First of all they are some change in the installation process, you have to unzip the linuxx64_12201_grid_home.zip file under the folder where you want to install the new GRID_HOME.
In my case, I have the 12.1.0.2 version installed under /u01/app/grid/12.1.0.2 so I unzipped the file under /u01/app/grid/12.2.0.1
You have to at least 7.5 of remaining space to start the install process.
To start the process, just run gridsetup.sh
grid@node1:/u01/app/grid/12.2.0.1/ [+ASM1] ./gridSetup.sh




That’s a lot of space required! This is because of some news features including quality of service that comes by default in 12.2.
So I have added a new disk to the grid diskgroup!



This is a major change with previous installations, there is no more ORACLE_HOME specification. Now ORACLE_HOME is the folder where you have unzip the gridzip file.


I just put the node1 (local node) in batch 1.
The rest of the cluster is in the second batch.


I have ignored the OCR integrity as it is related to asm filter driver not loaded…
Will do that later on 🙂
 



root.sh succeed on node1…



root.sh succeed on all nodes!
During the process, database where automatically relocated to available node to minimize downtime.
At the end, I used asmca (new interface) to add an acfs cloudfs filesystem.
 



Final state
Local Resources
[code language=”sql”]
——————————————————————————–
ora.ASMNET1LSNR_ASM.lsnr
ONLINE ONLINE node1 STABLE
ONLINE ONLINE node2 STABLE
ONLINE ONLINE node3 STABLE
ONLINE ONLINE node4 STABLE
ONLINE ONLINE node5 STABLE
ONLINE ONLINE node6 STABLE
ONLINE ONLINE node7 STABLE
ONLINE ONLINE node8 STABLE
ora.DATA.CLOUDFS.advm
ONLINE ONLINE node1 STABLE
ONLINE ONLINE node2 STABLE
ONLINE ONLINE node3 STABLE
ONLINE ONLINE node4 STABLE
ONLINE ONLINE node5 STABLE
ONLINE ONLINE node6 STABLE
ONLINE ONLINE node7 STABLE
ONLINE ONLINE node8 STABLE
ora.DATA.dg
ONLINE OFFLINE node1 STABLE
ONLINE OFFLINE node2 STABLE
ONLINE OFFLINE node3 STABLE
ONLINE OFFLINE node4 STABLE
ONLINE ONLINE node5 STABLE
ONLINE OFFLINE node6 STABLE
ONLINE ONLINE node7 STABLE
ONLINE ONLINE node8 STABLE
ora.GRID.dg
ONLINE OFFLINE node1 STABLE
ONLINE OFFLINE node2 STABLE
ONLINE OFFLINE node3 STABLE
ONLINE OFFLINE node4 STABLE
ONLINE ONLINE node5 STABLE
ONLINE OFFLINE node6 STABLE
ONLINE ONLINE node7 STABLE
ONLINE ONLINE node8 STABLE
ora.LISTENER.lsnr
ONLINE ONLINE node1 STABLE
ONLINE ONLINE node2 STABLE
ONLINE ONLINE node3 STABLE
ONLINE ONLINE node4 STABLE
ONLINE ONLINE node5 STABLE
ONLINE ONLINE node6 STABLE
ONLINE ONLINE node7 STABLE
ONLINE ONLINE node8 STABLE
ora.chad
ONLINE ONLINE node1 STABLE
ONLINE ONLINE node2 STABLE
ONLINE ONLINE node3 STABLE
ONLINE ONLINE node4 STABLE
ONLINE ONLINE node5 STABLE
ONLINE ONLINE node6 STABLE
ONLINE ONLINE node7 STABLE
ONLINE ONLINE node8 STABLE
ora.data.cloudfs.acfs
ONLINE ONLINE node1 mounted on /cloudfs,STABLE
ONLINE ONLINE node2 mounted on /cloudfs,STABLE
ONLINE ONLINE node3 mounted on /cloudfs,STABLE
ONLINE ONLINE node4 mounted on /cloudfs,STABLE
ONLINE ONLINE node5 mounted on /cloudfs,STABLE
ONLINE ONLINE node6 mounted on /cloudfs,STABLE
ONLINE ONLINE node7 mounted on /cloudfs,STABLE
ONLINE ONLINE node8 mounted on /cloudfs,STABLE
ora.net1.network
ONLINE ONLINE node1 STABLE
ONLINE ONLINE node2 STABLE
ONLINE ONLINE node3 STABLE
ONLINE ONLINE node4 STABLE
ONLINE ONLINE node5 STABLE
ONLINE ONLINE node6 STABLE
ONLINE ONLINE node7 STABLE
ONLINE ONLINE node8 STABLE
ora.ons
ONLINE ONLINE node1 STABLE
ONLINE ONLINE node2 STABLE
ONLINE ONLINE node3 STABLE
ONLINE ONLINE node4 STABLE
ONLINE ONLINE node5 STABLE
ONLINE ONLINE node6 STABLE
ONLINE ONLINE node7 STABLE
ONLINE ONLINE node8 STABLE
ora.proxy_advm
ONLINE ONLINE node1 STABLE
ONLINE ONLINE node2 STABLE
ONLINE ONLINE node3 STABLE
ONLINE ONLINE node4 STABLE
ONLINE ONLINE node5 STABLE
ONLINE ONLINE node6 STABLE
ONLINE ONLINE node7 STABLE
ONLINE ONLINE node8 STABLE
——————————————————————————–
[/code]
Cluster Resources
[code language=”sql”]
———————————————————-
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE node3 STABLE
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE node2 STABLE
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE node1 STABLE
ora.MGMTLSNR
1 ONLINE ONLINE node1 169.254.218.154 192.
168.2.101,STABLE
ora.asm
1 ONLINE ONLINE node8 Started,STABLE
2 ONLINE ONLINE node5 Started,STABLE
6 ONLINE ONLINE node7 Started,STABLE
ora.bi.db
1 ONLINE ONLINE node5 Open,HOME=/u01/app/oracle/product/12.1.0.2/rdbms,STABLE
2 ONLINE ONLINE node4 Open,HOME=/u01/app/oracle/product/12.1.0.2/rdbms,STABLE
ora.crm.db
1 ONLINE ONLINE node2 Open,HOME=/u01/app/oracle/product/12.1.0.2/rdbms,STABLE
2 ONLINE ONLINE node3 Open,HOME=/u01/app/oracle/product/12.1.0.2/rdbms,STABLE
ora.cvu
1 ONLINE ONLINE node4 STABLE
ora.ecom.db
1 ONLINE ONLINE node6 Open,HOME=/u01/app/oracle/product/12.1.0.2/rdbms,STABLE
2 ONLINE ONLINE node1 Open,HOME=/u01/app/oracle/product/12.1.0.2/rdbms,STABLE
ora.hr.db
1 ONLINE ONLINE node8 Open,HOME=/u01/app/oracle/product/12.1.0.2/rdbms,STABLE
2 ONLINE ONLINE node7 Open,HOME=/u01/app/oracle/product/12.1.0.2/rdbms,STABLE
ora.mgmtdb
1 ONLINE ONLINE node1 Open,STABLE
ora.node1.vip
1 ONLINE ONLINE node1 STABLE
ora.node2.vip
1 ONLINE ONLINE node2 STABLE
ora.node3.vip
1 ONLINE ONLINE node3 STABLE
ora.node4.vip
1 ONLINE ONLINE node4 STABLE
ora.node5.vip
1 ONLINE ONLINE node5 STABLE
ora.node6.vip
1 ONLINE ONLINE node6 STABLE
ora.node7.vip
1 ONLINE ONLINE node7 STABLE
ora.node8.vip
1 ONLINE ONLINE node8 STABLE
ora.qosmserver
1 ONLINE ONLINE node5 STABLE
ora.sales.db
1 ONLINE ONLINE node6 Open,HOME=/u01/app/oracle/product/12.1.0.2/rdbms,STABLE
2 ONLINE ONLINE node1 Open,HOME=/u01/app/oracle/product/12.1.0.2/rdbms,STABLE
ora.scan1.vip
1 ONLINE ONLINE node3 STABLE
ora.scan2.vip
1 ONLINE ONLINE node2 STABLE
ora.scan3.vip
1 ONLINE ONLINE node1 STABLE
—————————————————————–
[/code]
Now just need to decommission the old 12.1.0.2 grid home and that’s it!
Also have to setup the ASM filter driver…
Cheers
jko
 


     

Leave a Reply

Your email address will not be published. Required fields are marked *