8 Nodes Cluster Upgrade from 12.1.0.2 to 12.2.0.1

Here there,

This a from scratch first test case I am trying to upgrade my 12.1.0.2 cluster lab to 12.2.0.1 just downloaded!

Here are some specification:

Main Host is Red Hat Enterprise Linux Server release 6.6 (Santiago)

  • VMWare Workstation 10
    • 8 nodes cluster under Oracle Red Hat Enterprise Linux Server release 6.5 (Santiago)

Cluster inventory
Local Resources

------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
    ONLINE  ONLINE       node1   STABLE
    ONLINE  ONLINE       node2   STABLE
    ONLINE  ONLINE       node3   STABLE
    ONLINE  ONLINE       node4   STABLE
    ONLINE  ONLINE       node5   STABLE
    ONLINE  ONLINE       node6   STABLE
    ONLINE  ONLINE       node7   STABLE
    ONLINE  ONLINE       node8   STABLE
ora.DATA.dg
    OFFLINE OFFLINE      node1   STABLE
    ONLINE  ONLINE       node2   STABLE
    ONLINE  OFFLINE      node3   STABLE
    ONLINE  ONLINE       node4   STABLE
    ONLINE  ONLINE       node5   STABLE
    ONLINE  OFFLINE      node6   STABLE
    ONLINE  OFFLINE      node7   STABLE
    ONLINE  OFFLINE      node8   STABLE
ora.GRID.dg
    OFFLINE OFFLINE      node1   STABLE
    ONLINE  ONLINE       node2   STABLE
    OFFLINE OFFLINE      node3   STABLE
    ONLINE  ONLINE       node4   STABLE
    ONLINE  ONLINE       node5   STABLE
    OFFLINE OFFLINE      node6   STABLE
    OFFLINE OFFLINE      node7   STABLE
    OFFLINE OFFLINE      node8   STABLE
ora.LISTENER.lsnr
    ONLINE  ONLINE       node1   STABLE
    ONLINE  ONLINE       node2   STABLE
    ONLINE  ONLINE       node3   STABLE
    ONLINE  ONLINE       node4   STABLE
    ONLINE  ONLINE       node5   STABLE
    ONLINE  ONLINE       node6   STABLE
    ONLINE  ONLINE       node7   STABLE
    ONLINE  ONLINE       node8   STABLE
ora.net1.network
    ONLINE  ONLINE       node1   STABLE
    ONLINE  ONLINE       node2   STABLE
    ONLINE  ONLINE       node3   STABLE
    ONLINE  ONLINE       node4   STABLE
    ONLINE  ONLINE       node5   STABLE
    ONLINE  ONLINE       node6   STABLE
    ONLINE  ONLINE       node7   STABLE
    ONLINE  ONLINE       node8   STABLE
ora.ons
    ONLINE  ONLINE       node1   STABLE
    ONLINE  ONLINE       node2   STABLE
    ONLINE  ONLINE       node3   STABLE
    ONLINE  ONLINE       node4   STABLE
    ONLINE  ONLINE       node5   STABLE
    ONLINE  ONLINE       node6   STABLE
    ONLINE  ONLINE       node7   STABLE
    ONLINE  ONLINE       node8   STABLE
-----------------------------------------------

Cluster resources

Cluster Resources
------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE  node2 STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE  node3 STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE  node4 STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE  node6 169.254.91.188 192.168.2.106,STABLE
ora.asm
      1        ONLINE  ONLINE  node4 Started,STABLE
      4        ONLINE  ONLINE  node5 Started,STABLE
      5        ONLINE  ONLINE  node2 Started,STABLE
ora.bi.db
      1        ONLINE  ONLINE  node4 Open,STABLE
      2        ONLINE  ONLINE  node6 Open,STABLE
ora.crm.db
      1        ONLINE  ONLINE  node5 Open,STABLE
      2        ONLINE  ONLINE  node3 Open,STABLE
ora.cvu
      1        ONLINE  ONLINE  node8 STABLE
ora.ecom.db
      1        ONLINE  ONLINE  node2 Open,STABLE
      2        ONLINE  ONLINE  node7 Open,STABLE
ora.hr.db
      1        ONLINE  ONLINE  node1 Open,STABLE
      2        ONLINE  ONLINE  node8 Open,STABLE
ora.mgmtdb
      1        ONLINE  ONLINE  node6 Open,STABLE
ora.node1.vip
      1        ONLINE  ONLINE  node1 STABLE
ora.node2.vip
      1        ONLINE  ONLINE  node2 STABLE
ora.node3.vip
      1        ONLINE  ONLINE  node3 STABLE
ora.node4.vip
      1        ONLINE  ONLINE  node4 STABLE
ora.node5.vip
      1        ONLINE  ONLINE  node5 STABLE
ora.node6.vip
      1        ONLINE  ONLINE  node6 STABLE
ora.node7.vip
      1        ONLINE  ONLINE  node7 STABLE
ora.node8.vip
      1        ONLINE  ONLINE  node8 STABLE
ora.oc4j
      1        ONLINE  ONLINE  node8 STABLE
ora.sales.db
      1        ONLINE  ONLINE  node7 Open,STABLE
      2        ONLINE  ONLINE  node2 Open,STABLE
ora.scan1.vip
      1        ONLINE  ONLINE  node2 STABLE
ora.scan2.vip
      1        ONLINE  ONLINE  node3 STABLE
ora.scan3.vip
      1        ONLINE  ONLINE  node4 STABLE

-----------------------------------------------

Server pools

Server pool name: Free
Importance: 0, Min: 0, Max: -1
Category:
Candidate server names:

Server pool name: Generic
Importance: 0, Min: 0, Max: -1
Category:
Candidate server names:

Server pool name: Pool_BI
Importance: 2, Min: 2, Max: 2
Category: hub
Candidate server names:

Server pool name: Pool_CRM
Importance: 2, Min: 2, Max: 2
Category: hub
Candidate server names:

Server pool name: Pool_ECOM
Importance: 3, Min: 2, Max: 2
Category: hub
Candidate server names:

Server pool name: Pool_HR
Importance: 1, Min: 2, Max: 2
Category: hub
Candidate server names:

Databases

Database unique name: ECOM
Database name: ECOM
Oracle home: /u01/app/oracle/product/12.1.0.2/rdbms
Oracle user: oracle
Spfile: +DATA/ECOM/PARAMETERFILE/spfile.276.932381511
Password file: +DATA/ECOM/PASSWORD/pwdecom.256.932380909
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: Pool_ECOM
Disk Groups: DATA
Mount point paths:
Services:
Type: RAC
Start concurrency:
Stop concurrency:
OSDBA group: dba
OSOPER group: oinstall
Database instances:
Configured nodes:
Database is policy managed

Database unique name: BI
Database name: BI
Oracle home: /u01/app/oracle/product/12.1.0.2/rdbms
Oracle user: oracle
Spfile: +DATA/BI/PARAMETERFILE/spfile.306.932385447
Password file: +DATA/BI/PASSWORD/pwdbi.285.932384881
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: Pool_BI
Disk Groups: DATA
Mount point paths:
Services:
Type: RAC
Start concurrency:
Stop concurrency:
OSDBA group: dba
OSOPER group: oinstall
Database instances:
Configured nodes:
Database is policy managed


Database unique name: CRM
Database name: CRM
Oracle home: /u01/app/oracle/product/12.1.0.2/rdbms
Oracle user: oracle
Spfile: +DATA/CRM/PARAMETERFILE/spfile.418.932464087
Password file: +DATA/CRM/PASSWORD/pwdcrm.398.932463453
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: Pool_CRM
Disk Groups: DATA
Mount point paths:
Services:
Type: RAC
Start concurrency:
Stop concurrency:
OSDBA group: dba
OSOPER group: oinstall
Database instances:
Configured nodes:
Database is policy managed


Database unique name: HR
Database name: HR
Oracle home: /u01/app/oracle/product/12.1.0.2/rdbms
Oracle user: oracle
Spfile: +DATA/HR/PARAMETERFILE/spfile.364.932416107
Password file: +DATA/HR/PASSWORD/pwdhr.343.932415493
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: Pool_HR
Disk Groups: DATA
Mount point paths:
Services:
Type: RAC
Start concurrency:
Stop concurrency:
OSDBA group: dba
OSOPER group: oinstall
Database instances:
Configured nodes:
Database is policy managed


Database unique name: SALES
Database name: SALES
Oracle home: /u01/app/oracle/product/12.1.0.2/rdbms
Oracle user: oracle
Spfile: +DATA/SALES/PARAMETERFILE/spfile.333.932407199
Password file: +DATA/SALES/PASSWORD/pwdsales.313.932406567
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: Pool_ECOM
Disk Groups: DATA
Mount point paths:
Services:
Type: RAC
Start concurrency:
Stop concurrency:
OSDBA group: dba
OSOPER group: oinstall
Database instances:
Configured nodes:
Database is policy managed

First of all they are some change in the installation process, you have to unzip the linuxx64_12201_grid_home.zip file under the folder where you want to install the new GRID_HOME.

In my case, I have the 12.1.0.2 version installed under /u01/app/grid/12.1.0.2 so I unzipped the file under /u01/app/grid/12.2.0.1

You have to at least 7.5 of remaining space to start the install process.

To start the process, just run gridsetup.sh

grid@node1:/u01/app/grid/12.2.0.1/ [+ASM1] ./gridSetup.sh

That’s a lot of space required! This is because of some news features including quality of service that comes by default in 12.2.

So I have added a new disk to the grid diskgroup!

This is a major change with previous installations, there is no more ORACLE_HOME specification. Now ORACLE_HOME is the folder where you have unzip the gridzip file.

I just put the node1 (local node) in batch 1.

The rest of the cluster is in the second batch.

I have ignored the OCR integrity as it is related to asm filter driver not loaded…

Will do that later on 🙂

 

root.sh succeed on node1…

root.sh succeed on all nodes!

During the process, database where automatically relocated to available node to minimize downtime.

At the end, I used asmca (new interface) to add an acfs cloudfs filesystem.

 


Final state

Local Resources

--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
               ONLINE  ONLINE   node1  STABLE
               ONLINE  ONLINE   node2  STABLE
               ONLINE  ONLINE   node3  STABLE
               ONLINE  ONLINE   node4  STABLE
               ONLINE  ONLINE   node5  STABLE
               ONLINE  ONLINE   node6  STABLE
               ONLINE  ONLINE   node7  STABLE
               ONLINE  ONLINE   node8  STABLE
ora.DATA.CLOUDFS.advm
               ONLINE  ONLINE   node1  STABLE
               ONLINE  ONLINE   node2  STABLE
               ONLINE  ONLINE   node3  STABLE
               ONLINE  ONLINE   node4  STABLE
               ONLINE  ONLINE   node5  STABLE
               ONLINE  ONLINE   node6  STABLE
               ONLINE  ONLINE   node7  STABLE
               ONLINE  ONLINE   node8  STABLE
ora.DATA.dg
               ONLINE  OFFLINE  node1  STABLE
               ONLINE  OFFLINE  node2  STABLE
               ONLINE  OFFLINE  node3  STABLE
               ONLINE  OFFLINE  node4  STABLE
               ONLINE  ONLINE   node5  STABLE
               ONLINE  OFFLINE  node6  STABLE
               ONLINE  ONLINE   node7  STABLE
               ONLINE  ONLINE   node8  STABLE
ora.GRID.dg
               ONLINE  OFFLINE  node1  STABLE
               ONLINE  OFFLINE  node2  STABLE
               ONLINE  OFFLINE  node3  STABLE
               ONLINE  OFFLINE  node4  STABLE
               ONLINE  ONLINE   node5  STABLE
               ONLINE  OFFLINE  node6  STABLE
               ONLINE  ONLINE   node7  STABLE
               ONLINE  ONLINE   node8  STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE   node1  STABLE
               ONLINE  ONLINE   node2  STABLE
               ONLINE  ONLINE   node3  STABLE
               ONLINE  ONLINE   node4  STABLE
               ONLINE  ONLINE   node5  STABLE
               ONLINE  ONLINE   node6  STABLE
               ONLINE  ONLINE   node7  STABLE
               ONLINE  ONLINE   node8  STABLE
ora.chad
               ONLINE  ONLINE   node1  STABLE
               ONLINE  ONLINE   node2  STABLE
               ONLINE  ONLINE   node3  STABLE
               ONLINE  ONLINE   node4  STABLE
               ONLINE  ONLINE   node5  STABLE
               ONLINE  ONLINE   node6  STABLE
               ONLINE  ONLINE   node7  STABLE
               ONLINE  ONLINE   node8  STABLE
ora.data.cloudfs.acfs
               ONLINE  ONLINE   node1  mounted on /cloudfs,STABLE
               ONLINE  ONLINE   node2  mounted on /cloudfs,STABLE
               ONLINE  ONLINE   node3  mounted on /cloudfs,STABLE
               ONLINE  ONLINE   node4  mounted on /cloudfs,STABLE
               ONLINE  ONLINE   node5  mounted on /cloudfs,STABLE
               ONLINE  ONLINE   node6  mounted on /cloudfs,STABLE
               ONLINE  ONLINE   node7  mounted on /cloudfs,STABLE
               ONLINE  ONLINE   node8  mounted on /cloudfs,STABLE                                           
ora.net1.network
               ONLINE  ONLINE   node1  STABLE
               ONLINE  ONLINE   node2  STABLE
               ONLINE  ONLINE   node3  STABLE
               ONLINE  ONLINE   node4  STABLE
               ONLINE  ONLINE   node5  STABLE
               ONLINE  ONLINE   node6  STABLE
               ONLINE  ONLINE   node7  STABLE
               ONLINE  ONLINE   node8  STABLE
ora.ons
               ONLINE  ONLINE   node1  STABLE
               ONLINE  ONLINE   node2  STABLE
               ONLINE  ONLINE   node3  STABLE
               ONLINE  ONLINE   node4  STABLE
               ONLINE  ONLINE   node5  STABLE
               ONLINE  ONLINE   node6  STABLE
               ONLINE  ONLINE   node7  STABLE
               ONLINE  ONLINE   node8  STABLE
ora.proxy_advm
               ONLINE  ONLINE   node1  STABLE
               ONLINE  ONLINE   node2  STABLE
               ONLINE  ONLINE   node3  STABLE
               ONLINE  ONLINE   node4  STABLE
               ONLINE  ONLINE   node5  STABLE
               ONLINE  ONLINE   node6  STABLE
               ONLINE  ONLINE   node7  STABLE
               ONLINE  ONLINE   node8  STABLE
--------------------------------------------------------------------------------

Cluster Resources

----------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE  node3    STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE  node2    STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE  node1    STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE  node1    169.254.218.154 192.
                                        168.2.101,STABLE
ora.asm
      1        ONLINE  ONLINE  node8    Started,STABLE
      2        ONLINE  ONLINE  node5    Started,STABLE
      6        ONLINE  ONLINE  node7    Started,STABLE
ora.bi.db
      1        ONLINE  ONLINE  node5    Open,HOME=/u01/app/oracle/product/12.1.0.2/rdbms,STABLE
      2        ONLINE  ONLINE  node4    Open,HOME=/u01/app/oracle/product/12.1.0.2/rdbms,STABLE
ora.crm.db
      1        ONLINE  ONLINE  node2    Open,HOME=/u01/app/oracle/product/12.1.0.2/rdbms,STABLE
      2        ONLINE  ONLINE  node3    Open,HOME=/u01/app/oracle/product/12.1.0.2/rdbms,STABLE
ora.cvu
      1        ONLINE  ONLINE  node4    STABLE
ora.ecom.db
      1        ONLINE  ONLINE  node6    Open,HOME=/u01/app/oracle/product/12.1.0.2/rdbms,STABLE
      2        ONLINE  ONLINE  node1    Open,HOME=/u01/app/oracle/product/12.1.0.2/rdbms,STABLE
ora.hr.db
      1        ONLINE  ONLINE  node8    Open,HOME=/u01/app/oracle/product/12.1.0.2/rdbms,STABLE
      2        ONLINE  ONLINE  node7    Open,HOME=/u01/app/oracle/product/12.1.0.2/rdbms,STABLE
ora.mgmtdb
      1        ONLINE  ONLINE  node1    Open,STABLE
ora.node1.vip
      1        ONLINE  ONLINE  node1    STABLE
ora.node2.vip
      1        ONLINE  ONLINE  node2    STABLE
ora.node3.vip
      1        ONLINE  ONLINE  node3    STABLE
ora.node4.vip
      1        ONLINE  ONLINE  node4    STABLE
ora.node5.vip
      1        ONLINE  ONLINE  node5    STABLE
ora.node6.vip
      1        ONLINE  ONLINE  node6    STABLE
ora.node7.vip
      1        ONLINE  ONLINE  node7    STABLE
ora.node8.vip
      1        ONLINE  ONLINE  node8    STABLE
ora.qosmserver
      1        ONLINE  ONLINE  node5    STABLE
ora.sales.db
      1        ONLINE  ONLINE  node6    Open,HOME=/u01/app/oracle/product/12.1.0.2/rdbms,STABLE
      2        ONLINE  ONLINE  node1    Open,HOME=/u01/app/oracle/product/12.1.0.2/rdbms,STABLE
ora.scan1.vip
      1        ONLINE  ONLINE  node3    STABLE
ora.scan2.vip
      1        ONLINE  ONLINE  node2    STABLE
ora.scan3.vip
      1        ONLINE  ONLINE  node1    STABLE
-----------------------------------------------------------------

Now just need to decommission the old 12.1.0.2 grid home and that’s it!

Also have to setup the ASM filter driver…

Cheers

jko

 

The following two tabs change content below.

Jacques

I am Oracle Certified Master 11g & 12c database architect with significant experience in heterogeneous environments, and strong ability to lead complex and critical projects requiring multiple technical implementations. at Trivadis SA

Leave a Reply

Your email address will not be published. Required fields are marked *