Monday, November 7, 2016

Recovery Writer (RVWR) is stuck until more space is available in the recovery area.


Today I got an alert for My OMS is down and when I checked the oem url I see OMS down message.

[oracle@OMS_SERVER bin]$ ./emctl status oms
Oracle Enterprise Manager Cloud Control 13c Release 2
Copyright (c) 1996, 2016 Oracle Corporation.  All rights reserved.
WebTier is Up
Oracle Management Server is Down
JVMD Engine is Down
BI Publisher Server is Up

Checked OMS repository database(EMREPO) and i see database and listener is up and running fine but found below error in alert log…………

*************************************************************
Unable to allocate flashback log of 6377 blocks from
current recovery area of size 32212254720 bytes.
Recovery Writer (RVWR) is stuck until more space
is available in the recovery area.
recovery area is full, presence of a guaranteed
restore point and no reusable flashback logs.
Mon Nov 07 10:51:46 2016
*************************************************************


SQL> select space_limit/1024/1024/1024 maxGB,space_used/1024/1024/1024 usedGB from v$recovery_file_dest;

     MAXGB     USEDGB
---------- ----------
        30 29.9878693

SQL> SELECT FILE_TYPE "Type",PERCENT_SPACE_USED "% Used",PERCENT_SPACE_RECLAIMABLE "% Reclaim",
NUMBER_OF_FILES "# Files" FROM V$FLASH_RECOVERY_AREA_USAGE;
Type                                                                      % Used  % Reclaim    # Files
--------------------------------------------------------------------- ---------- ---------- ----------
CONTROL FILE                                                                   0          0          0
REDO LOG                                                                       0          0          0
ARCHIVED LOG                                                                   0          0          0
BACKUP PIECE                                                                 .06        .06          1
IMAGE COPY                                                                     0          0          0
FLASHBACK LOG                                                               99.9          0        154
FOREIGN ARCHIVED LOG                                                           0          0          0
AUXILIARY DATAFILE COPY                                                        0          0          0

8 rows selected.

SQL> show parameter db_recovery

NAME                                       TYPE                                                                                               VALUE
------------------------------------ -----------------------------------------------------------------------------   ------
db_recovery_file_dest                string                                                                                           /opt/oem/u20
db_recovery_file_dest_size           big integer                                                                                      30G



SQL> SELECT NAME, SCN, TIME, DATABASE_INCARNATION#, GUARANTEE_FLASHBACK_DATABASE, STORAGE_SIZE FROM V$RESTORE_POINT;

 NAME                                     SCN TIME                                         DATABASE_INCARNATION# GUARANTEE STORAGE_SIZE
--------------------------------- ---------- -------------------------------------------- --------------------- --------- ------------
EMREPO_BEFORE_UPGRADE13C          3.1001E+11 27-OCT-16 11.04.22.000000000 AM                                  2 YES         3.2181E+10

Now, I remember it is because of the Grantee Restore point which I have created during my recent OMS upgrade and now I can drop this since it’s been so many days and everything looks good.

SQL> DROP RESTORE POINT EMREPO_BEFORE_UPGRADE13C;

Restore point dropped.

SQL>
SQL> SELECT NAME, SCN, TIME, DATABASE_INCARNATION#, GUARANTEE_FLASHBACK_DATABASE, STORAGE_SIZE FROM V$RESTORE_POINT;

no rows selected

SQL> select space_limit/1024/1024/1024 maxGB,space_used/1024/1024/1024 usedGB from v$recovery_file_dest;

     MAXGB     USEDGB
---------- ----------
        30 .651931763


                               
[oracle@OMS_SERVER bin]$ ./emctl start oms
Oracle Enterprise Manager Cloud Control 13c Release 2
Copyright (c) 1996, 2016 Oracle Corporation.  All rights reserved.
Starting Oracle Management Server...
WebTier Successfully Started
Oracle Management Server Already Started
Oracle Management Server is Up
JVMD Engine is Up
Starting BI Publisher Server ...
BI Publisher Server Already Started
BI Publisher Server is Up


Now I see my OEM url is working fine…………….


Thursday, November 3, 2016

Incorrect Memory Utilization Reported for Linux Hosts in 13c OEM


OMS version: 13.1.1.0.0
OMS server: RHEL 7.2

From the OEM I see Memory graph shows 100% used (Wrong) but my server has lot of free memory available


This is due to Bug 23310224 - Incorrect Memory Utilization % on the Host Home page for RHEL 7.2
EM 13c: Incorrect Memory Utilization Reported for Linux Hosts in Enterprise Manager 13.1.0.0.0 Cloud Control (Doc ID 2144976.1)

[oracle@OMS_SERVER bin]$ ./emctl status oms -details
Oracle Enterprise Manager Cloud Control 13c Release 1
Copyright (c) 1996, 2015 Oracle Corporation.  All rights reserved.
Enter Enterprise Manager Root (SYSMAN) Password :
Console Server Host        : OMS_SERVER.domain.com
HTTP Console Port          : 7788
HTTPS Console Port         : 7803
HTTP Upload Port           : 4889
HTTPS Upload Port          : 4903
EM Instance Home           : /opt/oracle/product/middleware/gc_inst/em/EMGC_OMS1
OMS Log Directory Location : /opt/oracle/product/middleware/gc_inst/em/EMGC_OMS1/sysman/log
OMS is not configured with SLB or virtual hostname
Agent Upload is locked.
OMS Console is locked.
Active CA ID: 1
Console URL: https://OMS_SERVER.domain.com:7803/em
Upload URL: https://OMS_SERVER.domain.com:4903/empbs/upload

WLS Domain Information
Domain Name            : GCDomain
Admin Server Host      : OMS_SERVER.domain.com
Admin Server HTTPS Port: 7102
Admin Server is RUNNING

Oracle Management Server Information
Managed Server Instance Name: EMGC_OMS1
Oracle Management Server Instance Host: OMS_SERVER.domain.com
WebTier is Up
Oracle Management Server is Up
JVMD Engine is Up

BI Publisher Server Information
BI Publisher Managed Server Name: BIP
BI Publisher Server is Up

BI Publisher HTTP Managed Server Port   : 9701
BI Publisher HTTPS Managed Server Port  : 9803
BI Publisher HTTP OHS Port              : 9788
BI Publisher HTTPS OHS Port             : 9851
BI Publisher is locked.
BI Publisher Server named 'BIP' running at URL: https://OMS_SERVER.domain.com:9851/xmlpserver
BI Publisher Server Logs: /opt/oracle/product/middleware/gc_inst/user_projects/domains/GCDomain/servers/BIP/logs/
BI Publisher Log        : /opt/oracle/product/middleware/gc_inst/user_projects/domains/GCDomain/servers/BIP/logs/bipublisher/bipublisher.log



[oracle@OMS_SERVER ~]$ cd $OMS_HOME
[oracle@OMS_SERVER oms]$ pwd
/opt/oracle/product/middleware/oms

Applying patch to OMS can be done in two ways:         
          1. Applying patch without using property file
          2. Applying patch using property file

 Here i'm using option 1 without using property file

1. Applying patch without using property file

[oracle@OMS_SERVER bin]$ ./emctl status oms
Oracle Enterprise Manager Cloud Control 13c Release 1
Copyright (c) 1996, 2015 Oracle Corporation.  All rights reserved.
WebTier is Up
Oracle Management Server is Up
JVMD Engine is Up
BI Publisher Server is Up

[oracle@OMS_SERVER bin]$ ./emctl stop oms
Oracle Enterprise Manager Cloud Control 13c Release 1
Copyright (c) 1996, 2015 Oracle Corporation.  All rights reserved.
Stopping Oracle Management Server...
Oracle Management Server Successfully Stopped
Oracle Management Server is Down
JVMD Engine is Down

[oracle@OMS_SERVER bin]$ ./emctl status oms
Oracle Enterprise Manager Cloud Control 13c Release 1
Copyright (c) 1996, 2015 Oracle Corporation.  All rights reserved.
WebTier is Up
Oracle Management Server is Down
JVMD Engine is Down
BI Publisher Server is Up
[oracle@OMS_SERVER bin]$


[oracle@OMS_SERVER OMSPatcher]$ export ORACLE_HOME=/opt/oracle/product/middleware/oms
[oracle@OMS_SERVER OMSPatcher]$ ./omspatcher apply -analyze /opt/oracle/CB/23095307_OMS_plugin/23095307
OMSPatcher Automation Tool
Copyright (c) 2015, Oracle Corporation.  All rights reserved.


OMSPatcher version : 13.6.0.0.1
OUI version        : 13.6.0.0.0
Running from       : /opt/oracle/product/middleware/oms
Log file location  : /opt/oracle/product/middleware/oms/cfgtoollogs/omspatcher/opatch2016-10-06_13-09-33PM_1.log

OMSPatcher log file: /opt/oracle/product/middleware/oms/cfgtoollogs/omspatcher/23095307/omspatcher_2016-10-06_13-09-38PM_analyze.log

Please enter OMS weblogic admin server URL(t3s://OMS_SERVER.domain.com:7102):>  enter
Please enter OMS weblogic admin server username(weblogic):> enter
Please enter OMS weblogic admin server password:>


WARNING: Could not apply the patch "23092170" because the "oracle.sysman.ssa.oms.plugin with version 13.1.1.0.0" core component of the OMS or the plug-in for which the patch is intended is either not deployed or deployed with another version in your Enterprise Manager system.

Configuration Validation: Success


Running apply prerequisite checks for sub-patch(es) "23030182 23030179 23030173" and Oracle Home "/opt/oracle/product/middleware/oms"...
Sub-patch(es) "23030182 23030179 23030173" are successfully analyzed for Oracle Home "/opt/oracle/product/middleware/oms"


Complete Summary
================


All log file names referenced below can be accessed from the directory "/opt/oracle/product/middleware/oms/cfgtoollogs/omspatcher/2016-10-06_13-09-33PM_SystemPatch_23095307_1"

Prerequisites analysis summary:
-------------------------------

The following sub-patch(es) are applicable:

             Featureset                  Sub-patches                                                       Log file
             ----------                  -----------                                                       --------
  oracle.sysman.top.oms   23030182,23030179,23030173   23030182_23030179_23030173_opatch2016-10-06_13-15-21PM_2.log


The following sub-patches are incompatible with components installed in the OMS system:
23092170


--------------------------------------------------------------------------------
The following warnings have occurred during OPatch execution:
1)  Could not apply the patch "23092170" because the "oracle.sysman.ssa.oms.plugin with version 13.1.1.0.0" core component of the OMS or the plug-in for which the patch is intended is either not deployed or deployed with another version in your Enterprise Manager system.
--------------------------------------------------------------------------------
OMSPatcher Session completed with warnings.
Log file location: /opt/oracle/product/middleware/oms/cfgtoollogs/omspatcher/23095307/omspatcher_2016-10-06_13-09-38PM_analyze.log

OMSPatcher completed with warnings.




Contacted oracle support and they said it can be ignored (latest plugin is not installed in my env) so continued further………




[oracle@OMS_SERVER OMSPatcher]$ ./omspatcher apply  /opt/oracle/CB/23095307_OMS_plugin/23095307
OMSPatcher Automation Tool
Copyright (c) 2015, Oracle Corporation.  All rights reserved.


OMSPatcher version : 13.6.0.0.1
OUI version        : 13.6.0.0.0
Running from       : /opt/oracle/product/middleware/oms
Log file location  : /opt/oracle/product/middleware/oms/cfgtoollogs/omspatcher/opatch2016-10-10_22-52-10PM_1.log

OMSPatcher log file: /opt/oracle/product/middleware/oms/cfgtoollogs/omspatcher/23095307/omspatcher_2016-10-10_22-52-16PM_deploy.log

Please enter OMS weblogic admin server URL(t3s://OMS_SERVER.domain.com:7102):>
Please enter OMS weblogic admin server username(weblogic):>
Please enter OMS weblogic admin server password:>


WARNING: Could not apply the patch "23092170" because the "oracle.sysman.ssa.oms.plugin with version 13.1.1.0.0" core component of the OMS or the plug-in for which the patch is intended is either not deployed or deployed with another version in your Enterprise Manager system.

Configuration Validation: Success


Running apply prerequisite checks for sub-patch(es) "23030182 23030179 23030173" and Oracle Home "/opt/oracle/product/middleware/oms"...
Sub-patch(es) "23030182 23030179 23030173" are successfully analyzed for Oracle Home "/opt/oracle/product/middleware/oms"

To continue, OMSPatcher will do the following:
[Patch and deploy artifacts]   : Apply sub-patch(es) [ 23030182 ] to component "oracle.sysman.db.oms.plugin" and version "13.1.1.0.0";
                                 Apply sub-patch(es) [ 23030179 ] to component "oracle.sysman.emas.oms.plugin" and version "13.1.1.0.0";
                                 Apply sub-patch(es) [ 23030173 ] to component "oracle.sysman.si.oms.plugin" and version "13.1.1.0.0";
                                 Apply RCU artifact with patch "/opt/oracle/product/middleware/oms/.omspatcher_storage/23030179_May_5_2016_22_54_56/original_patch";
                                 Apply RCU artifact with patch "/opt/oracle/product/middleware/oms/.omspatcher_storage/23030182_May_5_2016_22_49_17/original_patch";
                                 Register MRS artifact "targetPatchingImplRegistration";
                                 Register MRS artifact "swlib";
                                 Register MRS artifact "procedures";
                                 Register MRS artifact "omsPropertyDef";
                                 Register MRS artifact "targetType";
                                 Register MRS artifact "storeTargetType";
                                 Register MRS artifact "default_collection";
                                 Register MRS artifact "systemStencil";
                                 Register MRS artifact "OracleCertifiedTemplate";
                                 Register MRS artifact "CfwServiceFamily"


Do you want to proceed? [y|n]
y
User Responded with: Y

Applying sub-patch "23030182 " to component "oracle.sysman.db.oms.plugin" and version "13.1.1.0.0"...

Applying sub-patch "23030179 " to component "oracle.sysman.emas.oms.plugin" and version "13.1.1.0.0"...

Applying sub-patch "23030173 " to component "oracle.sysman.si.oms.plugin" and version "13.1.1.0.0"...

Updating repository with RCU reference file "/opt/oracle/product/middleware/oms/.omspatcher_storage/23030179_May_5_2016_22_54_56/original_patch" for plugin home "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0"

Updating repository with RCU reference file "/opt/oracle/product/middleware/oms/.omspatcher_storage/23030182_May_5_2016_22_49_17/original_patch" for plugin home "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0"

Registering service "targetPatchingImplRegistration" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/targetpatchingregister/RegisterWLSTargetForPatching.xml" for plugin id as "oracle.sysman.emas"...

Registering service "swlib" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/swlib" for plugin id as "oracle.sysman.emas"...

Registering service "swlib" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/swlib/patch" for plugin id as "oracle.sysman.db"...

Registering service "swlib" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/swlib/dbprovision/dbprov" for plugin id as "oracle.sysman.db"...

Registering service "swlib" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/swlib" for plugin id as "oracle.sysman.db"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/procedures/PatchWLSRolling.xml" for plugin id as "oracle.sysman.emas"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/procedures/WlaaSAppProvisioning.xml" for plugin id as "oracle.sysman.emas"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/procedures/LbrWrapperDP.xml" for plugin id as "oracle.sysman.emas"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/procedures/JavaEEAppDeployment.xml" for plugin id as "oracle.sysman.emas"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/procedures/JavaEEDP.xml" for plugin id as "oracle.sysman.emas"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/procedures/PatchWLSParallel.xml" for plugin id as "oracle.sysman.emas"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/procedures/SOAaaSOuterDP.xml" for plugin id as "oracle.sysman.emas"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/procedures/WlaaSSetupDomain.xml" for plugin id as "oracle.sysman.emas"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/procedures/PatchAllNodesCRSDB12.xml" for plugin id as "oracle.sysman.db"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/procedures/PatchRollingCRSDB12.xml" for plugin id as "oracle.sysman.db"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/procedures/provsidb.xml" for plugin id as "oracle.sysman.db"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/procedures/RMANRestore.xml" for plugin id as "oracle.sysman.db"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/procedures/PatchRollingRAC.xml" for plugin id as "oracle.sysman.db"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/procedures/DNFSProfile.xml" for plugin id as "oracle.sysman.db"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/procedures/PatchRestartDB12.xml" for plugin id as "oracle.sysman.db"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/procedures/DBClone.xml" for plugin id as "oracle.sysman.db"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/procedures/DataMigration.xml" for plugin id as "oracle.sysman.db"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/procedures/RMANBackup.xml" for plugin id as "oracle.sysman.db"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/procedures/PatchAllNodesCRS.xml" for plugin id as "oracle.sysman.db"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/procedures/PatchSADB.xml" for plugin id as "oracle.sysman.db"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/procedures/ExtendClusterNG.xml" for plugin id as "oracle.sysman.db"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/procedures/PatchRestart.xml" for plugin id as "oracle.sysman.db"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/procedures/PatchAllNodesRAC.xml" for plugin id as "oracle.sysman.db"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/procedures/PatchRollingCRS.xml" for plugin id as "oracle.sysman.db"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/procedures/provrac.xml" for plugin id as "oracle.sysman.db"...

Registering service "procedures" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/procedures/CloneAndPatchSADB.xml" for plugin id as "oracle.sysman.db"...

Registering service "omsPropertyDef" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/omsProperties/definition/ProvisioningPropDefinition.xml" for plugin id as "oracle.sysman.db"...

Registering service "targetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/targetType/j2ee_application_domain.xml" for plugin id as "oracle.sysman.emas"...

Registering service "targetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/targetType/oracle_bi_publisher.xml" for plugin id as "oracle.sysman.emas"...

Registering service "targetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/targetType/j2ee_application.xml" for plugin id as "oracle.sysman.emas"...

Registering service "targetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/targetType/oracle_apm.xml" for plugin id as "oracle.sysman.emas"...

Registering service "targetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/targetType/oracle_oam.xml" for plugin id as "oracle.sysman.emas"...

Registering service "targetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/targetType/oracle_webcenter.xml" for plugin id as "oracle.sysman.emas"...

Registering service "targetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/targetType/oracle_pdb.xml" for plugin id as "oracle.sysman.db"...

Registering service "targetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/targetType/cluster.xml" for plugin id as "oracle.sysman.db"...

Registering service "targetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/targetType/oracle_database.xml" for plugin id as "oracle.sysman.db"...

Registering service "targetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/targetType/oracle_dbsvc.xml" for plugin id as "oracle.sysman.db"...

Registering service "targetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/targetType/rac_database.xml" for plugin id as "oracle.sysman.db"...

Registering service "storeTargetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/targetType/j2ee_application_domain.xml" for plugin id as "oracle.sysman.emas"...

Registering service "storeTargetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/targetType/j2ee_application.xml" for plugin id as "oracle.sysman.emas"...

Registering service "storeTargetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/targetType/oracle_webcenter.xml" for plugin id as "oracle.sysman.emas"...

Registering service "storeTargetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/targetType/oracle_oam.xml" for plugin id as "oracle.sysman.emas"...

Registering service "storeTargetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/targetType/oracle_bi_publisher.xml" for plugin id as "oracle.sysman.emas"...

Registering service "storeTargetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/targetType/oracle_apm.xml" for plugin id as "oracle.sysman.emas"...

Registering service "storeTargetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/targetType/oracle_dbsvc.xml" for plugin id as "oracle.sysman.db"...

Registering service "storeTargetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/targetType/oracle_database.xml" for plugin id as "oracle.sysman.db"...

Registering service "storeTargetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/targetType/rac_database.xml" for plugin id as "oracle.sysman.db"...

Registering service "storeTargetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/targetType/oracle_pdb.xml" for plugin id as "oracle.sysman.db"...

Registering service "storeTargetType" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/targetType/cluster.xml" for plugin id as "oracle.sysman.db"...

Registering service "default_collection" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/default_collection/oracle_webcenter.xml" for plugin id as "oracle.sysman.emas"...

Registering service "default_collection" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/default_collection/oracle_bi_publisher.xml" for plugin id as "oracle.sysman.emas"...

Registering service "default_collection" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/default_collection/j2ee_application.xml" for plugin id as "oracle.sysman.emas"...

Registering service "default_collection" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/default_collection/oracle_oam.xml" for plugin id as "oracle.sysman.emas"...

Registering service "default_collection" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/default_collection/j2ee_application_domain.xml" for plugin id as "oracle.sysman.emas"...

Registering service "default_collection" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/default_collection/oracle_apm.xml" for plugin id as "oracle.sysman.emas"...

Registering service "default_collection" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/default_collection/oracle_pdb.xml" for plugin id as "oracle.sysman.db"...

Registering service "default_collection" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/default_collection/oracle_database.xml" for plugin id as "oracle.sysman.db"...

Registering service "default_collection" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/default_collection/cluster.xml" for plugin id as "oracle.sysman.db"...

Registering service "default_collection" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/default_collection/rac_database.xml" for plugin id as "oracle.sysman.db"...

Registering service "systemStencil" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/systemStencil/rac_database.xml" for plugin id as "oracle.sysman.db"...

Registering service "systemStencil" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/systemStencil/cluster.xml" for plugin id as "oracle.sysman.db"...

Registering service "OracleCertifiedTemplate" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/monitoringTemplate/oracleCertified/DisablePDBaaSCollectionsTemplate.xml" for plugin id as "oracle.sysman.db"...

Registering service "OracleCertifiedTemplate" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/monitoringTemplate/oracleCertified/EnablePDBaaSRacCollectionsTemplate.xml" for plugin id as "oracle.sysman.db"...

Registering service "OracleCertifiedTemplate" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/monitoringTemplate/oracleCertified/EnablePDBaaSCollectionsTemplate.xml" for plugin id as "oracle.sysman.db"...

Registering service "OracleCertifiedTemplate" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.db.oms.plugin_13.1.1.0.0/metadata/monitoringTemplate/oracleCertified/DisablePDBaaSRacCollectionsTemplate.xml" for plugin id as "oracle.sysman.db"...

Registering service "CfwServiceFamily" with register file "/opt/oracle/product/middleware/oms/plugins/oracle.sysman.emas.oms.plugin_13.1.1.0.0/metadata/cfw/serviceFamily/mw_service_family.xml" for plugin id as "oracle.sysman.emas"...

Complete Summary
================


All log file names referenced below can be accessed from the directory "/opt/oracle/product/middleware/oms/cfgtoollogs/omspatcher/2016-10-10_22-52-10PM_SystemPatch_23095307_1"

Patching summary:
-----------------

Binaries of the following sub-patch(es) have been applied successfully:

                                Featureset   Sub-patches                                     Log file
                                ----------   -----------                                     --------
    oracle.sysman.db.oms.plugin_13.1.1.0.0      23030182   23030182_opatch2016-10-10_22-52-54PM_3.log
    oracle.sysman.si.oms.plugin_13.1.1.0.0      23030173   23030173_opatch2016-10-10_22-54-04PM_5.log
  oracle.sysman.emas.oms.plugin_13.1.1.0.0      23030179   23030179_opatch2016-10-10_22-53-35PM_4.log


The following sub-patches are incompatible with components installed in the OMS system:
23092170

Deployment summary:
-------------------

The following artifact(s) have been successfully deployed:

                           Artifacts                                                                  Log file
                           ---------                                                                  --------
                                 SQL                   rcu_applypatch_original_patch_2016-10-10_22-54-21PM.log
                                 SQL                   rcu_applypatch_original_patch_2016-10-10_23-02-40PM.log
  MRS-targetPatchingImplRegistration   emctl_register_targetPatchingImplRegistration_2016-10-10_23-10-29PM.log
                           MRS-swlib                            emctl_register_swlib_2016-10-10_23-10-36PM.log
                           MRS-swlib                            emctl_register_swlib_2016-10-10_23-11-13PM.log
                           MRS-swlib                            emctl_register_swlib_2016-10-10_23-11-30PM.log
                           MRS-swlib                            emctl_register_swlib_2016-10-10_23-11-57PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-12-31PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-12-40PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-12-47PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-12-55PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-13-03PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-13-10PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-13-19PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-13-27PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-13-35PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-13-44PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-13-52PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-14-01PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-14-08PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-14-17PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-14-24PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-14-31PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-14-39PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-14-47PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-14-55PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-15-03PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-15-11PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-15-20PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-15-28PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-15-36PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-15-45PM.log
                      MRS-procedures                       emctl_register_procedures_2016-10-10_23-15-53PM.log
                  MRS-omsPropertyDef                   emctl_register_omsPropertyDef_2016-10-10_23-16-01PM.log
                      MRS-targetType                       emctl_register_targetType_2016-10-10_23-16-08PM.log
                      MRS-targetType                       emctl_register_targetType_2016-10-10_23-16-18PM.log
                      MRS-targetType                       emctl_register_targetType_2016-10-10_23-16-33PM.log
                      MRS-targetType                       emctl_register_targetType_2016-10-10_23-17-06PM.log
                      MRS-targetType                       emctl_register_targetType_2016-10-10_23-17-21PM.log
                      MRS-targetType                       emctl_register_targetType_2016-10-10_23-17-40PM.log
                      MRS-targetType                       emctl_register_targetType_2016-10-10_23-18-03PM.log
                      MRS-targetType                       emctl_register_targetType_2016-10-10_23-18-37PM.log
                      MRS-targetType                       emctl_register_targetType_2016-10-10_23-18-50PM.log
                      MRS-targetType                       emctl_register_targetType_2016-10-10_23-20-26PM.log
                      MRS-targetType                       emctl_register_targetType_2016-10-10_23-20-35PM.log
                 MRS-storeTargetType                  emctl_register_storeTargetType_2016-10-10_23-21-32PM.log
                 MRS-storeTargetType                  emctl_register_storeTargetType_2016-10-10_23-21-39PM.log
                 MRS-storeTargetType                  emctl_register_storeTargetType_2016-10-10_23-21-49PM.log
                 MRS-storeTargetType                  emctl_register_storeTargetType_2016-10-10_23-21-58PM.log
                 MRS-storeTargetType                  emctl_register_storeTargetType_2016-10-10_23-22-06PM.log
                 MRS-storeTargetType                  emctl_register_storeTargetType_2016-10-10_23-22-14PM.log
                 MRS-storeTargetType                  emctl_register_storeTargetType_2016-10-10_23-22-22PM.log
                 MRS-storeTargetType                  emctl_register_storeTargetType_2016-10-10_23-22-29PM.log
                 MRS-storeTargetType                  emctl_register_storeTargetType_2016-10-10_23-22-37PM.log
                 MRS-storeTargetType                  emctl_register_storeTargetType_2016-10-10_23-22-46PM.log
                 MRS-storeTargetType                  emctl_register_storeTargetType_2016-10-10_23-22-54PM.log
              MRS-default_collection               emctl_register_default_collection_2016-10-10_23-23-01PM.log
              MRS-default_collection               emctl_register_default_collection_2016-10-10_23-23-17PM.log
              MRS-default_collection               emctl_register_default_collection_2016-10-10_23-23-24PM.log
              MRS-default_collection               emctl_register_default_collection_2016-10-10_23-23-37PM.log
              MRS-default_collection               emctl_register_default_collection_2016-10-10_23-23-50PM.log
              MRS-default_collection               emctl_register_default_collection_2016-10-10_23-23-57PM.log
              MRS-default_collection               emctl_register_default_collection_2016-10-10_23-24-08PM.log
              MRS-default_collection               emctl_register_default_collection_2016-10-10_23-24-17PM.log
              MRS-default_collection               emctl_register_default_collection_2016-10-10_23-24-43PM.log
              MRS-default_collection               emctl_register_default_collection_2016-10-10_23-24-52PM.log
                   MRS-systemStencil                    emctl_register_systemStencil_2016-10-10_23-25-08PM.log
                   MRS-systemStencil                    emctl_register_systemStencil_2016-10-10_23-25-16PM.log
         MRS-OracleCertifiedTemplate          emctl_register_OracleCertifiedTemplate_2016-10-10_23-25-23PM.log
         MRS-OracleCertifiedTemplate          emctl_register_OracleCertifiedTemplate_2016-10-10_23-25-32PM.log
         MRS-OracleCertifiedTemplate          emctl_register_OracleCertifiedTemplate_2016-10-10_23-25-39PM.log
         MRS-OracleCertifiedTemplate          emctl_register_OracleCertifiedTemplate_2016-10-10_23-25-47PM.log
                MRS-CfwServiceFamily                 emctl_register_CfwServiceFamily_2016-10-10_23-25-55PM.log


--------------------------------------------------------------------------------
The following warnings have occurred during OPatch execution:
1)  Could not apply the patch "23092170" because the "oracle.sysman.ssa.oms.plugin with version 13.1.1.0.0" core component of the OMS or the plug-in for which the patch is intended is either not deployed or deployed with another version in your Enterprise Manager system.
--------------------------------------------------------------------------------
OMSPatcher Session completed with warnings.
Log file location: /opt/oracle/product/middleware/oms/cfgtoollogs/omspatcher/23095307/omspatcher_2016-10-10_22-52-16PM_deploy.log

OMSPatcher completed with warnings.



[oracle@OMS_SERVER OMSPatcher]$ /opt/oracle/product/middleware/oms/bin/emctl start oms
Oracle Enterprise Manager Cloud Control 13c Release 1
Copyright (c) 1996, 2015 Oracle Corporation.  All rights reserved.
Starting Oracle Management Server...
WebTier Successfully Started
Oracle Management Server Successfully Started
Oracle Management Server is Up
JVMD Engine is Up
Starting BI Publisher Server ...
BI Publisher Server Already Started
BI Publisher Server is Up


[oracle@OMS_SERVER OMSPatcher]$ /opt/oracle/product/middleware/oms/bin/emctl status oms
Oracle Enterprise Manager Cloud Control 13c Release 1
Copyright (c) 1996, 2015 Oracle Corporation.  All rights reserved.
WebTier is Up
Oracle Management Server is Up
JVMD Engine is Up
BI Publisher Server is Up





oraprod11:NOTSET:/opt/oracle/product/oemagent/agent13c/agent_13.1.0.0.0/bin $ free -m
                     total       used       free     shared    buffers     cached
Mem:       3101968    3095442       6526          1       2136    1101277
-/+ buffers/cache:    1992028    1109940
Swap:       102399          0     102399

Later after few mins i see the memory graph showing correctly...........

Auto Scroll Stop Scroll