Sunday, December 30, 2018

Oracle Golden Gate – Performance Toolkit Monitor

  
This PTM is new in 12c version and it gives users to view and monitor GG in real time GUI mode 
Download jar file from the below location and place it in some location 

https://www.oracle.com/technetwork/middleware/goldengate/oracle-goldengate-exchange-3805527.html 
  
Pre req’s : 

1.       Add  “ENABLEMONITORING” in GLOBALS file 
  
      edit params ./GLOBALS 
              add  ENABLEMONITORING 
  
2.       from your local open command prompt and check java is installed or not 
from your local pc: run--> cmd

 C:\Users\myuserjava -jar <complete_path_of_jarfile> 

Ex:    java -jar C:\Users\myuser\Desktop\ogg-performancetoolkit-3810657.jar 
  
  
Go to File à Connect à New Connection 
  
  
  FIill in the server loggin details and then you are all set to use it, Thanks

Tuesday, December 18, 2018

ggsci: error while loading shared libraries: libclntsh.so.12.1: cannot open shared object file: No such file or directory


I have a shell script which Kicks off automatically when server reboots but that script when trying to login to ggsci giving below error

/goldengate/home/./ggsci: error while loading shared libraries: libclntsh.so.12.1: cannot open shared object file: No such file or directory

Shell Script:
oradev01:NOTSET:/home/oracle $ cat /goldengate/DBA/start_mgr_rc.sh
sudo su - oracle -c "export ORACLE_HOME=/opt/oracle/product/12.1.0.2.64;export PATH=$ORACLE_HOME/bin:$PATH;export LD_LIBRARY_PATH=$ORACLE_HOME/lib;/goldengate/home/./ggsci" <<EOF
sh sleep 30m
start mgr
EOF
exit;

Reason:
ggsci is unable to locate lib files which are available under database ORACLE_HOME, tried to verify login manually and same issue

oradev01:NOTSET:/goldengate/home $ ./ggsci
/goldengate/home/./ggsci: error while loading shared libraries: libclntsh.so.12.1: cannot open shared object file: No such file or directory

oradev01:NOTSET:/goldengate/home $  ldd ./ggsci
        linux-vdso.so.1 =>  (0x00007ffc0b5e3000)
        librt.so.1 => /lib64/librt.so.1 (0x0000003504000000)
        libdl.so.2 => /lib64/libdl.so.2 (0x0000003503c00000)
        lib./ggscilog.so => /goldengate/home/./lib./ggscilog.so (0x00007f07cf2a8000)
        lib./ggscirepo.so => /goldengate/home/./lib./ggscirepo.so (0x00007f07cf036000)
        libdb-6.1.so => /goldengate/home/./libdb-6.1.so (0x00007f07cec51000)
        lib./ggsciperf.so => /goldengate/home/./lib./ggsciperf.so (0x00007f07cea21000)
        lib./ggsciparam.so => /goldengate/home/./lib./ggsciparam.so (0x00007f07cd917000)
        libicui18n.so.48 => /goldengate/home/./libicui18n.so.48 (0x00007f07cd527000)
        libicuuc.so.48 => /goldengate/home/./libicuuc.so.48 (0x00007f07cd1a6000)
        libicudata.so.48 => /goldengate/home/./libicudata.so.48 (0x00007f07cb9e1000)
        libpthread.so.0 => /lib64/libpthread.so.0 (0x0000003503800000)
        libxerces-c.so.28 => /goldengate/home/./libxerces-c.so.28 (0x00007f07cb41a000)
        libantlr3c.so => /goldengate/home/./libantlr3c.so (0x00007f07cb201000)
        libnnz12.so => not found
        libclntsh.so.12.1 => not found
        libons.so => not found
        libclntshcore.so.12.1 => not found
        lib./ggscinnzitp.so => /goldengate/home/./lib./ggscinnzitp.so (0x00007f07ca721000)
        libm.so.6 => /lib64/libm.so.6 (0x0000003504800000)
        libc.so.6 => /lib64/libc.so.6 (0x0000003503400000)
        /lib64/ld-linux-x86-64.so.2 (0x0000003503000000)
        libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x000000350f000000)
        libgcc_s.so.1 => /lib64/libgcc_s.so.1 (0x000000350a400000)

oradev01:NOTSET:/goldengate/home $ exit

As ORACLE user Create Soft links

oradev01:NOTSET:/opt/oracle/product/12.1.0.2.64/lib $ ls -l libnnz*
-rw-r--r-- 1 oracle dba  1752834 Jul  5  2016 libnnz12.a
-rwxr-xr-x 1 oracle dba  6318657 Jul  5  2016 libnnz12.so
-rw-r--r-- 1 oracle dba 19160504 Jul  5  2016 libnnzst12.a

oradev01:NOTSET:/opt/oracle/product/12.1.0.2.64/lib $ cd -
/goldengate/home

oradev01:NOTSET:/goldengate/home $ ln -s /opt/oracle/product/12.1.0.2.64/lib/libnnz12.so libnnz12.so

oradev01:NOTSET:/goldengate/home $ ls -l libnnz12.so
lrwxrwxrwx 1 oracle dba 47 Sep 22 10:04 libnnz12.so -> /opt/oracle/product/12.1.0.2.64/lib/libnnz12.so

oradev01:NOTSET:/goldengate/home $ ./ggsci
/goldengate/home/./ggscisci: error while loading shared libraries: libclntsh.so.12.1: cannot open shared object file: No such file or directory

oradev01:NOTSET:/goldengate/home $ ln -s /opt/oracle/product/12.1.0.2.64/lib/libclntsh.so.12.1 libclntsh.so.12.1

oradev01:NOTSET:/goldengate/home $ ./ggsci
/goldengate/home/./ggscisci: error while loading shared libraries: libons.so: cannot open shared object file: No such file or directory

oradev01:NOTSET:/goldengate/home $ ln -s /opt/oracle/product/12.1.0.2.64/lib/libons.so libons.so

oradev01:NOTSET:/goldengate/home $ ./ggsci
/goldengate/home/./ggscisci: error while loading shared libraries: libclntshcore.so.12.1: cannot open shared object file: No such file or directory

oradev01:NOTSET:/goldengate/home $ ln -s /opt/oracle/product/12.1.0.2.64/lib/libclntshcore.so.12.1 libclntshcore.so.12.1

oradev01:NOTSET:/goldengate/home $ ./ggsci

Oracle GoldenGate Command Interpreter for Oracle
Version 12.2.0.1.170221 O./GGSCICORE_12.2.0.1.0O./GGSCIBP_PLATFORMS_170123.1033_FBO
Linux, x64, 64bit (optimized), Oracle 12c on Jan 23 2017 23:22:14
Operating system character set identified as UTF-8.

Copyright (C) 1995, 2017, Oracle and/or its affiliates. All rights reserved.



GGSCI (oradev01.domain.local) 1>exit

Yes now I can login after doing softlinks

oradev01:NOTSET:/goldengate/home $ ls -lrth lib*
-rw-r----- 1 oracle dba 1.7K Jan 30  2017 libxml2.txt
-rwxr-x--- 1 oracle dba 4.7M Jan 30  2017 libxerces-c.so.28
-rwxr-x--- 1 oracle dba 1.8M Jan 30  2017 libicuuc.so.48.1
-rwxr-x--- 1 oracle dba 1.8M Jan 30  2017 libicuuc.so.48
-rwxr-x--- 1 oracle dba 2.5M Jan 30  2017 libicui18n.so.48.1
-rwxr-x--- 1 oracle dba 2.5M Jan 30  2017 libicui18n.so.48
-rwxr-x--- 1 oracle dba  22M Jan 30  2017 libicudata.so.48.1
-rwxr-x--- 1 oracle dba  22M Jan 30  2017 libicudata.so.48
-rwxr-x--- 1 oracle dba 3.0M Jan 30  2017 lib./ggscirepo.so
-rwxr-x--- 1 oracle dba 1.6M Jan 30  2017 lib./ggsciperf.so
-rwxr-x--- 1 oracle dba  43M Jan 30  2017 lib./ggsciparam.so
-rwxr-x--- 1 oracle dba  11M Jan 30  2017 lib./ggscinnzitp.so
-rwxr-x--- 1 oracle dba  14M Jan 30  2017 lib./ggscilog.so
-rwxr-x--- 1 oracle dba 2.1M Jan 30  2017 libdb-6.1.so
-rwxr-x--- 1 oracle dba 124K Jan 30  2017 libantlr3c.so
lrwxrwxrwx 1 oracle dba   47 Sep 22 10:04 libnnz12.so -> /opt/oracle/product/12.1.0.2.64/lib/libnnz12.so
lrwxrwxrwx 1 oracle dba   53 Sep 22 10:04 libclntsh.so.12.1 -> /opt/oracle/product/12.1.0.2.64/lib/libclntsh.so.12.1
lrwxrwxrwx 1 oracle dba   45 Sep 22 10:05 libons.so -> /opt/oracle/product/12.1.0.2.64/lib/libons.so
lrwxrwxrwx 1 oracle dba   57 Sep 22 10:05 libclntshcore.so.12.1 -> /opt/oracle/product/12.1.0.2.64/lib/libclntshcore.so.12.1

  
(OR)
To Avoid this issue include $ORACLE_HOME/lib, $OGG_HOME in bash profile

Sunday, November 4, 2018

WARNING OGG-01519 in Oracle GoldenGate Replicat



Today my GG Checkpoint table not updating and my Replicat NOT moving at all but the lag is ZERO
I tried even bouncing the replicat but still NO Luck

DB Version:  12.1.0.2.0
GG Version:  12.2

GGSCI (trgprod.domain.com) 4> info all

Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     RUNNING
REPLICAT    RUNNING     REPSTDB    00:00:00      00:00:00
REPLICAT    RUNNING     REPUPDB    00:00:00      00:00:01
REPLICAT    RUNNING     REPTGDB      00:00:00      00:00:05


GGSCI (trgprod.domain.com) 5> info REPTGDB

REPLICAT   REPTGDB    Last Started 2018-10-24 14:35   Status RUNNING
Checkpoint Lag       00:00:00 (updated 00:00:13 ago)
Process ID           9255
Log Read Checkpoint  File /opt/oracle/GG/home/dirdat/reptgdb/MT000001301
                     2018-10-11 06:58:48.821076  RBA 16434843


GGSCI (trgprod.domain.com) 6> send REPTGDB status

Sending STATUS request to REPLICAT REPTGDB ...
  Current status: At EOF
  Sequence #: 1301
  RBA: 16434843
  0 records in current transaction

From above send command we can see that the GG is at the end of the trail file and processed all records in it

Ggserr.log:

2018-10-31 10:22:27  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (oracle): info REPTGDB.
2018-10-31 10:22:49  WARNING OGG-01519  Oracle GoldenGate Delivery for Oracle, REPTGDB.prm:  Waiting at EOF on input trail file /opt/oracle/GG/home/dirdat/reptgdb/MT000001301, which is not marked as complete; but succeeding trail file /opt/oracle/GG/home/dirdat/reptgdb/MT000001302 exists. If ALTER ETROLLOVER has been performed on source extract, ALTER EXTSEQNO must be performed on each corresponding downstream reader.

Trails Files are Accumulating but GG not processing and moving forward

trgprod:NOTSET:/home/oracle $ ls -lrth /opt/oracle/GG/home/dirdat/reptgdb/MT*

-rw-r----- 1 oracle dba  16M Oct 20 11:16 /opt/oracle/GG/home/dirdat/reptgdb/MT000001301
-rw-r----- 1 oracle dba  48M Oct 22 08:25 /opt/oracle/GG/home/dirdat/reptgdb/MT000001302
-rw-r----- 1 oracle dba  48M Oct 22 08:33 /opt/oracle/GG/home/dirdat/reptgdb/MT000001303
-rw-r----- 1 oracle dba  48M Oct 22 08:57 /opt/oracle/GG/home/dirdat/reptgdb/MT000001304
-rw-r----- 1 oracle dba  48M Oct 22 15:34 /opt/oracle/GG/home/dirdat/reptgdb/MT000001305
-rw-r----- 1 oracle dba  48M Oct 23 07:33 /opt/oracle/GG/home/dirdat/reptgdb/MT000001306
-rw-r----- 1 oracle dba  48M Oct 23 15:30 /opt/oracle/GG/home/dirdat/reptgdb/MT000001307
-rw-r----- 1 oracle dba  48M Oct 24 07:13 /opt/oracle/GG/home/dirdat/reptgdb/MT000001308
-rw-r----- 1 oracle dba  48M Oct 24 13:43 /opt/oracle/GG/home/dirdat/reptgdb/MT000001309
-rw-r----- 1 oracle dba  915 Oct 24 14:30 /opt/oracle/GG/home/dirdat/reptgdb/MT000001311
-rw-r----- 1 oracle dba 6.7M Oct 24 14:30 /opt/oracle/GG/home/dirdat/reptgdb/MT000001310
-rw-r----- 1 oracle dba  48M Oct 25 08:12 /opt/oracle/GG/home/dirdat/reptgdb/MT000001312
-rw-r----- 1 oracle dba  48M Oct 25 16:27 /opt/oracle/GG/home/dirdat/reptgdb/MT000001313
-rw-r----- 1 oracle dba  48M Oct 26 07:00 /opt/oracle/GG/home/dirdat/reptgdb/MT000001314
-rw-r----- 1 oracle dba  48M Oct 26 10:13 /opt/oracle/GG/home/dirdat/reptgdb/MT000001315
-rw-r----- 1 oracle dba  48M Oct 26 13:00 /opt/oracle/GG/home/dirdat/reptgdb/MT000001316
-rw-r----- 1 oracle dba  48M Oct 26 14:23 /opt/oracle/GG/home/dirdat/reptgdb/MT000001317
-rw-r----- 1 oracle dba  48M Oct 29 06:12 /opt/oracle/GG/home/dirdat/reptgdb/MT000001318
-rw-r----- 1 oracle dba  48M Oct 29 06:15 /opt/oracle/GG/home/dirdat/reptgdb/MT000001319
-rw-r----- 1 oracle dba  48M Oct 29 08:07 /opt/oracle/GG/home/dirdat/reptgdb/MT000001320

Reason:

This is due the reason that on the source side we performed etrollover for the EXTRACT/Pump but not done on target due to which replicat still waiting on EOF on the current trail file(MT000001301) but pump already started writing to next trail file(MT000001302) on Target side due to etrollover issued on source so this is expected on target side

FIX:

1.       Check whether GG processed all the records in the current trail file (MT000001301)

GGSCI (trgprod.domain.com) 6> send REPTGDB status

Sending STATUS request to REPLICAT REPTGDB ...
  Current status: At EOF
  Sequence #: 1301
  RBA: 16434843
  0 records in current transaction
 (Or)
   send <rep_name> logend

2.       STOP replicat
3.       Alter replicat with new sequence number & RBA

GGSCI (trgprod.domain.com) 10> Alter REPLICAT REPTGDB extseqno 1302, extrba 00

2018-10-31 10:35:52  INFO    OGG-06594  Replicat REPTGDB has been altered through GGSCI. Even the start up position might be updated, duplicate suppression remains active in next startup. To override duplicate suppression, start REPTGDB with NOFILTERDUPTRANSACTIONS option.

REPLICAT altered.

4.       Start replicat

GGSCI (trgprod.domain.com) 11> start REPTGDB

Sending START request to MANAGER ...
REPLICAT REPTGDB starting

Now it started moving and processing records


Same on Oracle DOC:

WARNING OGG-01519 in Oracle GoldenGate Replicat (Doc ID 2383240.1)



Auto Scroll Stop Scroll