Saturday, March 9, 2019

ERROR OGG-01332 Oracle GoldenGate Collector for Oracle



Source side :
DB : 12.2
OGG : 18.1
GG Mode: Integrated Extract

Target side :

DB: 12.2
OGG: 12.2
GG Mode: Integrated Replicat

After GG upgrade on source side when trying to start the Replicat on target side we are getting below error

$ tail -f /goldengate/ggserr.log

2019-01-23 14:37:47  ERROR   OGG-01332  Oracle GoldenGate Collector for Oracle:  File /goldengate/dirdat/mydev/mydev/HP000000244, with compatibility level 6, is not compatible with the current software version's compatibility level of 5. Modify the file writer's parameter file to generate the appropriate format using the FORMAT LEVEL 5 option.
2019-01-23 14:37:47  ERROR   OGG-01668  Oracle GoldenGate Collector for Oracle:  PROCESS ABENDING.

Solution :

When we upgrade GG on source side we do an alter to pump to generate a new trail file on the Target machine so we need to start the replicat also by altering to the same SEQNO and RBANO if we not do alter and just start with same old trail file then we encounter the error above

To fix the issue alter the replicat (On target side) also along with extract and pump (on Source side)

GGSCI (myoradev.domain.com) 10> alter RDBDEV1 extseqno 245 extrba 0

2019-01-23 14:40:18  INFO    OGG-06594  Replicat RDBDEV1 has been altered through GGSCI. Even the start up position might be updated, duplicate suppression remains active in next startup. To override duplicate suppression, start RDBDEV1 with NOFILTERDUPTRANSACTIONS option.

REPLICAT (Integrated) altered.


GGSCI (myoradev.domain.com) 11> info RDBDEV1

REPLICAT   RDBDEV1  Initialized   2019-01-23 14:40   Status STOPPED
INTEGRATED
Checkpoint Lag       00:00:00 (updated 00:00:09 ago)
Log Read Checkpoint  File /goldengate/dirdat/mydev/mydev/HP000245
                     First Record  RBA 0


GGSCI (myoradev.domain.com) 12> start RDBDEV1

Sending START request to MANAGER ...
REPLICAT RDBDEV1 starting

ggserr.log

2019-01-23 14:40:18  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (oracle): alter RDBDEV1 extseqno 245 extrba 0.
2019-01-23 14:40:18  INFO    OGG-06594  Oracle GoldenGate Command Interpreter for Oracle:  Replicat RDBDEV1 has been altered through GGSCI. Even the start up position might be updated, duplicate suppression remains active in next startup. To override duplicate suppression, start RDBDEV1 with NOFILTERDUPTRANSACTIONS option.

2019-01-23 14:40:27  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (oracle): info RDBDEV1.
2019-01-23 14:40:33  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (oracle): start RDBDEV1.
2019-01-23 14:40:33  INFO    OGG-00963  Oracle GoldenGate Manager for Oracle, mgr.prm:  Command received from GGSCI on host 10.10.33.17:56242 (START REPLICAT RDBDEV1 ).
2019-01-23 14:40:33  INFO    OGG-00960  Oracle GoldenGate Manager for Oracle, mgr.prm:  Access granted (rule #5).
2019-01-23 14:40:33  INFO    OGG-00975  Oracle GoldenGate Manager for Oracle, mgr.prm:  REPLICAT RDBDEV1 starting.
2019-01-23 14:40:33  INFO    OGG-00995  Oracle GoldenGate Delivery for Oracle, RDBDEV1.prm:  REPLICAT RDBDEV1 starting.
2019-01-23 14:40:33  INFO    OGG-03059  Oracle GoldenGate Delivery for Oracle, RDBDEV1.prm:  Operating system character set identified as UTF-8.
2019-01-23 14:40:33  INFO    OGG-02695  Oracle GoldenGate Delivery for Oracle, RDBDEV1.prm:  ANSI SQL parameter syntax is used for parameter parsing.
2019-01-23 14:40:33  INFO    OGG-02095  Oracle GoldenGate Delivery for Oracle, RDBDEV1.prm:  Successfully set environment variable ORACLE_HOME=/opt/oracle/product/12.1.0.2.64.
2019-01-23 14:40:33  INFO    OGG-02095  Oracle GoldenGate Delivery for Oracle, RDBDEV1.prm:  Successfully set environment variable ORACLE_SID=mydev.
2019-01-23 14:40:34  INFO    OGG-02095  Oracle GoldenGate Delivery for Oracle, RDBDEV1.prm:  Successfully set environment variable ORACLE_HOME=/opt/oracle/product/12.1.0.2.64.
2019-01-23 14:40:34  INFO    OGG-02095  Oracle GoldenGate Delivery for Oracle, RDBDEV1.prm:  Successfully set environment variable ORACLE_SID=mydev.
2019-01-23 14:40:34  INFO    OGG-01815  Oracle GoldenGate Delivery for Oracle, RDBDEV1.prm:  Virtual Memory Facilities for: COM
    anon alloc: mmap(MAP_ANON)  anon free: munmap
    file alloc: mmap(MAP_SHARED)  file free: munmap
    target directories:
    /goldengate/dirtmp.
2019-01-23 14:40:34  INFO    OGG-02526  Oracle GoldenGate Delivery for Oracle, RDBDEV1.prm:  Parameter FILTERDUPTRANSACTIONS is ignored by Integrated Replicat.
2019-01-23 14:40:34  INFO    OGG-02545  Oracle GoldenGate Delivery for Oracle, RDBDEV1.prm:  Parameter GROUPTRANSOPS is ignored by Integrated Replicat when parallelism is greater than 1.
2019-01-23 14:40:34  INFO    OGG-02527  Oracle GoldenGate Delivery for Oracle, RDBDEV1.prm:  Integrated Replicat does not populate a trace table.
2019-01-23 14:40:35  INFO    OGG-02530  Oracle GoldenGate Delivery for Oracle, RDBDEV1.prm:  Integrated replicat successfully attached to inbound server OGG$RDBDEV1.
2019-01-23 14:40:35  INFO    OGG-00996  Oracle GoldenGate Delivery for Oracle, RDBDEV1.prm:  REPLICAT RDBDEV1 started.



Check Similar issue :


Replicat Abends With ERROR OGG-01332 With Compatibility Level 6, Is Not Compatible With The Current software version's compatibility level of 5. (Doc ID 2385520.1)



OGG-01416 Oracle GoldenGate Capture for Oracle


After Upgrading My Oracle Goldengate from 12.2. to 18.1 version extracts are unable to start with current trail file and fails with below error

Error:

tail -f $GG_HOME/ggserr.log

2019-01-22T18:25:28.710-0500  INFO    OGG-01478  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  Output file /goldengate/dirdat/ORAQA/MYQADB/hp is using format RELEASE 12.3/18.1.
2019-01-22T18:25:28.715-0500  ERROR   OGG-01416  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  File /goldengate/dirdat/ORAQA/MYQADB/hp000000141, with format RELEASE 12.2, does not match current format specification of RELEASE 12.3/18.1. Modify the parameter file to specify format RELEASE 12.2 or issue ETROLLOVER prior to restart.
2019-01-22T18:25:28.715-0500  ERROR   OGG-01668  Oracle GoldenGate Capture for Oracle, eoraqa.prm:  PROCESS ABENDING.

Solution:

Since I’m using same existing trail file (seq# 144)  to start after upgrading my GG due to the version difference it is failing so We need to rollover to next trail file and start with next trail file seq number

Login to ggsci and do ETROLLOVER

GGSCI (oraqa.domain.com) 43> alter EORAQA etrollover

2019-01-23 14:35:57  INFO    OGG-01520  Rollover performed.  For each affected output trail of Version 10 or higher format, after starting the source extract, issue ALTER EXTSEQNO for that trail's reader (either pump EXTRACT or REPLICAT) to move the reader's scan to the new trail file;  it will not happen automatically.
EXTRACT altered.


GGSCI (oraqa.domain.com) 44> info EORAQA showch

EXTRACT    EORAQA  Initialized   2019-01-23 14:34   Status ABENDED
Checkpoint Lag       01:10:59 (updated 00:00:12 ago)
Log Read Checkpoint  Oracle Integrated Redo Logs
                     2019-01-23 13:24:58
                     SCN 95.1370001303 (409391894423)


Current Checkpoint Detail:

Read Checkpoint #1

  Oracle Integrated Redo Log

  Startup Checkpoint (starting position in the data source):
    Timestamp: 2018-02-28 12:15:17.000000
    SCN: Not available

  Recovery Checkpoint (position of oldest unprocessed transaction in the data source):
    Timestamp: 2019-01-23 13:24:58.000000
    SCN: 95.1370001302 (409391894422)

  Current Checkpoint (position of last record read in the data source):
    Timestamp: 2019-01-23 13:24:58.000000
    SCN: 95.1370001303 (409391894423)

  BR Previous Recovery Checkpoint:
    Timestamp: 2019-01-22 18:39:59.544161
    SCN: Not available

  BR Begin Recovery Checkpoint:
    Timestamp: 2019-01-23 10:41:39.000000
    SCN: 95.1365863434 (409387756554)

  BR End Recovery Checkpoint:
    Timestamp: 2019-01-23 10:41:39.000000
    SCN: 95.1365863434 (409387756554)

Write Checkpoint #1

  GGS Log Trail

  Current Checkpoint (current write position):
    Sequence #: 145
    RBA: 0
    Timestamp: 2019-01-23 13:25:01.767828
    Extract Trail: /goldengate/dirdat/ORAQA/MYQADB/hp
    Seqno Length: 9
    Flip Seqno Length: No
    Trail Type: EXTTRAIL

Header:
  Version = 2
  Record Source = U
  Type = 13
  # Input Checkpoints = 1
  # Output Checkpoints = 1

File Information:
  Block Size = 2048
  Max Blocks = 100
  Record Length = 2048
  Current Offset = 0

Configuration:
  Data Source = 3
  Transaction Integrity = 1
  Task Type = 0

Status:
  Start Time = 2019-01-23 14:34:23
  Last Update Time = 2019-01-23 14:35:57
  Stop Status = A
  Last Result = 520



GGSCI (oraqa.domain.com) 45> start EORAQA

Sending START request to MANAGER ...
EXTRACT EORAQA starting

GGSCI (oraqa.domain.com) 47> info EORAQA

EXTRACT    EORAQA  Last Started 2019-01-23 14:36   Status RUNNING
Checkpoint Lag       00:00:09 (updated 00:00:01 ago)
Process ID           2686
Log Read Checkpoint  Oracle Integrated Redo Logs
                     2019-01-23 14:36:27
                     SCN 95.1370008158 (409391901278)


ggserr.log

2019-01-23T14:35:57.135-0500  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (oracle): alter EORAQA etrollover.
2019-01-23T14:35:57.152-0500  INFO    OGG-01520  Oracle GoldenGate Command Interpreter for Oracle:  Rollover performed.  For each affected output trail of Version 10 or higher format, after starting the source extract, issue ALTER EXTSEQNO for that trail's reader (either pump EXTRACT or REPLICAT) to move the reader's scan to the new trail file;  it will not happen automatically.
2019-01-23T14:36:09.856-0500  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (oracle): info EORAQA showch.
2019-01-23T14:36:19.984-0500  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (oracle): start EORAQA.
2019-01-23T14:36:19.985-0500  INFO    OGG-00963  Oracle GoldenGate Manager for Oracle, mgr.prm:  Command received from GGSCI on host [10.123.00.25]:11140 (START EXTRACT EORAQA ).
2019-01-23T14:36:19.992-0500  INFO    OGG-00975  Oracle GoldenGate Manager for Oracle, mgr.prm:  EXTRACT EORAQA starting.
2019-01-23T14:36:20.130-0500  INFO    OGG-00992  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  EXTRACT EORAQA starting.
2019-01-23T14:36:20.131-0500  INFO    OGG-03059  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  Operating system character set identified as UTF-8.
2019-01-23T14:36:20.131-0500  INFO    OGG-02695  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  ANSI SQL parameter syntax is used for parameter parsing.
2019-01-23T14:36:20.131-0500  INFO    OGG-02095  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  Successfully set environment variable ORACLE_HOME=/opt/oracle/product/12.1.0.2.64.
2019-01-23T14:36:20.132-0500  INFO    OGG-02095  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  Successfully set environment variable ORACLE_SID=ORAQA.
2019-01-23T14:36:20.169-0500  INFO    OGG-01360  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  EXTRACT is running in Integrated mode.
2019-01-23T14:36:21.402-0500  INFO    OGG-01635  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  BOUNDED RECOVERY: reset to initial or altered checkpoint.
2019-01-23T14:36:21.411-0500  INFO    OGG-01815  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  Virtual Memory Facilities for: BR
                                  anon alloc: mmap(MAP_ANON)  anon free: munmap
                                  file alloc: mmap(MAP_SHARED)  file free: munmap
                                  target directories:
                                  /goldengate/BR/EORAQA.
2019-01-23T14:36:21.421-0500  INFO    OGG-01851  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  filecaching started: thread ID: 139675624793856.
2019-01-23T14:36:21.421-0500  INFO    OGG-01815  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  Virtual Memory Facilities for: COM
                                  anon alloc: mmap(MAP_ANON)  anon free: munmap
                                  file alloc: mmap(MAP_SHARED)  file free: munmap
                                  target directories:
                                  $GG_HOME/dirtmp.
2019-01-23T14:36:21.615-0500  INFO    OGG-06604  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  Database ORAQA CPU info: CPU Count 80, CPU Core Count 80, CPU Socket Count 8.
2019-01-23T14:36:22.309-0500  WARNING OGG-02045  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  Database does not have streams_pool_size initialization parameter configured.
2019-01-23T14:36:22.375-0500  INFO    OGG-02248  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  Logmining server DDL filtering enabled.
2019-01-23T14:36:23.643-0500  INFO    OGG-02068  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  Integrated capture successfully attached to logmining server OGG$CAP_EORAQA using OGGCapture API.
2019-01-23T14:36:23.646-0500  INFO    OGG-02089  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  Source redo compatibility version is: 12.1.0.2.0.
2019-01-23T14:36:23.646-0500  INFO    OGG-02086  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  Integrated Dictionary will be used.
2019-01-23T14:36:23.720-0500  WARNING OGG-02905  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  Replication of OID column in object tables may diverge.
2019-01-23T14:36:26.882-0500  INFO    OGG-00993  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  EXTRACT EORAQA started.
2019-01-23T14:36:26.882-0500  INFO    OGG-01052  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  No recovery is required for target file /goldengate/dirdat/ORAQA/MYQADB/hp000000145, at RBA 0 (file not opened).
2019-01-23T14:36:26.883-0500  INFO    OGG-01478  Oracle GoldenGate Capture for Oracle, EORAQA.prm:  Output file /goldengate/dirdat/ORAQA/MYQADB/hp is using format RELEASE 12.2.

Now my extract started fine with new sequence number



Sunday, February 3, 2019

WARNING OGG-01932 Datastore already exists.


After Server Reboot where OGG is running my goldengate manager is unable to start and getting below error

GGSCI (oradev.domain.com) 1> info all

Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     STOPPED
JAGENT      STOPPED
EXTRACT     RUNNING     EXTDEVQ1    00:00:02      00:00:07
EXTRACT     RUNNING     EXTDEVQ1    00:00:04      00:00:09
EXTRACT     RUNNING     EXTDEVQ1    00:00:01      00:00:09
EXTRACT     RUNNING     EXTDEVQ1    00:00:02      00:00:03
EXTRACT     RUNNING     PXTDEVQ1    00:00:00      00:00:08
EXTRACT     RUNNING     PXTDEVQ1    00:00:00      00:00:03
EXTRACT     RUNNING     PXTDEVQ1    00:00:00      00:00:05
EXTRACT     RUNNING     PXTDEVQ1    00:00:00      00:00:02


GGSCI (oradev.domain.com) 1> start mgr
Manager started.
2019-01-17 10:37:29  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (oracle): start mgr.
2019-01-17 10:37:29  WARNING OGG-01877  Oracle GoldenGate Manager for Oracle, mgr.prm:  Missing explicit accessrule for server collector.
2019-01-17 10:37:29  INFO    OGG-00960  Oracle GoldenGate Manager for Oracle, mgr.prm:  Access granted (rule #7).
2019-01-17 10:37:29  INFO    OGG-00983  Oracle GoldenGate Manager for Oracle, mgr.prm:  Manager started (port 7809).
2019-01-17 10:37:29  WARNING OGG-01934  Oracle GoldenGate Manager for Oracle, mgr.prm:  Datastore repair failed.
2019-01-17 10:37:29  WARNING OGG-06530  Oracle GoldenGate Manager for Oracle, mgr.prm:  Berkeley Database encountered a Critical error.
2019-01-17 10:37:29  WARNING OGG-00543  Oracle GoldenGate Manager for Oracle, mgr.prm:  Unexpected threading library failure. Error code 16 (Device or resource busy).


GGSCI (oradev.domain.com) 13> delete datastore
Are you sure you want to delete the datastore? y
BDB0118 shmat: id 1679097930: unable to attach to shared system memory region: Invalid argument
BDB0118 shmat: id 1679097930: unable to attach to shared system memory region: Invalid argument
2019-01-17T15:37:57Z  INFO    OGG-06492  Datastore deleted
GGSCI (oradev.domain.com) 14>

GGSCI (oradev.domain.com) 14> info datastore
2019-01-17T15:38:03Z  WARNING OGG-06307  Datastore does not exist.

GGSCI (oradev.domain.com) 15> Create datastore mmap
2019-01-17T15:38:13Z  WARNING OGG-01933  Datastore create failed.

GGSCI (oradev.domain.com) 18> Create datastore
2019-01-17T15:39:44Z  WARNING OGG-01933  Datastore XTeate failed.

oradev:NOTSET:/home/oracle $ cd /goldengate/home/
oradev:NOTSET:/goldengate/home $ cd dirbdb
-bash: cd: dirbdb: No such file or directory

Looks like 'dirdbd' Directory is missing or Lost

oradev:NOTSET:/goldengate/home $ mkdir dirbdb

GGSCI (oradev.domain.com) 1> info all

Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     STOPPED
JAGENT      STOPPED
EXTRACT     STOPPED     EXTDEVQ1    00:00:46      00:17:59
EXTRACT     STOPPED     EXTDEVQ1    00:00:43      00:17:59
EXTRACT     STOPPED     EXTDEVQ1    00:00:44      00:17:58
EXTRACT     ABENDED     EXTDEVQ1    00:00:02      00:18:39
EXTRACT     STOPPED     PXTDEVQ1    00:00:00      00:17:57
EXTRACT     STOPPED     PXTDEVQ1    00:00:00      00:17:56
EXTRACT     STOPPED     PXTDEVQ1    00:00:00      00:17:55
EXTRACT     STOPPED     PXTDEVQ1    00:00:00      00:17:55


GGSCI (oradev.domain.com) 2> Create datastore mmap
2019-01-17T15:55:06Z  WARNING OGG-01932  Datastore already exists.

GGSCI (oradev.domain.com) 3> info datastore
2019-01-17T15:55:14Z  INFO    OGG-06308  Datastore uses memory mapped (MMAP) environment files.

GGSCI (oradev.domain.com) 5> info all

Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     STOPPED
JAGENT      STOPPED
EXTRACT     STOPPED     EXTDEVQ1    00:00:46      00:18:40
EXTRACT     STOPPED     EXTDEVQ1    00:00:43      00:18:39
EXTRACT     STOPPED     EXTDEVQ1    00:00:44      00:18:39
EXTRACT     ABENDED     EXTDEVQ1    00:00:02      00:19:20
EXTRACT     STOPPED     PXTDEVQ1    00:00:00      00:18:38
EXTRACT     STOPPED     PXTDEVQ1    00:00:00      00:18:37
EXTRACT     STOPPED     PXTDEVQ1    00:00:00      00:18:36
EXTRACT     STOPPED     PXTDEVQ1    00:00:00      00:18:35

GGSCI (oradev.domain.com) 6> start mgr
Manager started.

GGSCI (oradev.domain.com) 7> info mgr

Manager is running (IP port oradev.domain.com.7809, Process ID 139824).



Auto Scroll Stop Scroll