WARNING OGG-01519 in Oracle GoldenGate Replicat

Today my GG Checkpoint table not updating and my Replicat NOT moving at all but the lag is ZERO

I tried even bouncing the replicat but still NO Luck

DB Version:  12.1.0.2.0

GG Version:  12.2

GGSCI (trgprod.domain.com) 4> info all

Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     RUNNING

REPLICAT    RUNNING     REPSTDB    00:00:00      00:00:00

REPLICAT    RUNNING     REPUPDB    00:00:00      00:00:01

REPLICAT    RUNNING     REPTGDB      00:00:00      00:00:05

GGSCI (trgprod.domain.com) 5> info REPTGDB

REPLICAT   REPTGDB    Last Started 2018-10-24 14:35   Status RUNNING

Checkpoint Lag       00:00:00 (updated 00:00:13 ago)

Process ID           9255

Log Read Checkpoint  File /opt/oracle/GG/home/dirdat/reptgdb/MT000001301

                     2018-10-11 06:58:48.821076  RBA 16434843

GGSCI (trgprod.domain.com) 6> send REPTGDB status

Sending STATUS request to REPLICAT REPTGDB ...

  Current status: At EOF

  Sequence #: 1301

  RBA: 16434843

  0 records in current transaction

From above send command we can see that the GG is at the end of the trail file and processed all records in it

Ggserr.log:

2018-10-31 10:22:27  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (oracle): info REPTGDB.

2018-10-31 10:22:49  WARNING OGG-01519  Oracle GoldenGate Delivery for Oracle, REPTGDB.prm:  Waiting at EOF on input trail file /opt/oracle/GG/home/dirdat/reptgdb/MT000001301, which is not marked as complete; but succeeding trail file /opt/oracle/GG/home/dirdat/reptgdb/MT000001302 exists. If ALTER ETROLLOVER has been performed on source extract, ALTER EXTSEQNO must be performed on each corresponding downstream reader.

Trails Files are Accumulating but GG not processing and moving forward

trgprod:NOTSET:/home/oracle $ ls -lrth /opt/oracle/GG/home/dirdat/reptgdb/MT*

-rw-r----- 1 oracle dba  16M Oct 20 11:16 /opt/oracle/GG/home/dirdat/reptgdb/MT000001301

-rw-r----- 1 oracle dba  48M Oct 22 08:25 /opt/oracle/GG/home/dirdat/reptgdb/MT000001302

-rw-r----- 1 oracle dba  48M Oct 22 08:33 /opt/oracle/GG/home/dirdat/reptgdb/MT000001303

-rw-r----- 1 oracle dba  48M Oct 22 08:57 /opt/oracle/GG/home/dirdat/reptgdb/MT000001304

-rw-r----- 1 oracle dba  48M Oct 22 15:34 /opt/oracle/GG/home/dirdat/reptgdb/MT000001305

-rw-r----- 1 oracle dba  48M Oct 23 07:33 /opt/oracle/GG/home/dirdat/reptgdb/MT000001306

-rw-r----- 1 oracle dba  48M Oct 23 15:30 /opt/oracle/GG/home/dirdat/reptgdb/MT000001307

-rw-r----- 1 oracle dba  48M Oct 24 07:13 /opt/oracle/GG/home/dirdat/reptgdb/MT000001308

-rw-r----- 1 oracle dba  48M Oct 24 13:43 /opt/oracle/GG/home/dirdat/reptgdb/MT000001309

-rw-r----- 1 oracle dba  915 Oct 24 14:30 /opt/oracle/GG/home/dirdat/reptgdb/MT000001311

-rw-r----- 1 oracle dba 6.7M Oct 24 14:30 /opt/oracle/GG/home/dirdat/reptgdb/MT000001310

-rw-r----- 1 oracle dba  48M Oct 25 08:12 /opt/oracle/GG/home/dirdat/reptgdb/MT000001312

-rw-r----- 1 oracle dba  48M Oct 25 16:27 /opt/oracle/GG/home/dirdat/reptgdb/MT000001313

-rw-r----- 1 oracle dba  48M Oct 26 07:00 /opt/oracle/GG/home/dirdat/reptgdb/MT000001314

-rw-r----- 1 oracle dba  48M Oct 26 10:13 /opt/oracle/GG/home/dirdat/reptgdb/MT000001315

-rw-r----- 1 oracle dba  48M Oct 26 13:00 /opt/oracle/GG/home/dirdat/reptgdb/MT000001316

-rw-r----- 1 oracle dba  48M Oct 26 14:23 /opt/oracle/GG/home/dirdat/reptgdb/MT000001317

-rw-r----- 1 oracle dba  48M Oct 29 06:12 /opt/oracle/GG/home/dirdat/reptgdb/MT000001318

-rw-r----- 1 oracle dba  48M Oct 29 06:15 /opt/oracle/GG/home/dirdat/reptgdb/MT000001319

-rw-r----- 1 oracle dba  48M Oct 29 08:07 /opt/oracle/GG/home/dirdat/reptgdb/MT000001320

Reason:

This is due the reason that on the source side we performed etrollover for the EXTRACT/Pump but not done on target due to which replicat still waiting on EOF on the current trail file(MT000001301) but pump already started writing to next trail file(MT000001302) on Target side due to etrollover issued on source so this is expected on target side

FIX:

1.       Check whether GG processed all the records in the current trail file (MT000001301)

GGSCI (trgprod.domain.com) 6> send REPTGDB status

Sending STATUS request to REPLICAT REPTGDB ...

  Current status: At EOF

  Sequence #: 1301

  RBA: 16434843

  0 records in current transaction

 (Or)

   send <rep_name> logend

2.       STOP replicat

3.       Alter replicat with new sequence number & RBA

GGSCI (trgprod.domain.com) 10> Alter REPLICAT REPTGDB extseqno 1302, extrba 00

2018-10-31 10:35:52  INFO    OGG-06594  Replicat REPTGDB has been altered through GGSCI. Even the start up position might be updated, duplicate suppression remains active in next startup. To override duplicate suppression, start REPTGDB with NOFILTERDUPTRANSACTIONS option.

REPLICAT altered.

4.       Start replicat

GGSCI (trgprod.domain.com) 11> start REPTGDB

Sending START request to MANAGER ...

REPLICAT REPTGDB starting

Now it started moving and processing records

Same on Oracle DOC:

WARNING OGG-01519 in Oracle GoldenGate Replicat (Doc ID 2383240.1)