Today my GG Checkpoint table not updating and my Replicat NOT
moving at all but the lag is ZERO
I tried even bouncing the replicat but still NO Luck
DB Version: 12.1.0.2.0
GG Version: 12.2
GGSCI (trgprod.domain.com) 4> info all
Program
Status Group
Lag at Chkpt Time Since Chkpt
MANAGER RUNNING
REPLICAT RUNNING
REPSTDB 00:00:00 00:00:00
REPLICAT RUNNING
REPUPDB 00:00:00 00:00:01
REPLICAT RUNNING
REPTGDB 00:00:00
00:00:05
GGSCI (trgprod.domain.com) 5> info REPTGDB
REPLICAT REPTGDB Last Started
2018-10-24 14:35 Status RUNNING
Checkpoint Lag 00:00:00
(updated 00:00:13 ago)
Process
ID 9255
Log Read Checkpoint File
/opt/oracle/GG/home/dirdat/reptgdb/MT000001301
2018-10-11 06:58:48.821076 RBA 16434843
GGSCI (trgprod.domain.com) 6> send REPTGDB status
Sending STATUS request to REPLICAT REPTGDB ...
Current status: At EOF
Sequence #: 1301
RBA: 16434843
0 records in current transaction
From above send command we can see that the GG is at the end of
the trail file and processed all records in it
Ggserr.log:
2018-10-31 10:22:27 INFO OGG-00987
Oracle GoldenGate Command Interpreter for Oracle: GGSCI command (oracle):
info REPTGDB.
2018-10-31 10:22:49 WARNING
OGG-01519 Oracle GoldenGate Delivery for Oracle, REPTGDB.prm:
Waiting at EOF on input trail file
/opt/oracle/GG/home/dirdat/reptgdb/MT000001301, which is not marked as
complete; but succeeding trail file /opt/oracle/GG/home/dirdat/reptgdb/MT000001302
exists. If ALTER ETROLLOVER has been performed on source extract, ALTER
EXTSEQNO must be performed on each corresponding downstream reader.
Trails Files are Accumulating but GG not processing and moving
forward
trgprod:NOTSET:/home/oracle $ ls -lrth
/opt/oracle/GG/home/dirdat/reptgdb/MT*
-rw-r----- 1 oracle dba 16M Oct 20 11:16
/opt/oracle/GG/home/dirdat/reptgdb/MT000001301
-rw-r----- 1 oracle dba 48M Oct 22 08:25
/opt/oracle/GG/home/dirdat/reptgdb/MT000001302
-rw-r----- 1 oracle dba 48M Oct 22 08:33
/opt/oracle/GG/home/dirdat/reptgdb/MT000001303
-rw-r----- 1 oracle dba 48M Oct 22 08:57
/opt/oracle/GG/home/dirdat/reptgdb/MT000001304
-rw-r----- 1 oracle dba 48M Oct 22 15:34
/opt/oracle/GG/home/dirdat/reptgdb/MT000001305
-rw-r----- 1 oracle dba 48M Oct 23 07:33
/opt/oracle/GG/home/dirdat/reptgdb/MT000001306
-rw-r----- 1 oracle dba 48M Oct 23 15:30
/opt/oracle/GG/home/dirdat/reptgdb/MT000001307
-rw-r----- 1 oracle dba 48M Oct 24 07:13
/opt/oracle/GG/home/dirdat/reptgdb/MT000001308
-rw-r----- 1 oracle dba 48M Oct 24 13:43
/opt/oracle/GG/home/dirdat/reptgdb/MT000001309
-rw-r----- 1 oracle dba 915 Oct 24 14:30
/opt/oracle/GG/home/dirdat/reptgdb/MT000001311
-rw-r----- 1 oracle dba 6.7M Oct 24 14:30
/opt/oracle/GG/home/dirdat/reptgdb/MT000001310
-rw-r----- 1 oracle dba 48M Oct 25 08:12
/opt/oracle/GG/home/dirdat/reptgdb/MT000001312
-rw-r----- 1 oracle dba 48M Oct 25 16:27
/opt/oracle/GG/home/dirdat/reptgdb/MT000001313
-rw-r----- 1 oracle dba 48M Oct 26 07:00 /opt/oracle/GG/home/dirdat/reptgdb/MT000001314
-rw-r----- 1 oracle dba 48M Oct 26 10:13
/opt/oracle/GG/home/dirdat/reptgdb/MT000001315
-rw-r----- 1 oracle dba 48M Oct 26 13:00
/opt/oracle/GG/home/dirdat/reptgdb/MT000001316
-rw-r----- 1 oracle dba 48M Oct 26 14:23 /opt/oracle/GG/home/dirdat/reptgdb/MT000001317
-rw-r----- 1 oracle dba 48M Oct 29 06:12
/opt/oracle/GG/home/dirdat/reptgdb/MT000001318
-rw-r----- 1 oracle dba 48M Oct 29 06:15
/opt/oracle/GG/home/dirdat/reptgdb/MT000001319
-rw-r----- 1 oracle dba 48M Oct 29 08:07
/opt/oracle/GG/home/dirdat/reptgdb/MT000001320
Reason:
This is due the reason that on the source side we
performed etrollover for the EXTRACT/Pump but not done
on target due to which replicat still waiting on EOF on the current trail
file(MT000001301) but pump already started writing to next trail
file(MT000001302) on Target side due to etrollover issued on source so this is
expected on target side
FIX:
1. Check whether GG processed all the records in the current trail
file (MT000001301)
GGSCI (trgprod.domain.com) 6> send REPTGDB status
Sending STATUS request to REPLICAT REPTGDB ...
Current status: At EOF
Sequence #: 1301
RBA: 16434843
0 records in current transaction
(Or)
send <rep_name> logend
2. STOP replicat
3. Alter replicat with new sequence number & RBA
GGSCI (trgprod.domain.com) 10> Alter
REPLICAT REPTGDB extseqno 1302, extrba 00
2018-10-31 10:35:52 INFO OGG-06594
Replicat REPTGDB has been altered through GGSCI. Even the start up position
might be updated, duplicate suppression remains active in next startup. To
override duplicate suppression, start REPTGDB with NOFILTERDUPTRANSACTIONS
option.
REPLICAT altered.
4. Start replicat
GGSCI (trgprod.domain.com) 11> start REPTGDB
Sending START request to MANAGER ...
REPLICAT REPTGDB starting
Now it started moving and processing records
Same on Oracle DOC:
WARNING OGG-01519 in
Oracle GoldenGate Replicat (Doc ID 2383240.1)
