Friday, January 30, 2015

OGG-01028 unexpected LOB record or record fragment

My replicat REP1 abended with the below error for SCHEMA.TEST table

ERROR   OGG-01028  unexpected LOB record or record fragment in /gg/dirdat/VC/VC000079, rba 1367.

CauseReplicat altered to start on trail where the first record is a LOB and NOT the base record.

Solution:  Start the Replicat Manually from the beginning of the LOB record.

Start logdump utility to find out the root cause

 [oracle@oracledev11 gg]$ ./logdump

Oracle GoldenGate Log File Dump Utility for Oracle
Version 11.2.1.0.14 17547423 OGGCORE_11.2.1.0.0OGGBP_PLATFORMS_131022.0605

Copyright (C) 1995, 2013, Oracle and/or its affiliates. All rights reserved.



Logdump 411 >ghdr on
Logdump 412 >detail on
Logdump 413 >open /gg/dirdat/VC/VC000079
Current LogTrail is /gg/dirdat/VC/VC000079
Logdump 414 >pos o
Error: Invalid file position (O)
Logdump 415 >DETAIL DATA
Logdump 416 >pos 0
Reading forward from RBA 0
Logdump 417 >n

2015/01/25 17:52:55.283.720 FileHeader           Len  1359 RBA 0
Name: *FileHeader*
 3000 01a2 3000 0008 4747 0d0a 544c 0a0d 3100 0002 | 0...0...GG..TL..1...
 0003 3200 0004 2000 0000 3300 0008 02f2 33b1 25be | ..2... ...3.....3.%.
 3008 3400 001c 001a 7572 693a 736c 3733 7670 7064 | 0.4.....uri:oraclepro
 6270 3030 393a 3a67 673a 686f 6d65 3600 001d 001b | d009::gg:home6.....
 2f67 672f 4747 3131 2f64 6972 6461 742f 5643 2f56 | /gg/dirdat/VC/V
 4330 3030 3037 3937 0000 0101 3800 0004 0000 004f | C0000797....8......O
 3900 0008 0000 0000 05f5 db9a 3a00 0081 0b31 3038 | 9...........:....108

Logdump 418 >n
___________________________________________________________________
Hdr-Ind    :     E  (x45)     Partition  :     .  (x04)
UndoFlag   :     .  (x00)     BeforeAfter:     A  (x41)
RecLength  :  2020  (x07e4)   IO Time    : 2015/01/25 17:52:52.996.472
IOType     :   116  (x74)     OrigNode   :   255  (xff)
TransInd   :     .  (x01)     FormatType :     R  (x52)
SyskeyLen  :     0  (x00)     Incomplete :     .  (x00)
AuditRBA   :      25679       AuditPos   : 159347796
Continued  :     Y  (x01)     RecCount   :     3  (x03)

2015/01/25 17:52:52.996.472 LargeObject          Len  2020 RBA 1367
Name: SCHEMA.MYTEST
After  Image:                                             Partition 4      m
 0000 0003 0000 0005 0000 0002 0000 07d0 0000 07d0 | ....................
 204d 6f62 696c 652f 3131 4235 3534 6120 5361 6661 |  Mobile/3222F Safa
 7269 2f39 3533 372e 3533 222c 2254 484d 5f62 726f | ri/1234.53","THM_bro
 7773 6572 5f73 7472 696e 675f 6861 7368 3a34 6563 | wser_string_hash:4ec
 6134 3532 3034 3731 3166 3265 3634 3764 3030 3161 | xxxxxxxxxxxxxxxxxxx
 3133 3438 3734 3632 3322 2c22 5448 4d5f 6373 735f | 12344322","THM_css_
 696d 6167 655f 6c6f 6164 6564 3a79 6573 222c 2254 | image_loaded:yes","T
Column 3, LOB fragment 2 of 5
Size          2000 (x07d0)
Offset        2000 (x07d0)

Logdump 419 >n
___________________________________________________________________
Hdr-Ind    :     E  (x45)     Partition  :     .  (x04)
UndoFlag   :     .  (x00)     BeforeAfter:     A  (x41)
RecLength  :    86  (x0056)   IO Time    : 2015/01/25 17:52:52.996.472
IOType     :   116  (x74)     OrigNode   :   255  (xff)
TransInd   :     .  (x01)     FormatType :     R  (x52)
SyskeyLen  :     0  (x00)     Incomplete :     .  (x00)
AuditRBA   :      25679       AuditPos   : 159347796
Continued  :     Y  (x01)     RecCount   :     4  (x04)

2015/01/25 17:52:52.996.472 LargeObject          Len    86 RBA 3463
Name: SCHEMA.MYTEST
After  Image:                                             Partition 4      m
 0000 0003 0000 0005 0000 0003 0000 0fa0 0000 0042 | ...................B
 3022 2c22 5448 4d5f 7072 6f66 696c 6564 5f64 6f6d | 0","THM_profiled_dom
 6169 6e3a 7365 6375 7265 2e63 6865 636b 6f75 742e | ain:xxxxx.xxxx.
 7669 7361 2e63 6f6d 222c 2254 484d 5f70 726f 6669 | corp.com","THM_profi
 6c65 645f 646f                                    | led_do
Column 3, LOB fragment 3 of 5
Size            66 (x0042)
Offset        4000 (x0fa0)

………………..

By reading the above current trail file it is clear that it is trying to apply a LOB segment (RBA 1367) which is fragmented meaning(applying 2 of 5) it is not starting from 1 which is missing in 'VC000079' trail file



Lets go to previous trail file(VC000078) and search for the LOB:

Logdump 439 >DETAIL DATA
Logdump 440 >GHDR ON
Logdump 441 >detail on
Logdump 442 >open /gg/dirdat/VC/VC000078    (going one trail file back)
Current LogTrail is /gg/dirdat/VC/VC000078
Logdump 443 >pos eof                             (going End of file)
Reading forward from RBA 99998989
Logdump 444 >pos reverse                     (Reading from reverse)
Reading in reverse from RBA 99998989
Logdump 445 >n
___________________________________________________________________
Hdr-Ind    :     E  (x45)     Partition  :     .  (x04)
UndoFlag   :     .  (x00)     BeforeAfter:     A  (x41)
RecLength  :  2020  (x07e4)   IO Time    : 2015/01/25 17:52:52.993.564
IOType     :   116  (x74)     OrigNode   :   255  (xff)
TransInd   :     .  (x01)     FormatType :     R  (x52)
SyskeyLen  :     0  (x00)     Incomplete :     .  (x00)
AuditRBA   :      25679       AuditPos   : 159347796
Continued  :     Y  (x01)     RecCount   :     2  (x02)

2015/01/25 17:52:52.993.564 LargeObject          Len  2020 RBA 99996893
Name: SCHEMA.MYTEST
After  Image:                                             Partition 4      m
 0000 0003 0000 0005 0000 0001 0000 0000 0000 07d0 | ....................
 7b22 616d 6d56 646e 6153 6572 7669 6365 5265 7175 | {"oracleserviceRequ
 6573 7422 3a7b 2250 726f 6475 6374 496e 766f 6b65 | est":{"ProductInvoke
 7254 7970 6522 3a22 565f 4d45 222c 2243 6f6e 7465 | rType":"XXXX","Conte
 7874 5479 7065 223a 2250 7572 6368 6173 6549 6e74 | xtType":"PurchaseInt
 656e 7422 2c22 5265 7175 6573 7449 6422 3a22 3331 | ent","RequestId":"31
 6136 3032 3566 2d37 3664 622d 3431 6133 2d62 3338 | a1234f-76db-xxxx-b38
Column 3, LOB fragment 1 of 5
Size          2000 (x07d0)
Offset           0 (x0000)

Logdump 446 >n
___________________________________________________________________
Hdr-Ind    :     E  (x45)     Partition  :     .  (x04)
UndoFlag   :     .  (x00)     BeforeAfter:     A  (x41)
RecLength  :   116  (x0074)   IO Time    : 2015/01/25 17:52:52.995.853
IOType     :     5  (x05)     OrigNode   :   255  (xff)
TransInd   :     .  (x00)     FormatType :     R  (x52)
SyskeyLen  :     0  (x00)     Incomplete :     .  (x00)
AuditRBA   :      25679       AuditPos   : 159347796
Continued  :     Y  (x01)     RecCount   :     1  (x01)

2015/01/25 17:52:52.995.853 Insert               Len   116 RBA 99996643       ß LOB starts from here
Name: SCHEMA.MYTEST
After  Image:                                             Partition 4   G  b
 0000 000c 0000 0008 3833 3731 3035 3036 0001 0028 | ........83710506...(
 0000 0024 3965 6463 3564 6530 2d30 6665 612d 3431 | ...$gddgg5w4-0fea-41
 3361 2d61 3938 332d 6666 3362 3834 6465 6561 3039 | 3a-a324-ff3b84feea09
 0002 0008 0000 0004 5644 4e41 0004 0005 0000 0001 | ........BSDA........
 3500 0500 1f00 0032 3031 352d 3031 2d32 353a 3137 | 5......2015-01-25:17
 3a35 323a 3533 2e37 3031 3030 3030 3030           | :52:53.701000000
Column     0 (x0000), Len    12 (x000c)
Column     1 (x0001), Len    40 (x0028)
Column     2 (x0002), Len     8 (x0008)
Column     4 (x0004), Len     5 (x0005)
Column     5 (x0005), Len    31 (x001f)

Logdump 447 >n
___________________________________________________________________
Hdr-Ind    :     E  (x45)     Partition  :     .  (x04)
UndoFlag   :     .  (x00)     BeforeAfter:     A  (x41)
RecLength  :  1805  (x070d)   IO Time    : 2015/01/25 17:52:52.995.853
IOType     :     5  (x05)     OrigNode   :   255  (xff)
TransInd   :     .  (x03)     FormatType :     R  (x52)
SyskeyLen  :     0  (x00)     Incomplete :     .  (x00)
AuditRBA   :      25466       AuditPos   : 55964348
Continued  :     N  (x00)     RecCount   :     1  (x01)

2015/01/25 17:52:52.995.853 Insert               Len  1805 RBA 99994708
Name: SCHEMA2.LOCATION
After  Image:                                             Partition 4   G  s
 0000 000c 0000 0008 3632 3839 3432 3433 0001 0041 | ........62894243...A
 0000 003d 6874 7470 733a 2f2f 766d 6564 666d 2e76 | ...=https://oracle.dom
 6973 612e 636f 6d3a 3834 3433 2f64 666d 7365 7276 | ain.com:8443/oracleserv
 6963 6573 2f76 312f 636f 6e73 756d 6572 2f64 6563 | ices/v1/consumer/dec
 6973 696f 6e00 0200 2f00 0000 2b31 3432 3232 3038 | ision.../...+12345678
 3230 335f 3536 375f 3532 335f 6c37 3370 3132 336d | 203_567_523_l73p123m
 5f43 4845 434b 4f55 542d 5749 4447 4554 0003 000e | _xxxxxx....
Column     0 (x0000), Len    12 (x000c)
Column     1 (x0001), Len    65 (x0041)
Column     2 (x0002), Len    47 (x002f)
Column     3 (x0003), Len    14 (x000e)
Column     4 (x0004), Len     5 (x0005)
Column     5 (x0005), Len   184 (x00b8)
Column     6 (x0006), Len     4 (x0004)
Column     7 (x0007), Len     6 (x0006)
Column     8 (x0008), Len  1295 (x050f)
Column     9 (x0009), Len    31 (x001f)
Column    10 (x000a), Len     8 (x0008)
Column    11 (x000b), Len     4 (x0004)
Column    12 (x000c), Len     8 (x0008)
Column    13 (x000d), Len    31 (x001f)
Column    14 (x000e), Len    31 (x001f)


Here we found the LOB segment in '78' trail file so lets start the replicat using the above highlighted rba number:

Syntax:   ggsci> alter <replicat>, extseqno ### ,extrba <RBA of record from above output>
  
ggsci> alter REP1, extseqno 78 ,extrba 99996643

ggsci> start REP1

For more info:
OGG Replicat Abends On LOB Data. OGG Error: OGG-01028: Unexpected LOB Record Or Record Fragment In ... (Trail File) (Doc ID 1903819.1)

Auto Scroll Stop Scroll