golden gate integrated replicat failed after shut abort
From: Kumar Madduri <ksmadduri_at_gmail.com>
Date: Thu, 3 Nov 2016 11:32:08 -0700
Message-ID: <CAHDOOG6gSBzQLJD_BqSJai8ypoTDQBvPzmB99ZXUvMFtTnPxNw_at_mail.gmail.com>
Golden Gate 12c version running against a 12c database. Integrated extract and replicat were setup with a few tables. All was well. The target database was shut abort. After the outage, replicat stopped working. My understanding was that the remote trail files were corrupt and I tried a few t hings (like skip transaction, trying to move the rba so that replicat would start from that point, removed the dirdat directory aand create an empty one hoping that the right ones would be copied over ). But replicat kept failing.
SR was of not much use.
Then I deleted the replicat and created another with the same name. Before that there were a couple of tables that were failing with this error 2016-11-02 13:30:10 WARNING OGG-02544 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: Unhandled error (ORA-26787: The row with key ("TASK_ID") = (23249) does not exist in table SUBSERA.XXDL_SUBS_TASK_ITEMS ORA-01403: no data found) while processing the record at SEQNO 4, RBA 6742 in Integrated mode. REPLICAT will retry in Direct mode. 2016-11-02 13:30:10 WARNING OGG-02760 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: ASSUMETARGETDEFS is ignored because trail file ./dirdat/rt000000004 contains table definitions. 2016-11-02 13:30:10 INFO OGG-03506 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: The source database character set, as determined from the trail file, is we8iso8859p15.
2016-11-02 13:30:10 INFO OGG-06505 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: MAP resolved (entry APPS.XXDL_SUBS_TRANS_LINES): MAP
"APPS"."XXDL_SUBS_TRANS_LINES", TARGET SUBSERA.XXDL_SUBS_TRANS_LINES.
2016-11-02 13:30:11 INFO OGG-02756 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: The definition for table APPS.XXDL_SUBS_TRANS_LINES is obtained from the trail file.
2016-11-02 13:30:11 INFO OGG-06511 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: Using following columns in default map by name: LINE_ID, TRANSACTION_ID, TRANSACTION_TYPE, AMENDMENT_NUMBER, POP_START_DATE,
2016-11-02 13:30:11 INFO OGG-03010 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: Performing implicit conversion of column data from character set we8iso8859p15 to UTF-8.
2016-11-02 13:30:11 INFO OGG-06505 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: MAP resolved (entry APPS.XXDL_SUBS_TASK_ITEMS): MAP
"APPS"."XXDL_SUBS_TASK_ITEMS", TARGET SUBSERA.XXDL_SUBS_TASK_ITEMS.
2016-11-02 13:30:12 INFO OGG-02756 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: The definition for table APPS.XXDL_SUBS_TASK_ITEMS is obtained from the trail file.
2016-11-02 13:30:12 INFO OGG-06511 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: Using following columns in default map by name: TASK_ID, LINE_ID, TRANSACTION_ID, TASK_TYPE, STATUS, ASSIGNEE, ASSIGNED_ON, COMPLETED_DATE, COMMENTS, PERSON_ID, CREATED_BY. 2016-11-02 13:30:12 INFO OGG-06510 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: Using the following key columns for target table SUBSERA.XXDL_SUBS_TASK_ITEMS: TASK_ID.
2016-11-02 13:30:12 WARNING OGG-01154 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: SQL error 1 mapping APPS.XXDL_SUBS_TASK_ITEMS to SUBSERA.XXDL_SUBS_TASK_ITEMS OCI Error ORA-00001: unique constraint (SUBSERA.XXDL_SUBS_TASK_ITEMS_PK) violated (status = 1), SQL <INSERT INTO
"SUBSERA"."XXDL_SUBS_TASK_ITEMS"
("TASK_ID","LINE_ID","TRANSACTION_ID","TASK_TYPE","STATUS","ASSIGNEE","ASSIGNED_ON","COMPLETED_DATE","COMMENTS","PERSON_ID","CREATED_BY") VALUES (:a0,:a1,:a2,:a3,:a4,:a5,:a6,:a7,:a8,:a9,:a10)>. 2016-11-02 13:30:12 ERROR OGG-01296 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: Error mapping from APPS.XXDL_SUBS_TASK_ITEMS to SUBSERA.XXDL_SUBS_TASK_ITEMS.
2016-11-02 13:30:19 ERROR OGG-01668 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: PROCESS ABENDING.
Date: Thu, 3 Nov 2016 11:32:08 -0700
Message-ID: <CAHDOOG6gSBzQLJD_BqSJai8ypoTDQBvPzmB99ZXUvMFtTnPxNw_at_mail.gmail.com>
Golden Gate 12c version running against a 12c database. Integrated extract and replicat were setup with a few tables. All was well. The target database was shut abort. After the outage, replicat stopped working. My understanding was that the remote trail files were corrupt and I tried a few t hings (like skip transaction, trying to move the rba so that replicat would start from that point, removed the dirdat directory aand create an empty one hoping that the right ones would be copied over ). But replicat kept failing.
SR was of not much use.
Then I deleted the replicat and created another with the same name. Before that there were a couple of tables that were failing with this error 2016-11-02 13:30:10 WARNING OGG-02544 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: Unhandled error (ORA-26787: The row with key ("TASK_ID") = (23249) does not exist in table SUBSERA.XXDL_SUBS_TASK_ITEMS ORA-01403: no data found) while processing the record at SEQNO 4, RBA 6742 in Integrated mode. REPLICAT will retry in Direct mode. 2016-11-02 13:30:10 WARNING OGG-02760 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: ASSUMETARGETDEFS is ignored because trail file ./dirdat/rt000000004 contains table definitions. 2016-11-02 13:30:10 INFO OGG-03506 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: The source database character set, as determined from the trail file, is we8iso8859p15.
2016-11-02 13:30:10 INFO OGG-06505 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: MAP resolved (entry APPS.XXDL_SUBS_TRANS_LINES): MAP
"APPS"."XXDL_SUBS_TRANS_LINES", TARGET SUBSERA.XXDL_SUBS_TRANS_LINES.
2016-11-02 13:30:11 INFO OGG-02756 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: The definition for table APPS.XXDL_SUBS_TRANS_LINES is obtained from the trail file.
2016-11-02 13:30:11 INFO OGG-06511 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: Using following columns in default map by name: LINE_ID, TRANSACTION_ID, TRANSACTION_TYPE, AMENDMENT_NUMBER, POP_START_DATE,
POP_END_DATE, AMOUNT_FUNDED, REQUISITION_NUMBER, SUB_PI_NAME, SUB_ADMIN_CONTACT_NAME, SUB_ADMIN_ADDRESS, SUB_CITY, SUB_STATE, SUB_ZIP, SUB_FED, SUB_PHONE, SUB_EMAIL, PROJECT_NAME, SU_CONTACT_NAME,SU_CONTACT_PHONE, SU_DEPARTMENT, SU_CONTACT_EMAIL, OSR_ASSIGNED_TO_ID, LINE_STATUS, SUB_ALT_LOCATION, SUB_ALT_ADDRESS, PHS_FLAG, ASSIGN_DATE, LAST_ACTION_DATE, REQUISITION_TYPE, SUBRECIPIENT_CARRYFORWARD, ADDITIONAL_RESTRICTIONS, CAPITAL_EQUIPMENT, ANIMAL_SUBJECTS, HUMAN_SUBJECTS, REQUEST_DESC, STANFORD_PI_NAME, CREATED_BY, CREATION_DATE, LAST_UPDATED_BY, LAST_UPDATE_DATE, RISK_ASSESS_FLAG. 2016-11-02 13:30:11 INFO OGG-06510 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: Using the following key columns for target table SUBSERA.XXDL_SUBS_TRANS_LINES: LINE_ID.
2016-11-02 13:30:11 INFO OGG-03010 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: Performing implicit conversion of column data from character set we8iso8859p15 to UTF-8.
2016-11-02 13:30:11 INFO OGG-06505 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: MAP resolved (entry APPS.XXDL_SUBS_TASK_ITEMS): MAP
"APPS"."XXDL_SUBS_TASK_ITEMS", TARGET SUBSERA.XXDL_SUBS_TASK_ITEMS.
2016-11-02 13:30:12 INFO OGG-02756 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: The definition for table APPS.XXDL_SUBS_TASK_ITEMS is obtained from the trail file.
2016-11-02 13:30:12 INFO OGG-06511 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: Using following columns in default map by name: TASK_ID, LINE_ID, TRANSACTION_ID, TASK_TYPE, STATUS, ASSIGNEE, ASSIGNED_ON, COMPLETED_DATE, COMMENTS, PERSON_ID, CREATED_BY. 2016-11-02 13:30:12 INFO OGG-06510 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: Using the following key columns for target table SUBSERA.XXDL_SUBS_TASK_ITEMS: TASK_ID.
2016-11-02 13:30:12 WARNING OGG-01154 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: SQL error 1 mapping APPS.XXDL_SUBS_TASK_ITEMS to SUBSERA.XXDL_SUBS_TASK_ITEMS OCI Error ORA-00001: unique constraint (SUBSERA.XXDL_SUBS_TASK_ITEMS_PK) violated (status = 1), SQL <INSERT INTO
"SUBSERA"."XXDL_SUBS_TASK_ITEMS"
("TASK_ID","LINE_ID","TRANSACTION_ID","TASK_TYPE","STATUS","ASSIGNEE","ASSIGNED_ON","COMPLETED_DATE","COMMENTS","PERSON_ID","CREATED_BY") VALUES (:a0,:a1,:a2,:a3,:a4,:a5,:a6,:a7,:a8,:a9,:a10)>. 2016-11-02 13:30:12 ERROR OGG-01296 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: Error mapping from APPS.XXDL_SUBS_TASK_ITEMS to SUBSERA.XXDL_SUBS_TASK_ITEMS.
2016-11-02 13:30:19 ERROR OGG-01668 Oracle GoldenGate Delivery for Oracle, rsubsera.prm: PROCESS ABENDING.
Did a datapump export and import of those tables and started the replicat. It is fine now.
This is not an elegant way of doing. Is there a better way that this can be handled?
Thanks for your time.
Kumar
-- http://www.freelists.org/webpage/oracle-lReceived on Thu Nov 03 2016 - 19:32:08 CET