RE: [EXT] Re: Goldengate: How to load multiple files for initial load?
Date: Fri, 10 May 2019 16:39:03 +0000
Message-ID: <a8132887fd8e46a1bbf7a34e8db8e9f5_at_wcw30921.Regmail.West.Com>
It will load a single file of about 3 mill rows in about a minute or so, but it means I need to run it repeatedly (apparently).
The reason for going the route with GG itself was that this table eventually needs to be replicated ongoing from Oracle -> SQL Server
BCP seems to have the same problem: it expects a single source datafile.
Almost like these utilities were last updated in 2005 or something ...
From: Andrew Kerber [mailto:andrew.kerber_at_gmail.com]
Sent: Friday, May 10, 2019 10:32 AM
For large tables, you cant really use that method and expect it to finish in a reasonable time. You will need to look at BCP, or perhaps even a database link for the initial load.
On Fri, May 10, 2019 at 10:54 AM Livingston, Daniel <DLivingston_at_west.com<mailto:DLivingston_at_west.com>> wrote:
I have a table of around 65mill rows that I need to replicate from an Oracle 18 database to SQL Server 2008
Source: Oracle 18.5, Goldengate 18.1
I am trying to do this via the FILE to REPLICAT method:
The problem I am running into is that the replicat can only seem to read a *single* trail file at a time. It cannot use wildcards or any other way I have found to specify multiple EXTFILE datafiles
Directory: C:\GGate\dirdat
specialrun
targetdb ers_gg, useridalias ggadmin
extfile ./dirdat/initld
sourcecatalog vsopdb
end runtime
Get the error:
2019-05-10 09:36:14 ERROR OGG-01091 Unable to open file "C:\GGate\dirdat/initld" (error 2, The system cannot find the file specified.).
RMTFILE: limit of 2GB per file
EXTFILE: read on a single file
BCP.exe: read only a single file
To: Livingston, Daniel <DLivingston_at_regmail.west.com>
Cc: oracle-l_at_freelists.org
Subject: [EXT] Re: Goldengate: How to load multiple files for initial load?
Target: SQL Server 2008R2, Goldengate 12.3 (this system is being migrated later this year to SS 2017 – different story)
Mode LastWriteTime Length Name
...
---- ------------- ------ ----
-a--- 5/10/2019 8:54 AM 2041669405 initld000000
-a--- 5/10/2019 8:56 AM 2041669563 initld000001
-a--- 5/10/2019 8:59 AM 2041669310 initld000002
-a--- 5/10/2019 9:01 AM 2041669276 initld000003
-a--- 5/10/2019 9:03 AM 1119899237 initld000004
abortonfatalerror
BATCHSQL
discardfile ./dirrpt/initld.dsc, purge
MAP vsop.masterline_repl, TARGET dbo.masterline_repl, colmap(usedefaults);
--
Andrew W. Kerber
'If at first you dont succeed, dont take up skydiving.'
--
http://www.freelists.org/webpage/oracle-l
Received on Fri May 10 2019 - 18:39:03 CEST