RE: [EXT] Re: Goldengate: How to load multiple files for initial load?

From: Livingston, Daniel <>
Date: Fri, 10 May 2019 16:39:03 +0000
Message-ID: <a8132887fd8e46a1bbf7a34e8db8e9f5_at_wcw30921.Regmail.West.Com>

It will load a single file of about 3 mill rows in about a minute or so, but it means I need to run it repeatedly (apparently).

The reason for going the route with GG itself was that this table eventually needs to be replicated ongoing from Oracle -> SQL Server

BCP seems to have the same problem: it expects a single source datafile.

RMTFILE: limit of 2GB per file
EXTFILE: read on a single file
BCP.exe: read only a single file

Almost like these utilities were last updated in 2005 or something ...

From: Andrew Kerber [] Sent: Friday, May 10, 2019 10:32 AM
To: Livingston, Daniel <> Cc:
Subject: [EXT] Re: Goldengate: How to load multiple files for initial load?

For large tables, you cant really use that method and expect it to finish in a reasonable time. You will need to look at BCP, or perhaps even a database link for the initial load.

On Fri, May 10, 2019 at 10:54 AM Livingston, Daniel <<>> wrote: I have a table of around 65mill rows that I need to replicate from an Oracle 18 database to SQL Server 2008

Source: Oracle 18.5, Goldengate 18.1
Target: SQL Server 2008R2, Goldengate 12.3 (this system is being migrated later this year to SS 2017 – different story)

I am trying to do this via the FILE to REPLICAT method:

  • Extract to trail files on remote server
  • Start SPECIALRUN replicat to read through the trail files and load the target table

The problem I am running into is that the replicat can only seem to read a *single* trail file at a time. It cannot use wildcards or any other way I have found to specify multiple EXTFILE datafiles

  • file list (partial) ----------------

Directory: C:\GGate\dirdat

Mode                LastWriteTime     Length Name

---- ------------- ------ ----
-a--- 5/10/2019 8:54 AM 2041669405 initld000000
-a--- 5/10/2019 8:56 AM 2041669563 initld000001
-a--- 5/10/2019 8:59 AM 2041669310 initld000002
-a--- 5/10/2019 9:01 AM 2041669276 initld000003
-a--- 5/10/2019 9:03 AM 1119899237 initld000004
  • replicat param file -------------------------

BATCHSQL discardfile ./dirrpt/initld.dsc, purge

targetdb ers_gg, useridalias ggadmin

extfile ./dirdat/initld

sourcecatalog vsopdb
MAP vsop.masterline_repl, TARGET dbo.masterline_repl, colmap(usedefaults);

end runtime

Get the error:

2019-05-10 09:36:14 ERROR OGG-01091 Unable to open file "C:\GGate\dirdat/initld" (error 2, The system cannot find the file specified.).

Is there any way to do this? Or am I supposed to create a powershell loop of some sort to process the full 57 data files one by one? I have tried with a wildcard (error), multiple EXTFILE parameters (only reads the last one) ... ?


Andrew W. Kerber

'If at first you dont succeed, dont take up skydiving.'
-- Received on Fri May 10 2019 - 18:39:03 CEST

Original text of this message