Re: SQL*Loader reading compressed data files

From: Thomas Kyte <tkyte_at_us.oracle.com>
Date: Tue, 12 May 1998 11:25:02 GMT
Message-ID: <355c312a.10080264@192.86.155.100>

A copy of this was sent to "Stephen Channell" <stephen.channell_at_dial.pipex.com> (if that email address didn't require changing) On Tue, 12 May 1998 09:19:16 +0100, you wrote:

>I have a Data Warehouse that needs to load 56,000,000 transactions a day
>from one of our operational systems.
>The operational system is using Pro*C with GNU ZLIB to compress the data
>files dynamically to optimise the trip across the network.
>
>My current proposed design uses another Pro*C program running on the Data
>Warehouse to uncompress the data, to provide the type of files that
>SQL*Loader will like the taste of.
>
>Does anybody know:
>
>o Is it possible to link a custom version SQL*Loader to use a different
>basic IO library from the standard UNIX one.
>
>o Is Oracle Corp likely to "throw the toys out of the pram" at such a build.
>

Use named pipes.

$ mknod somefile.dat p
$ your_proc_progam < compressed.data > somefile.dat &
$ sqlldr userid=scott/tiger control=abc.ctl data=somefile.dat

That'll replace the 'IO' library.

Thomas Kyte
tkyte_at_us.oracle.com
Oracle Government
Herndon VA

http://govt.us.oracle.com/ -- downloadable utilities

Opinions are mine and do not necessarily reflect those of Oracle Corporation

Anti-Anti Spam Msg: if you want an answer emailed to you, you have to make it easy to get email to you. Any bounced email will be treated the same way i treat SPAM-- I delete it. Received on Tue May 12 1998 - 06:25:02 CDT