Re: Fastest way to ASCII file or other ideas?

On Apr 30, 4:51 pm, EscVector <J..._at_webthere.com> wrote:
> On Apr 30, 4:35 pm, hpuxrac <johnbhur..._at_sbcglobal.net> wrote:
>
> > On Apr 30, 4:07 pm, EscVector <J..._at_webthere.com> wrote:
>
> > > I'm looking for suggestions on the fastest way to dump 100+ Million
> > > rows from Oracle to an ASCII file.
> > > We've looked at external table with data pump. This works with speed,
> > > but that format is proprietary. We've also looked at UTL_FILE and
> > > this is slow. Looking for ideas suggestions. Streams possibly? Any
> > > third party freeware?
>
> > Traditionally for best speed one tactic is a c program running on same
> > server as database use bequeath or ipc type connection.
>
> Great suggestion. Thought of this but they didn't want to go with C
> or C++. Will explore concurrency/threading issues and maybe I can
> convince that it's not so bad.... I've only ever created single
> threaded C processes. What to do if C/native can't be used?

It's a given that oracle is already a propretary database. Tom Kyte argues to understand your database well and then use the tools that take the most advantages of it's features don't try to black box it.

Personally I would try a couple alternatives maybe C plus perl plus the external table data pump. Compare and contrast the speed you can get with these methods ... and go where those conclusions lead you.

Turn it into a shell script that calls a shell script that does data pump if you must hide some details! Put a little python in the middle eh? Received on Mon Apr 30 2007 - 16:01:52 CDT