data unloading

From: SAMIR C RAJGURU <SRAJGURU_at_prodigy.net>
Date: Tue, 29 Sep 1998 03:57:07 -0700
Message-ID: <6uqeaa$54ng$1@newssvr04-int.news.prodigy.com>

I am currently writing an application that does analytical processing of LARGE amts. of database data. I need a way to get large amts. of data (many records) out of a database quickly (and cache to a local file).

My app is currently written in java and I use JDBC to connect to Personal Oracle 8 on Win95 using oracle's type 4 jdbc driver. I am getting each record individually and then incrementing a cursor. This is a VERY slow process (several minutes for 50,000 short text strings).

Is there a faster way to get data out of a database?

How does JDBC performance compare to performance of native "C" drivers, any other options?

Also, it seems to take forever just to get a connection and meta data (e.g. table/column names etc.). Is there some way to speed this up?

Any and all help/comments are much appreciated.

Sincerely,
Samir Rajguru
Stanford University Received on Tue Sep 29 1998 - 05:57:07 CDT