Re: Large dataset performance

Hello Cimode,

first let me say that you're right I am far away from being literate in SQL. However, consider that I am simulating the way a client application would be writing data to the database and this cannot change... I would really love to read directly from a binary stream into a db table, so that the performance would be adequate. Such a solution would fit me very well, since my data have a persistent pattern, for example int,double,double,double. Anyway, thanks for your remark

BR

jma

Ï/Ç Cimode Ýãñáøå:
> On 20 mar, 16:39, "jma" <junkmailav..._at_yahoo.com> wrote:
> <<I would like your opinion and experience on the performance of
> writing
> large datasets. I am writing in one loop about 3.5 million rows where
> each row is an integer and 3 doubles to an Interbase db. All in all
> it's about 100MB. My time measurement was 210 seconds. Is this normal?
> To me it appears as a veeerryyy long time.... >>
> The principle reason I see is the *Looping* algirythmics which is not
> what a db does best. I suggest you learn better the power of set
> operation through a better mastery of good ol SQL...Hope this helps...
> >
Received on Tue Mar 20 2007 - 22:53:04 CET