Re: Large dataset performance

From: Jonathan Leffler <jleffler_at_earthlink.net>
Date: Tue, 20 Mar 2007 16:13:40 GMT
Message-ID: <UKTLh.15136$Jl.864_at_newsread3.news.pas.earthlink.net>


jma wrote:
> I would like your opinion and experience on the performance of writing
> large datasets. I am writing in one loop about 3.5 million rows where
> each row is an integer and 3 doubles to an Interbase db. All in all
> it's about 100MB. My time measurement was 210 seconds. Is this normal?
> To me it appears as a veeerryyy long time....

With an index on the integer column? Most likely, that index has to be updated all 3.5 million times, and the reorganization of that is causing the slow down. Is the index on a separate drive from the data (is that even possible in Interbase)?

-- 
Jonathan Leffler                   #include <disclaimer.h>
Email: jleffler_at_earthlink.net, jleffler_at_us.ibm.com
Guardian of DBD::Informix v2005.02 -- http://dbi.perl.org/
Received on Tue Mar 20 2007 - 17:13:40 CET

Original text of this message