Re: Large XML Data, Parsing, JDBC, RMI, 2 Oracle DB

Hi,

I have no experience with multiple CPU, but 200 ms per element is rather slow for simple parsing. What is your parsing process ? is it simple value extracting and saving into corresponding columns? any data validation ? pre/post processing ? creating dependent objects and saving into several different tables?

May be [just may be] Oracle parser is slow by-itself. If dtd is more-or-less fixed, you can try to write custom-made parser...

AlexV

"Raden Java" <radenjava_at_theglobe.com.invalide> wrote in message news:tlilner8k3pd5d_at_corp.supernews.com...
> Hi,
>
> I'm trying to insert a large of data over 25,000,000 elements in xml
 format to
> 2 different Oracle Database on 2 different server.
>
> I'm currently working on 4 machines, machine A 1 and 2 is a database
 running
> Oracle 9i, machine B is a parsing machine (8 CPU Solaris), and
> machine C is where the RMI Connection to Database.
>
> What, I'm doing right now is I'm parsing every elements from the files
> using Oracle Parser and insert it to database using jdbc.
> But the program isn;t using all of the cpus because
> it's only capable to Parse and insert around 18,000 elements /
> hour, 432,000 elements in 1 day.
> So to parse all of data it will take around 57 days ?
> It should be something wrong here, but I don't have any clue on how to
> get through it.
>
> My only thought is to modified the parsing program, to utilize the 8 cpus
> resources.
>
> Can someone guide me how to find resource in Parallelism, so the Parsing
> program will utilize the SMP.
>
> Or if anyone have some advice on the best way to implement it, I really
> appreciate it.
>
> Thanks
Received on Sat Jul 21 2001 - 14:22:55 CDT