Re: Import of large CSV datasets in Java
From: Bruce Lewis <brlspam_at_yahoo.com>
Date: 11 Aug 2003 16:00:02 -0400
Message-ID: <nm9znigt16l.fsf_at_department-of-alchemy.mit.edu>
Date: 11 Aug 2003 16:00:02 -0400
Message-ID: <nm9znigt16l.fsf_at_department-of-alchemy.mit.edu>
ps_chowdary_at_hotmail.com (Srinivas) writes:
> Lookup of ids for tags takes long time when we process the data in
> batches of 100 or less. One idea could be first fill in all the IDs in
> the tmp_student_course.csv file (copy of student_couese.csv but
> without TAGs) and then import using sql*Loader.
>
> Can any one suggest alternative design ideas or third party APIs to
> accomplish this? Any pointers will be greatly appreciated.
I'd take the opposite approach. First import tmp_student_course.csv into a temporary table using sql*Loader. Then use SQL to import from this table to the production tables, joining as needed to get student ids. Received on Mon Aug 11 2003 - 22:00:02 CEST