Re: Uploading data for star schema

From: j_beverly <>
Date: Wed, 06 Dec 2000 04:22:50 GMT
Message-ID: <>

On Tue, 05 Dec 2000 19:53:55 GMT, wrote:

>I have a textfile that contains rows of data in a non-normalized fashion
>What I need to do is load that data into a star schema.
>In order to this I need to load each of the dimension tables and get the
>ids of the entry. Of course if the row already exists I need to just get
>the ids. After I have done this on all measure (8 of them). I need to
>stuff the ids and other data into a record in a fact table.
>Currently, I am doing this using a VB program and it is incredibly slow.
>Is there a way to this using SQLLoader or some other technque that would
>be more efficient?
>NOTE - probably doesn't matter but I am not using Oracle OLAP.
>Thank you.
First of all, I'm not sure I complely understand what you're trying to do.

You say your text data file is not normalized. I had a similar problem.

In this case the legacy data came another (PROGRESS) database program that was poorly designed (not normalized) and on a different operating system. I used Microsoft Access as an interim step to massage the data to match the format of my Oracle database. (I am more used to using Access than Oracle).
Then I ran a query/report in Access that generated a text file that matched my Oracle database, so the SQL Loader process was simple and ran very fast. (Okay, after many attempts to clean the data and get the bugs out.)
This was a relatively small database (< 20,000 records). I don't know if this procedure would work for you. Received on Wed Dec 06 2000 - 05:22:50 CET

Original text of this message