Re: Expect to work with terrabytes.. now what?

Ferdinand,
  compressing data in the DB is not possible without starting    to pull out rabbits out of the head.

  If you want to compress look for a hardware solution.   I think that 'space' will be the least of your concerns as    harddisks are cheap this days.

  The next thing is that you will have to decide what kind of     application it is. The characteristica of a DW is not     non-update and large ... it is more the way how data is     stored (fact, dimensions), how data gets into the system     (who feeds the system) and how is the data queried.

  In a DW environment user have to possiblity to ask "unplanned"     questions and know that it might take a while, while in     OLAPs the applications provide them with at ready made     query.

  That is the functional side (just the first thoughts when I     read your mail).

  On the technical side:

    Go for 8i and don't settle for less.

    You can use parallel server to increase performance for     the DB operations

    You should use BITMAP index

    Once you have figured out how you will structure your data

      you will need to know what are the most likely queries
      and distribute your datafiles over different disks/media

In article <7ieald$vlj_at_guust.incore.xs4all.nl>,   "Ferdinand Swaters" <ferd_at_incore.xs4all.NO_SPAM.nl> wrote:
> Hi All,
>
> I am currently on a project where the data in my database is going to
run
> into the 1-10 Terabyte range. I have no experience with these sizes
of data
> in a DBMS, and I am wondering what new pitfalls I might run into.
>
> The system will do almost no updates on the data, most is storage and
then
> delete after a while. There won't be many queries on the data, but the
> queries will be large. It is much like a data warehouse situation.
The DBMS
> will be oracle.
>
> I don't have a good idea on what questions to ask first, because I'm
mainly
> concerned about the things I might forget now, and run into when the
beast
> is operational. One thing that I would like to know is if there is a
way I
> could compress the data while it is in the database. That would reduce
> storage space required by a huge factor.
>
> Anyone has some experience they wish to share?
>
> advTHANKSance,
>
> Ferd.
>
>

--== Sent via Deja.com http://www.deja.com/ ==-- ---Share what you know. Learn what you don't.--- Received on Thu May 27 1999 - 11:18:19 CEST