Re: How to change ETL layer dynamically?

From: Mark D Powell <Mark.Powell2_at_hp.com>
Date: Tue, 23 Mar 2010 06:22:21 -0700 (PDT)
Message-ID: <5d357196-097f-494b-8a19-e738f9597ee9_at_33g2000yqj.googlegroups.com>

On Mar 23, 7:03 am, guser78 <qazmlp1..._at_rediffmail.com> wrote:
> We have to create a Datamart containing the Customer characteristics
> like 'Heavy Buyer; Chocolate lover' etc., and this has to be done by
> evaluating the relevant attributes in the Data ware house tables.
> But, in our case, the definition of Customer characteristics can
> change occasionally based on the new market conditions.
>
> This means that we should allow the dynamic administration of the
> definition of Customer characteristics.
>
> Please guide me on we can do this from an Application which uses the
> Datamart as the backend. Do we need to write an additional software
> module (for e.g. JDBC) to interpret the 'write' requests coming from
> the Application, and adapt the ETL layer accordingly?

Data warehouse architecture and design is a complex topic and you would probably be better off reading a few books on the subject because getting a truely meaningful response to such a broad question as yours without giving any background information on the over-all warehouse design and architecture is unlikely.

Oracle has a manual devoted to the subject of data warehousing and there are numerous design options covered in it. Microsoft has articles on the topic available on its web site and even though the subject is placing a warehouse on SQL Server there are still generic topics discussed.

HTH -- Mark D Powell -- Received on Tue Mar 23 2010 - 08:22:21 CDT