Re: Slightly OT: ETL Tools
Date: Mon, 9 Jan 2012 11:23:59 -0800
Message-ID: <CAGXkmivftE9NPpCyDTh=np3XWbNyGOZiuXRpT4bvkVrD2twWNA_at_mail.gmail.com>
For me, I see just two requirements of any ETL product, purchased or engineered, in today's world that interacts with data in an RDBMS: 1) The output must be SQL. This means that the ETL product does code generation only and the database does the actual work. This way your ETL scales as your database scales.
2) The product must be metadata driven. Any ETL code that is not metadata driven is costly to maintain and becomes brittle and problematic when changes are required (and their will be changes). I realize that this does not specifically address any of the points you have asked, but I think they are the most important technical points out there when dealing with large systems or systems that can grow up to be large.
On Mon, Jan 9, 2012 at 10:52 AM, Kellyn Pot'vin <kellyn.potvin_at_ymail.com>wrote:
> Hey Listers!
> I've been tasked with a new data warehouse project and one of the steps is
> to decide if we wish to continue all our transformations and build steps
> through SQL or if we would be better off utilizing an ETL tool. I have
> documented, as well as my manager, the pros and cons of going with an ETL,
> but I'm hitting up a number of resources on what ETL tools are preferred by
> different groups.
> Developers and DBA's, from your POV, what ETL tools do you think are the
> best?
> I'm looking for the following:
> 1. What was the product and how long did you work with it?
> 2. In what capacity you supported the product, (i.e. as a DBA or
> developer) and/or did you perform the tasks as an ETL administrator or
> supported the technical peer who did perform these functions for the
> business?
> 3. What were the best features/ limiting drawbacks of the product?
>
> Questions may seem involved, but feel free to just slap a few lines of
> info together and I would really appreciate any feedback you can offer!
> Thanks!
-- Regards, Greg Rahn | blog <http://bit.ly/u9N0i8> | twitter <http://bit.ly/v733dJ> | linkedin <http://linkd.in/gregrahn> -- http://www.freelists.org/webpage/oracle-lReceived on Mon Jan 09 2012 - 13:23:59 CST