Re: thoughts on "manufactured data"

In message <1112008817.202655.77150_at_l41g2000cwc.googlegroups.com>, Nolan <NMadsonGoogle_at_yahoo.com> writes
>A client with which I'm working has a dictum that "thou shalt not
>manufacture data"; which means we are forced to pull in bad data
>against all sane advice to the contrary.
>
>Can anyone point me to an author who can show how to go about
>integrating poor data quality sources into a datamart with a defensible
>strategy for data cleansing (which is the client's definition of
>'manufacturing' data.)

Sounds like a management problem not a technical one. Your choices are limited.

You can persuade the client to cleanse the data.

You can leave bad data on the server and cleanse it on the fly every time you use it.

You can treat all of the data as gospel and let the client live with the consequences. This involves least effort and is most likely to result in the client eventually letting you cleanse the data properly.

-- 
Bernard Peek
London, UK. DBA, Manager, Trainer & Author.