|
|
Re: Processing data from flat files to base files via staging tables [message #617509 is a reply to message #617506] |
Tue, 01 July 2014 01:57 |
elaiyavel
Messages: 114 Registered: April 2008
|
Senior Member |
|
|
Steps at high level.
1. Using SQL loader load data from flat file to staging table (do a plain data load)
2. Apply validations and move only selctive records to base tables.
Other approach can be, use awk scripting and run validations on flat file and load only selective records to base table. Stage table load is not required in this case.
|
|
|
Re: Processing data from flat files to base files via staging tables [message #617510 is a reply to message #617509] |
Tue, 01 July 2014 02:02 |
Lalit Kumar B
Messages: 3174 Registered: May 2013 Location: World Wide on the Web
|
Senior Member |
|
|
elaiyavel wrote on Tue, 01 July 2014 12:27Steps at high level.
1. Using SQL loader load data from flat file to staging table (do a plain data load)
2. Apply validations and move only selctive records to base tables.
I would rather say it is 20th century method. External tables should be given preference. Both your steps could be done at one go.
|
|
|
|
|
Re: Processing data from flat files to base files via staging tables [message #617532 is a reply to message #617510] |
Tue, 01 July 2014 06:01 |
Solomon Yakobson
Messages: 3269 Registered: January 2010 Location: Connecticut, USA
|
Senior Member |
|
|
Lalit Kumar B wrote on Tue, 01 July 2014 03:02I would rather say it is 20th century method.
And why would you say that? There are many reasons to use SQL*Loader in 21 century. And it's a shame if rumours Oracle is deprecating SQL*Loader are true. But I doubted they are true. Otherwise we would end up in a situation where Oracle is pushing Exadata and other appliances where we can't easily place data feeds and deprecating SQL*Loader at the same time. Another reason could be performance (database server load versus application server load) and security.
SY.
|
|
|
Re: Processing data from flat files to base files via staging tables [message #617533 is a reply to message #617532] |
Tue, 01 July 2014 06:10 |
Lalit Kumar B
Messages: 3174 Registered: May 2013 Location: World Wide on the Web
|
Senior Member |
|
|
Solomon Yakobson wrote on Tue, 01 July 2014 16:31Lalit Kumar B wrote on Tue, 01 July 2014 03:02I would rather say it is 20th century method.
And why would you say that?
It was my response specific to the steps mentioned by elaiyavel. I would go with external table and do it at one go.
Quote:There are many reasons to use SQL*Loader in 21 century.
I agree, and I use it quite often depending on the purpose. I work for a legacy banking application and we do not have external tables because our only purpose is to load and nothing else. And we don't have permissions to create a directory object. So sqlldr works ok for us just for loading purpose.
|
|
|
|
|
|