Home » RDBMS Server » Server Utilities » Skip Duplicates with SQL*Loader
Skip Duplicates with SQL*Loader [message #72305] Fri, 09 May 2003 03:42 Go to next message
Scott Ford
Messages: 1
Registered: May 2003
Junior Member
Hello!

Any help would be very much appreciated -

I have a file with exact duplicate records and I just want to skip then during a load.

(Using 'distinct' in my extract makes the query perform like a dog. I don't want to load all the duplicates then weed them out because it's 3GB of data compared to 300MB).

Many thanks,

Scott
Re: Skip Duplicates with SQL*Loader [message #72328 is a reply to message #72305] Sat, 17 May 2003 16:11 Go to previous message
LevR
Messages: 1
Registered: May 2003
Junior Member
I had the same problem. To fix it intermediate file "list.txt" was used in control. Option "-u" for sort does the job:

sort -u list_orig.txt > list.txt
sqlldr db/pswrd@instance control=control.ctl
Previous Topic: Help..! Inter Instance IPC Error
Next Topic: How to export tables directly to tape device in AIX?
Goto Forum:
  


Current Time: Sat Jun 29 04:20:56 CDT 2024