sqlloader problem while loading from a huge csv file
Home > IT Answers > Oracle > sqlloader problem while loading from a huge c...
avishek
0 pts.
0
Q:
sqlloader problem while loading from a huge csv file
Oracle, DB2, Database
Hi all,

I am new to this community. Hope to have a great learning experience here.

The error I am receiving while loading a huge file is:
SQL*Loader-510: Physical record in data file is longer than the maximum(1048576)

Actually the csv file I am loading from is huge, has 9lac+ records. Increasing the readsize doesnt help... Let me write down the full command I am issuing:
C:>sqlldr "test/test@conf" control='E:control_location.ctl',log='E:log_location.log',data='E:data_location.txt',errors=0,direct=true,commit_discontinued=true,readsize=3000000;

returns an error...
LRM-00104: '3000000;' is not a legal integer for 'readsize'

Please suggest me a way out. Thank you all in advance,

Avishek.
ASKED: Sep 6 2005  2:12 AM GMT
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
RELATED QUESTIONS
0
whizzconsult
0 pts.
0
A:
 RATE THIS ANSWER
0
Click to Vote:
  •   0
  •  0
  • AddThis Social Bookmark Button
I would try to investigate the 3000000 number that is referenced in the error message, could a number this size fit into a type 'integer' column? Perhaps, the column in question needs a size change...
Last Answered: Sep 6 2005  4:18 PM GMT by whizzconsult   0 pts.
  •   
0
0
RSS - Discussions Help
Discuss This Answer:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _



_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

avishek   0 pts.  |   Sep 12 2005  9:23AM GMT

Hi,

When I am trying the command with the normal read buffer size, then it gave the error:
SQL*Loader-510: Physical record in data file is longer than the maximum(1048576)

That is why I tried it with a higher buffer value. Trying with a lesser value gives the above error msg.

 

DaveInAZ   0 pts.  |   Sep 14 2005  12:08PM GMT

The error means just what it says, in this case; one or more of your records is too long for the loader to handle. You’ll need to investigate the use of one of SQL*Loader’s workaround methods; Concatenate or ContinueIf.

SQL*Loader-510: physical record in datafile is longer than the maximum

Cause: The datafile has a physical record that is too long.

Action: Use CONCATENATE or CONTINUEIF. Break up the physical records.

If you don’t have the documentation for SQL*Loader, or access to Oracle’s site, you can find the relevant section here: <a href="http://tbw.verbundstudium.de/faecher/datenbanken/loader/loader_ref.pdf" title="http://tbw.verbundstudium.de/faecher/datenbanken/loader/loader_ref.pdf" target="_blank">http://tbw.verbundstudium.de/faecher/dat…</a>

 
0