sqlloader problem while loading from a huge csv file

0 pts.
Tags:
Database
DB2
Oracle
Hi all, I am new to this community. Hope to have a great learning experience here. The error I am receiving while loading a huge file is: SQL*Loader-510: Physical record in data file is longer than the maximum(1048576) Actually the csv file I am loading from is huge, has 9lac+ records. Increasing the readsize doesnt help... Let me write down the full command I am issuing: C:>sqlldr "test/test@conf" control='E:control_location.ctl',log='E:log_location.log',data='E:data_location.txt',errors=0,direct=true,commit_discontinued=true,readsize=3000000; returns an error... LRM-00104: '3000000;' is not a legal integer for 'readsize' Please suggest me a way out. Thank you all in advance, Avishek.
ASKED: September 6, 2005  2:12 AM
UPDATED: September 14, 2005  12:08 PM

Answer Wiki

Thanks. We'll let you know when a new response is added.

I would try to investigate the 3000000 number that is referenced in the error message, could a number this size fit into a type ‘integer’ column? Perhaps, the column in question needs a size change…

Discuss This Question: 4  Replies

 
There was an error processing your information. Please try again later.
Thanks. We'll let you know when a new response is added.
Send me notifications when members answer or reply to this question.

REGISTER or login:

Forgot Password?
By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy
  • Avishek
    Hi, When I am trying the command with the normal read buffer size, then it gave the error: SQL*Loader-510: Physical record in data file is longer than the maximum(1048576) That is why I tried it with a higher buffer value. Trying with a lesser value gives the above error msg.
    0 pointsBadges:
    report
  • DaveInAZ
    The error means just what it says, in this case; one or more of your records is too long for the loader to handle. You'll need to investigate the use of one of SQL*Loader's workaround methods; Concatenate or ContinueIf. SQL*Loader-510: physical record in datafile is longer than the maximum Cause: The datafile has a physical record that is too long. Action: Use CONCATENATE or CONTINUEIF. Break up the physical records. If you don't have the documentation for SQL*Loader, or access to Oracle's site, you can find the relevant section here: http://tbw.verbundstudium.de/faecher/datenbanken/loader/loader_ref.pdf
    0 pointsBadges:
    report
  • Avishek
    [...] Address: http://itknowledgeexchange.techtarget.com/itanswers/sqlloader-problem-while-loading-from-a-huge-csv-... (0) Comments Read [...]
    0 pointsBadges:
    report
  • Avishek
    [...] Original Address: http://itknowledgeexchange.techtarget.com/itanswers/sqlloader-problem-while-loading-from-a-huge-csv-... [...]
    0 pointsBadges:
    report

Forgot Password

No problem! Submit your e-mail address below. We'll send you an e-mail containing your password.

Your password has been sent to:

To follow this tag...

There was an error processing your information. Please try again later.

REGISTER or login:

Forgot Password?
By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy

Thanks! We'll email you when relevant content is added and updated.

Following