Copy high volume of data between AS/400

25 pts.
Tags:
AS/400 data transfer
AS/400 database
Copy Database Wizard
Data
Neeed copy big file between iseries faster, this moment the requerided is 2 days? Need your coments to do the transfer more quicKly

Software/Hardware used:
copy

Answer Wiki

Thanks. We'll let you know when a new response is added.

Sorry, but that information is missed.
The data some 1500.000.000 de records used to collect data sql and ddm record x record

Could send me some tips I need have in hand to do this process eficient
Tanks You

Discuss This Question: 9  Replies

 
There was an error processing your information. Please try again later.
Thanks. We'll let you know when a new response is added.
Send me notifications when members answer or reply to this question.

REGISTER or login:

Forgot Password?
By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy
  • CharlieBrowne
    I am not clear on all you are asking. Are you saying that it takes 2 days to transfer the file? What steps are you currently taking to transer the file?
    41,380 pointsBadges:
    report
  • TomLiotta
    How are the systems connected? Are they in two different networks or are they in the same local network? What kind of network interface is used? Ethernet? Something else? What kind of file? I'd normally assume a database file rather than any kind of streamfile. The question is tagged with a couple 'database' references. How much data is involved? What protocol are you using for transfer? FTP? DDM? QFileSvr.400? Something else? What OS versions are on each end? Tom
    125,585 pointsBadges:
    report
  • Labnuke99
    What type of file transfer protocol are you using? How much data? How far apart are the servers? Please provide more details.
    32,960 pointsBadges:
    report
  • CharlieBrowne
    1.5 billion records? What is the record size? You definitely do not want to be using DDM. We sill need much more detail.
    41,380 pointsBadges:
    report
  • Teandy
    Just going by the information provided, it looks like you are saying you have 2 days to get 1.5 Billion records from one location to another. If this is correct, and the servers are not on the same network in the same building, I would suggest saving the file to tape, then over night the tape to the new location and restore the file.
    5,860 pointsBadges:
    report
  • TomLiotta
    If it's SQL, it won't be DDM though it probably will be DRDA. If you must use SQL, you don't have much choice. Blocked INSERTs are probably the best you're going to get. Choose a number of records to make your block as close as 128K as will fit. Again, what OS versions are on both ends? What NICs are you using? What transfer rate do you get across the wire between the two systems? Tom
    125,585 pointsBadges:
    report
  • CRAMIREZ
    [...] TomLiotta, Labnuke99 and Teandy worked together trying to figure out how to help a member copy a high volume of data between AS/400s. 6. You learn something new everyday in the forums. Learn from Jcmdba on running SQL Plus on a [...]
    0 pointsBadges:
    report
  • Oldpgmritk
    i would ftp the data and process on the other end.
    20 pointsBadges:
    report
  • TomLiotta
    I would ftp the data and process on the other end. As would perhaps everybody else if this was a simple transfer of a file from one system to the other. But we still don't know what the circumstances are. We don't even know how big the file is, though we can assume it's probably a minimum of maybe 50GB in size. Maximum could be 1TB or more, depending on row size. 50 bytes? 200 bytes? 2K bytes? I'm not sure how many of us would want to send a reasonably complex 1TB SQL table straight through FTP. Most of us would first want to convert the table into perhaps a savefile format first and then ZIP it up and FTP the .zip file. But it's not always a trivial task to have a 1TB table plus a 1TB savefile plus a resulting .zip file on a system even for as long as it takes to finish the preparation. And the reverse process must be done on the receiving side. Let's see... an upload speed of 100Mbps would handle 1TB in 80,000 seconds at perfect rates, almost a full day. Except the actual packets will have built-in overhead, and the underlying protocols themselves have their own overheads for acknowledgments, error corrections, etc., and 100Mbps across any common internet route is an order of magnitude (or two or three) better than we might expect, and at some time during the day (or two days or more) somebody else on either end might want to use the internet for some other purpose, and... And maybe the problem really is as implied -- SQL (or DDM perhaps) is needed. Perhaps there is an issue with key restraints or two-phase commits or who knows? We simply don't know enough to make useful suggestions. If FTP was the best networking choice, maybe it's better just to use tapes and send them via express delivery. Tom
    125,585 pointsBadges:
    report

Forgot Password

No problem! Submit your e-mail address below. We'll send you an e-mail containing your password.

Your password has been sent to:

To follow this tag...

There was an error processing your information. Please try again later.

REGISTER or login:

Forgot Password?
By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy

Thanks! We'll email you when relevant content is added and updated.

Following