Comments on: IFS maximum record size

By: mitchb

mitchb — Thu, 11 Dec 2008 22:12:47 +0000

Thanks Phil for your efforts.

I ended up getting the source of the data changed to be less than 4096 char record size.

It was worth the discussion anyway, thanks again.

By: philpl1jb

philpl1jb — Thu, 11 Dec 2008 14:36:16 +0000

CPYFRMIMPF – then press F9 for additional parameters <– or we’re dealing with an additon
in a later OS

Apparently the -w:9000 is a pc and perhaps unix command.

On the FTP side heres a pc based note
c:temp>ftp -?

Transfers files to and from a computer running an FTP server service
(sometimes called a daemon). Ftp can be used interactively.

FTP [-v] [-d] [-i] [-n] [-g] [-s:filename] [-a] [-w:windowsize] [-A] [host]

-v Suppresses display of remote server responses.
-n Suppresses auto-login upon initial connection.
-i Turns off interactive prompting during multiple file
transfers.
-d Enables debugging.
-g Disables filename globbing (see GLOB command).
-s:filename Specifies a text file containing FTP commands; the
commands will automatically run after FTP starts.
-a Use any local interface when binding data connection.
-A login as anonymous.
-w:buffersize Overrides the default transfer buffer size of 4096.
host Specifies the host name or IP address of the remote
host to connect to.

By: mitchb

mitchb — Wed, 10 Dec 2008 23:31:56 +0000

The STMFLEN parameter is not obviously visable in the CPYFRMIMPF command, so I will give that a go anyway to see if that will copy more than 4096 characters for each record. You are right in that the FTP is placing the data on the IFS in 4096 char lots, but there seems to be no option on the AS/400 FTP command to change that. Is that how you see it?

By: philpl1jb

philpl1jb — Wed, 10 Dec 2008 14:14:27 +0000

CPYFRMIMPF has the length — that will help if, infact if it got loaded with only one CRLF

The FTP -w:9000 <- record length sets the buffer length – default is 4096, but I don’t know what happens when your record is longer than the buffer. Your get or put might be breaking up your records like you thought originally.

Of course the last option – load it into a flat file and have a program build the records – two reads for each record – first for the 4096 second for the remainder.

By: mitchb

mitchb — Wed, 10 Dec 2008 02:37:46 +0000

Thanks for your help.

What command has the STMFLEN parameter?

The FTP command on the AS/400 does not have anywhere to extend the incoming data record length.

By: philpl1jb

philpl1jb — Tue, 09 Dec 2008 14:37:10 +0000

Here’s something more .. maybe

http://www.itjungle.com/mpo/mpo071802-story05.html

-w:buffersize overrides the default transfer buffer size of 4096.

also @ http://search400.techtarget.com/tip/0,289483,sid3_gci869595,00.html

and
http://www.orafaq.com/forum/t/124788/0/

Don’t know if this will help but try setting the buffer size larger on the FTP

with the option -w:9000 <– your record size.

By: philpl1jb

philpl1jb — Tue, 09 Dec 2008 14:23:30 +0000

And setting the Stream file record length . . . STMFLEN > 9000 to a larger value doesn’t work?
We still don’t know if this was a problem upstream, bringing the file to the IFS or downstream, getting the file from the IFS.

So try copying it to a flat file with a long enough width using the stream file record length to see if it still breaks.

By: mitchb

mitchb — Mon, 08 Dec 2008 23:23:10 +0000

The data seems to be wrapped at 4096 chars regardless. If I copy the data from the stream file to a database using the CPYFRMIMPF and specify CRLF the copy creates records of 4096 in the database even when there is no CRLF at the end on 4096.

By: philpl1jb

philpl1jb — Mon, 08 Dec 2008 14:18:33 +0000

So the only issue is viewing the IFS file?
Since it’s on the IFS it can be viewed from the client using any software on the client.
Phil

By: mitchb

mitchb — Fri, 05 Dec 2008 23:23:37 +0000

When you view any file using WRKLNK you will find that it seems to have a size limit of 4096 chars.
I understand what you mean about record lengths on the IFS and the basic record terminator is usually the CRLF, but if you upload a file with larger data lengths than 4096 it will wrap and the CRLF will be at the end of the data on the next line. Any help with this is appreciated.