Question

Performance issues regarding merging libraries

AS/400 performance, multithreading, library merging

I received an email yesterday from a reader who has a big task. She is working with a hospital to merge three different libraries into one using AS/400.

"One Hospital is going for data merger of three different libraries to one single library including some data mapping and conversion.
There are lots of programs written for conversion of data to single library. But we are facing performance issue as converting billions of records takes time and CPU usage goes high, resulting in slowness of application.
We can implement the concept of multithreading, but monitoring each job for its conversion may become a big task.
What should we do?"

It look like this project is pretty huge so in that case, I would probably ask to create a special subsystem with a specific shared pool insulated from the one used by QBATCH so each of them would have their individual memory and CPU specs so they wont disturb the other one while running Monster jobs.

If you do so, dont forget to start your sub system at IPL time in your QSTRUP pgm.

Have Fun !

__________________
DanTheMan