Increasing batch run throughput

-
Hint: I have noticed that running a single instance of the Conversion validation runs on a Windows box results in massive under-utilisation of CPU, RAM and I/O.

My recommendation is that all runs of these jobs be run in threaded mode (I tend to start with 2 threads per CPU and assess the performance from that point).

Some work has been done on rewriting the batch submission scripts for both Unix and Windows to support easier multi-thread submission and the auto-processing of batch parameters. Let me know if you would like more info.

Comments

Unknown said…
Hi Stu,

May I have more information on this?

Thanks,
Joaquin
June 23, 2010 at 1:51 PM
Stuart Ramage said…
hi Joaquin,

the new shared threadpool methods and the associated submitJob scripts support the ability to submit a multi-threaded instance via a single submitJob script execution (by specifiying ThreadNbr 0 and Max Threads as a value > 1.

These new scripts also support the creation of .properties files for each batch and at the global level, which reduces the amount of manual entry for these parameters.

I recommend scanning through http://support.oracle.com for the new batch submission patch for your specific version of FW/CC&B, the associated PFD should list the setup required to implement these submission methods.
June 23, 2010 at 1:58 PM
Post a Comment

Popular posts from this blog

Database Upgrades and their impact on Conversion

-
Hint: It appears that the current strategy in relation to application of Single Fixes and Service Packs no longer supports application of these scripts against a staging schema (at least as part of CC&B 2.x.x). As a result it is recommended that you drop and rebuild the Conversion schema from the Production instance once this has been upgraded with the latest patch-sets. We have also noted that application of these single fixes may require a redelivery of all custom java code from the development environment, since the java compilation is not performed as part of the patch install process (unlike the Cobol implementation process).
Read more

Embedding web-based external applications within the framework.

-
Image
My current project contained a requirement to embed an external application within the the CC&B framework and initiate calls to this application supplying a number of context elements to ensure that the correct information is displayed. The client also requested that the application be 'skinned' to maintain the CC&B look-and-feel. This is how we implemented it.. Defined a number of Business Object to manage retrieval of data from some of the base CC&B objects in a flattened format (ie. Characteristics mapped to descriptive elements, unused fields not defined, etc). Defined a UI map which forms the canvas for 'painting' the application within our framework. A Query Zone to ensure that the required data associated with the Context Zones are retrieved (using Zone type F1-DE-QUERY). A Business Service to wrap the call to the Query Zone into a usable service. A Script to initiate the call to the Business Service with the associated Context Identifiers (fr...
Read more

Bundle Corrections.

-
We have identified an issue with the use of bundling and UI Maps, whereby the resulting Bundle was wrapping the UI Map in a set of CDATA tags, but only after it had already removed all formatting from the source records, resulting in corruption of the UI Map HTML fragments. This has now been corrected by implementing Single Fix 8228025 on FW/CC&B 2.2.0. If you are using the Bundling subsystem in your implementation, I strongly recommend that you implement this patch.
Read more