Hi Team,
I have a dataflow which is having 12 custom functions each custom function will run 3 times for an attribute with different input parameters , i have 15 attributes which call these custom functions, function has sql statements inside it. All functions have "enable parallel execution " enabled.The performance of the Job is for 3000 records it is taking 3.5 hours.Then i applied DOP =5 and loader =5 it gave good improvement and it is now taking 1.5 hours but still management is not happy about the throughput and i explained them everything no luck.Is there any way , i can improve the performance further,
Server details :
OS:Windows
RAM-32GB
CPU-8
jmuthukumaran (BOB member since 2011-09-13)