My production job performance is getting deteriorated due to AL_Statistics table size issue.
Is there any option in CMC or the designer where we can limit the data retention in al_statistics to last 7 to 10 days or any way to do auto clean up of all the al_statistics, al_history tables on a weekly basis etc ?
We had already made that change few months back by changing History and Log retention period to 20 days but we still have entries in value column in al_statistics table having date greater than 30 days.
There is another field “Job History Cleanup Period”, is this linked to al_statistics ? Its ask to enter values in seconds, any idea what does this field exactly does ?
you should first find out why the history is not getting deleted
if you want to cleanup the data manually, check the following post
if you are seeing lots of statistics getting generated then you can disable that by making the following changes to %DS_COMMON_DIR%\conf\DSConfig.txt file on the jobServer
first try the following
Enable_Statistics = TRUE
Disable_Transform_Statistics = TRUE
if you still see large amount of stats, then set the values as below
Enable_Statistics = FALSE
Disable_Transform_Statistics = TRUE
if the log deletion is not working properly, I would suggest opening a case with support