BusinessObjects Board

xml loading causes virtual memory issue

I have 7 tables through which I am trying to load xml. I am doing all the joins in a query which has xml schema. It loads 100 rows fine but when i try to load bigger set of data like 5000rows it consumes all the server ram and hangs. How to avoid this?


DataGenius (BOB member since 2006-06-13)

It would help if you provided a more detailed description of the Dataflow. A picture would help.

It might work to put a Data Transfer after the XML source so the data goes to the database. After that you can join from the table using a Query transform. That might eliminate your memory issue.


eganjp :us: (BOB member since 2007-09-12)

Dear Sharma,

Try to use the Data transfer transformation followed by Query joins and see the difference.

Regards,
Prasna


pnr6kor (BOB member since 2014-05-14)

99% chance that there is a carthesian product still in your xml/nested structure.

You can check this with looking at the row count. Probably much higher than 5000…


Johannes Vink :netherlands: (BOB member since 2012-03-20)

Attached is the picture. I have tried data transfer as well. It doesn’t help either.
Pic.PNG


DataGenius (BOB member since 2006-06-13)