I’ve very recently started occasionally seeing the following error occuring for some of my users:
‘Connection Failed. The server has reached the maximum number of simultaneous connections. (Error:RWI 00239) (Error: INF)’
However, when I check, there are fewer sessions than maximum connections (most recently this occured when I had 19 sessions, the maximum is set to 50 on the webintelligence server.
Does anyone know why this might happen, or if the connection count is different from the session count?
There is no correlation between connection count and session count. A single user could have multiple Webi documents open each of which would consume a Webi server connection.
Also, in XI R2, there is no reliable way to get the actual Webi conection count as the SDK includes internal connections that do not count against the 50. I have not looked into whether 3.x has this same issue.
The issue seems to keep happening around about the same time of day. It is happening again now, but with only 6 people logged in, and a maximum connections of 50. I suspect none of these user is working on more than a single document (indeed only 1 of those users knows how to), and there are no scheduled jobs running (I keep these to a strict overnight timeslot).
I’m concerned that this has started happening over the last week or so without any reason.
Can anyone think why this might happen? We occasionally have an issue where the BO webserver stops responding but the servers all indicate normal ~20% load. Could this be connected, is it possible that connections are not being closed?
If you are on XI 3.x there should be an Open Connections metric for Webi servers, if so what is that number at when the error appears?
Is anyone editing Webi documents? Editing can consume multiple connections at a time per user.
What is the max documents per user parameter set to?
Is anyone using LiveOffice and/or QaaWS? These could be consuming webi connections also.
Have you tried increasing or decreasing the max connections from 50, to see if there is any difference in behavior?
If you have additional CPU and sufficient memory on the server, you can add more Webi processing servers to achieve load balancing.
You may want to check your Webi cache parameters to see if they are set to anything different than the installed defaults. There’s a possibility that the combination of these parameters may be preventing connections from cleaning up.
Unfortunately when I try to retrieve the metric from the server, I just keep getting the error ‘The property with ID SI_METRICS does not exist in the object’, even when the system is working fine.
The maximum documents per user is set to 5. Noteably is seems to take a long time to return the properties on the webi server object, perhaps 7-8 minutes beofre it displays the page in the CMC.
Aside from that, yes there are often users writing/editing webi documents, but this has never caused an issue before
We don’t use LiveOffice yet, and I’ve never managed to get QaaWS working , strangley I’m beginning to wonder if these issues are linked.
We can’t add more server resource for licencing reasons, and we are not experiencing memory issues.
I’ve not yet tried changing the max connections, but I have changed the session timeout down to 10 minutes from a setting of 30, so that at least any orphaned connections will recycle more quickly
.
Thanks for your help!
I think you need to focus on this first, it sounds like either your webi server is corrupted , or there is a problem on the web app server or CMS database.
First see if you can get this info from querybuilder, by running select * from ci_systemobjects where si_kind = ‘Server’ and si_name = ‘server name’
You should be able to scroll down in the results and see all of the server metrics.
If this runs quickly and there are no other known problems with your CMS database, start to look at the web app server for performance/memory issues and look in the logs for errors.
If you can’t find anything wrong, then get some system downtime, and disable the exisiting webi server, and create a new one to see how that performs relative to the one giving you problems.
Thanks for this, I’m going to liaise with the DBA who looks after the installation ans look at this.
One last question, though. I presume that the recreation of a new webi server is different from just restarting it? We restart it occasionally with no effect.
Correct, restarting just stops/starts the process but you will actually create a new Webi Report Server from the CMC. When you disable the existing Webi Server uncheck the option to start the server when the SIA starts.
If the new Webi server works you can then delete the old one.
I run this in query builder and it took fully 11 minutes to run. At the time there were only 10 sessions, and the system was performing normally.
Am I right in presuming 11 minutes is a very long time for this sort of query? If so, could you give me any idea where I should be looking next?
[EDIT: I’ve also noticed that the whole SI_METRICS section is missing from the query output! It is there on our development and test platforms, but when I run it on our production platform, it’s just missing!]
right, that is a very long time for that query – it should be a matter of seconds. did you finally get your metric information? in any case, you may need to look into your CMS database performance before looking at anything else. I would not be surprised if it is causing your connection error also.
What RDBMS is it on? Have the DBA check into it; look at the logs, cache, lock waits, etc. Is it sharing a databse server with other systems which may be causing resource bottlenecks?
I just saw your update about SI_METRICS missing… could be a serious issue. Is it missing that section for all servers, or just Webi? I’d recommend first creating a new server alongside the existing one and see if the new one is also missing that info.
We are solely a MS-SQL house, and the server is shared, although it is a very powerful clustered DB, and there is no specific load indicated on the server.
I’ll ask my DBA to look into some of the other elements of the DB.
Hi Dra4.
I was curious who you solved your issue with the “‘The property with ID SI_METRICS does not exist in the object’” error. My Web Intelligence server returns the same result when I try to look at the properties.
The other servers show their properties just fine.
If you had to rebuild it… how difficult was that?
Thanks so much for any guidance you can give.
(BOB member since 2006-07-28)
, strangley I’m beginning to wonder if these issues are linked.
(BOB member since 2003-03-20)