Apache jMeter - performance/stress testing

Hi,

Anyone wanted to share their experience with performance/stress testing of BO BI 4.0/4.1 using Apache jMeter?

Thank you.


Marek Chladny :slovakia: (BOB member since 2003-11-27)

Hi Marek -

We haven’t used JMeter (we’ve built our own performance testing instrumentation), however, this is a great link by James Rapp about his setup and experience of it - not sure if you’ve read, but in case:

http://scn.sap.com/docs/DOC-45507

http://wiki.scn.sap.com/wiki/display/BOBJ/Creating+your+First+Test+Plan

http://wiki.scn.sap.com/wiki/display/BOBJ/Description+of+JMeter+core+components


Atul Chowdhury (BOB member since 2003-07-07)

Hi Atul,

After I posted my post here, I found those blogs on SCN :slight_smile: But I appreciate your response :+1:

Thanks


Marek Chladny :slovakia: (BOB member since 2003-11-27)

This is an old post but i wanted to find if others have done recent Jmeter performance bench-marking against SAP BOE4.2 (latest). After much headaches i found out a few gotchas on syntax adjustments. The SCN page is way old using BOE4.0 and 4.1.

I will attach my latest (simple) working Jmeter Webi Test plan (Login / Nav Launchpad / Open Webi rpt / Logout) in exchange for any guidance and or field experience doing load testing or bench marking. My real ultimate goal is to use Jmeter to validate Sizing and Tuning with SAP BOE 4.2 (mostly Webi for now).

Angel
Webi Login & Repoirt Refresh Test Plan3 - Copy.txt (363.0 KB)


angelsd1 :us: (BOB member since 2005-10-21)

I am not able to open your jmx file in Jmeter for some reason, maybe some plugins which I do not have.

I was able to create a test plan for 4.2 SP05

  1. Login (Once only controller)
  2. Navigate BI Launchpad (Transaction controller)
  3. View and Refresh Webi report (Loop controller)
  4. Log off (Once only controller)

Of course there are extractors in between (sunfaces and bttoken), but I didn’t include portal id extractor since I just want to test it out once

  1. When I run this for multiple users all looks good, in Summary Report there are no errors
  2. As soon as I increase Ramp-up seconds Navigate and View/Refresh show 50 % success ALWAYS
  3. For some reason Perfmon graph is not showing results properly when CPU and Memory is added (Maybe I am missing something in metric parameter)
  4. I tried to see if I am able to replicate and load test scheduling, everything is green in View Test Results but I don’t see any instances for the report

ViR2 (BOB member since 2018-05-09)

It is just a test file. If you rename it with a .jmx extention; you can open it on jMeter. Btw; the Debug Sampler, in HTML read mode will give you a good idea of what the virtual logins are doing. For the PerfMons; i am assuming that you are running the HOST plugin needed to read OS level Perfs.

Good luck.

Angel


angelsd1 :us: (BOB member since 2005-10-21)

Yes, I did rename it to jmx. In fact I removed all perfmon and visual related objects from the file as well. Nevermind though … Just wanted to know what is your result status for this test plan when you have 10 threads(users) and 20 ramp-up second and have 2 loops for execution

For some reason I am getting 50% error


ViR2 (BOB member since 2018-05-09)

I was getting that before i renamed the target Webi report. Each systemn will have a different “id” target in jmeter which corresponds to the GUID i believe.

Angel


angelsd1 :us: (BOB member since 2005-10-21)

My problem at the moment is this:

I can generally run jMeter against BOE4.2 SP5 for simulated user logins, navigation; open and refresh a Webi report; and logout. All is good.

I am doing an Apache “Split” - fronting Apache Web server to tomcat as per various references on this forum, etc. The split works fine on 4.2 with Apche 2.4 and jk_mod on Windows.

When i try to run the jMeter working test plan; my run breaks with errors like:
“The requested URL /BOE/portal/0/InfoView/js/utils.js was not found on this server” …

Because the “split” is placing static content on the Apache side; i suspect the jmeter portal_id [(\d+)] extraction happening for 4.2 is wrong.

Has anyone run into this?


angelsd1 :us: (BOB member since 2005-10-21)

What happens if you do not use portal id extractor ?


ViR2 (BOB member since 2018-05-09)

Hi angelsd1,

How did you build/write the jmx file that you shared in one of your previous posts? Was the file generated by some tool or did you write it yourself? I am just trying to understand how to start using JMeter with Business Objects. I have no previous experience with JMeter.


Marek Chladny :slovakia: (BOB member since 2003-11-27)

Sorry; I have been offline for a while. I created the first basic workflow using the jmeter HTTP Recorder (in proxy mode). There are various pretty good references around to get you started. Once I had the basics; i edited and adjusted for my environment. BOE42 has some fine grain deltas but the basic script works. See my attached version now. Simply change the IP/port and the Test Webi ID and you could prob run as is on a Windows jmeter / BO setup. Try to run jmeter off the server so it does not affect locally your CPU amd RAM readings. Also; command line work better than GUI i hear but i didnot have an issue with GUI for basic runs.

Ang
Webi Login & Repoirt Refresh Test Plan.txt (235.0 KB)


angelsd1 :us: (BOB member since 2005-10-21)

Here is my cheat sheet reference:

SAP BI Load Testing
https://wiki.scn.sap.com/wiki/display/BOBJ/Deploying+the+Pattern

Business Intelligence (BusinessObjects)
BI Platform 4.x Performance Testing Pattern Book
https://wiki.scn.sap.com/wiki/display/BOBJ/Architecture

To install Apache JMeter
https://wiki.scn.sap.com/wiki/display/BOBJ/Introduction+to+Apache+JMeter
https://wiki.scn.sap.com/wiki/display/BOBJ/1st+Time+Setup+of+JMeter?original_fqdn=wiki.sdn.sap.com

jmeter Test Plans
https://wiki.scn.sap.com/wiki/display/BOBJ/Final+Configuration+Components
https://wiki.scn.sap.com/wiki/display/BOBJ/View+Report+Transaction
https://wiki.scn.sap.com/wiki/display/BOBJ/Creating+your+First+Test+Plan?original_fqdn=wiki.sdn.sap.com
4.2 bttpken issue

https://archive.sap.com/documents/docs/DOC-45507


angelsd1 :us: (BOB member since 2005-10-21)