This post is to explain the reading of the Tsung reports generate by the Tsung benchmarking tool as shown in my last post.
Below are the screen shots of the reports which Tsung has generate:
Next these are Tsung reports based in graphical description:
Lastly, these are the explanation of the reports which can give the testers some ideas or guidelines on what was going on during the testing.
Reading the report
Network Throughput
The size received and size sent are measured on the ethernet packets sent or received on each hosts during the test.
The size received and size sent are measured on the ethernet packets sent or received on each hosts during the test.
Counters Statistics
The highest rate is the computation of the average of rate every 10 secs. The highest rate is the maximum value for all these estimations.
The Max value for the counter statistics are refering to the number of simultaneous connected users and simultaneous alive users.
The users_count is the number of users created and finished_user_count is the total number of users who complete the test.
Http Response code
Status-Code =
"100" ; Section 10.1.1: Continue
| "101" ; Section 10.1.2: Switching Protocols
| "200" ; Section 10.2.1: OK
| "201" ; Section 10.2.2: Created
| "202" ; Section 10.2.3: Accepted
| "203" ; Section 10.2.4: Non-Authoritative Information
| "204" ; Section 10.2.5: No Content
| "205" ; Section 10.2.6: Reset Content
| "206" ; Section 10.2.7: Partial Content
| "300" ; Section 10.3.1: Multiple Choices
| "301" ; Section 10.3.2: Moved Permanently
| "302" ; Section 10.3.3: Found
| "303" ; Section 10.3.4: See Other
| "304" ; Section 10.3.5: Not Modified
| "305" ; Section 10.3.6: Use Proxy
| "307" ; Section 10.3.8: Temporary Redirect
| "400" ; Section 10.4.1: Bad Request
| "401" ; Section 10.4.2: Unauthorized
| "402" ; Section 10.4.3: Payment Required
| "403" ; Section 10.4.4: Forbidden
| "404" ; Section 10.4.5: Not Found
| "405" ; Section 10.4.6: Method Not Allowed
| "406" ; Section 10.4.7: Not Acceptable
| "407" ; Section 10.4.8: Proxy Authentication Required
| "408" ; Section 10.4.9: Request Time-out
| "409" ; Section 10.4.10: Conflict
| "410" ; Section 10.4.11: Gone
| "411" ; Section 10.4.12: Length Required
| "412" ; Section 10.4.13: Precondition Failed
| "413" ; Section 10.4.14: Request Entity Too Large
| "414" ; Section 10.4.15: Request-URI Too Large
| "415" ; Section 10.4.16: Unsupported Media Type
| "416" ; Section 10.4.17: Requested range not satisfiable
| "417" ; Section 10.4.18: Expectation Failed
| "500" ; Section 10.5.1: Internal Server Error
| "501" ; Section 10.5.2: Not Implemented
| "502" ; Section 10.5.3: Bad Gateway
| "503" ; Section 10.5.4: Service Unavailable
| "504" ; Section 10.5.5: Gateway Time-out
| "505" ; Section 10.5.6: HTTP Version not supported
| extension-code
Main Statistics
Connect is the duration of the connection establishment
Request is the response time for each requests
Page is Response time for each set of requests (a page is a group of request not separated by a thinktime)
Session is the duration of a user session
Error Connection
Error connection is calculate every 10 secs. Below is an example
Name Highest Rate Total Number
Connect is the duration of the connection establishment
Request is the response time for each requests
Page is Response time for each set of requests (a page is a group of request not separated by a thinktime)
Session is the duration of a user session
Error Connection
Error connection is calculate every 10 secs. Below is an example
Name Highest Rate Total Number
Error connection timeout 2/sec 68
For every 10 sec, tsung will dump all its counters for calculation. Therefore the explanation for Highest rate is throughout the whole session,for 10 secs, maximum of timeout found is 2 per second.
this post does useful. thanks!
ReplyDeleteThanks
ReplyDeleteHello Chong ming,
ReplyDeleteBlog is neatly written and very full. However, I need to understand "Counter Statics" in the report, and I am interested in knowing
1. Total concurrent Users
2. Total requests made
3. Total successful and total failed requests.
How Can I pull these values from the reports?
Thanks,
Ajay
This comment has been removed by the author.
DeleteHello. I am very new to load testing. I want to do Performance Analysis of a messaging server for an enterprise application which uses XMPP. I want to test the performance during login, chat sessions, presence service notifications, etc., when under load. Tsung seems to be an apt tool for my requirements.
ReplyDeleteI am not able to completely analyse the results (both graphical and statistical) that I have obtained. I have referred the Tsung documentation and other websites. But I still have few queries. Could someone please help me with this??
Here are log details from ‘connect.txt’. This load is generated for max 100 users with arrivalphase of 1min and interarrival of 0.5second.
0 1.3 0.8100961538461539 0.3003341117366558 1.364990234375 0.566162109375 0 0
10 2.3 1.0076851222826086 0.28226948557783504 1.384033203125 0.55517578125 0.8100961538461539 13
20 1.5 0.9711100260416666 0.2764732010730768 1.384033203125 0.5380859375 0.9363335503472222 36
30 2.2 1.1567937677556817 0.36105147083378225 1.93896484375 0.5380859375 0.9465619255514706 51
40 1.4 0.9898332868303571 0.2942442039408825 1.93896484375 0.5380859375 1.0099194670376712 73
50 1.3 1.0449969951923077 0.28618096652614605 1.93896484375 0.5380859375 1.0066872081537357 87
60 0 0 0 1.93896484375 0.5380859375 1.01166748046875 100
70 0 0 0 1.93896484375 0.5380859375 1.01166748046875 100
80 0 0 0 1.93896484375 0.5380859375 1.01166748046875 100
90 0 0 0 1.93896484375 0.5380859375 1.01166748046875 100
100 0 0 0 1.93896484375 0.5380859375 1.01166748046875 100
110 0 0 0 1.93896484375 0.5380859375 1.01166748046875 100
111 0 0 0 1.93896484375 0.5380859375 1.01166748046875 100
Main Statistics:
Name: connect
highest 10sec mean: 1.16msec
lowest 10sec mean: 0.971msec
Highest Rate: 2.3/sec
Mean rate: 0.73/sec
Mean: 1.01msec
Count: 100
Now consider the data line for 20seconds. As per ‘stats.conf’, ‘connect’ is of type ‘sample’ and the format is:
name: connect;
count (during the last10sec): 1.5;
mean: 0.9711100260416666;
stddev: 0.2764732010730768;
max: 1.384033203125;
min: 0.5380859375;
globalmean: 0.9363335503472222;
globalcount: 36;
1) What is count exactly? I can tell that (using globalcount) from 0-10 sec 13 users were connected. From 10-20 sec 23 more users were connected. But what is count representing?
2) mean is calculated every 10 sec. But what is globalmean? How is it calculated?
3) max and min are representing maximum and minimum of what ?
4) How is Mean Rate calculated in Main Statistics table?
5) As per the log file, lowest 10sec mean must be 0.81. But why is it 0.97msec in Main Statistics table?
Any pointers or directions will be really helpful!!!
Thanks and Regards