SlideShare uma empresa Scribd logo
1 de 5
Baixar para ler offline
Confluence performance
        testing
       how we did it
Why?
● Live and test environment crashed after release
● Functional testing did not show any problems
Target
● Make sure that our changes will not crash live
  environment again
● No intention to define performance limits of live
  environment
How?
● Tests provided by Attlassian
● JMeter
● Own shell script for setup automation
● Dedicated physical machine (not the same as in
  live)
● Same confluence configuration as in live
Performance indicators
 Indicator      Requirement                      Description


90% line     baseline + 1.5 s   Upper bound of the 90-percent confidence
                                interval of the average response time
                                (response time for 90% of requests fits below
                                given number)

Throughput baseline - 5 req/s   Number of requests per second



Error rate   0.1%               Percentage of failed requests out of total
                                requests

Mais conteúdo relacionado

Destaque

แนะนำแบบบ้านราคาประหยัด
แนะนำแบบบ้านราคาประหยัดแนะนำแบบบ้านราคาประหยัด
แนะนำแบบบ้านราคาประหยัดKamthon Sarawan
 
20150329civictechforum2015lightningtalk
20150329civictechforum2015lightningtalk20150329civictechforum2015lightningtalk
20150329civictechforum2015lightningtalkMaco Yoshioka
 
Converged data center_f_co_e_iscsi_future_storage_networking
Converged data center_f_co_e_iscsi_future_storage_networkingConverged data center_f_co_e_iscsi_future_storage_networking
Converged data center_f_co_e_iscsi_future_storage_networkingEMC
 
RSA Monthly Online Fraud Report -- December 2014
RSA Monthly Online Fraud Report -- December 2014RSA Monthly Online Fraud Report -- December 2014
RSA Monthly Online Fraud Report -- December 2014EMC
 
EMC IT's Journey to Cloud : IT PRODUCTION SERVER VIRTUALIZATION
EMC IT's Journey to Cloud : IT PRODUCTION SERVER VIRTUALIZATION EMC IT's Journey to Cloud : IT PRODUCTION SERVER VIRTUALIZATION
EMC IT's Journey to Cloud : IT PRODUCTION SERVER VIRTUALIZATION EMC
 
The art of_being_healthy
The art of_being_healthyThe art of_being_healthy
The art of_being_healthyChandan Dubey
 
White Paper: DB2 and FAST VP Testing and Best Practices
White Paper: DB2 and FAST VP Testing and Best Practices   White Paper: DB2 and FAST VP Testing and Best Practices
White Paper: DB2 and FAST VP Testing and Best Practices EMC
 
Block opp costs and free
Block opp costs and freeBlock opp costs and free
Block opp costs and freeTravis Klein
 
The drawbacks of Using Adsense
The drawbacks of Using AdsenseThe drawbacks of Using Adsense
The drawbacks of Using Adsense1joefrazier
 
White Paper: DB2 and FAST VP Testing and Best Practices
White Paper: DB2 and FAST VP Testing and Best Practices   White Paper: DB2 and FAST VP Testing and Best Practices
White Paper: DB2 and FAST VP Testing and Best Practices EMC
 
1948 creation of israel wed
1948 creation of israel wed1948 creation of israel wed
1948 creation of israel wedTravis Klein
 
Information security 2008
Information security 2008Information security 2008
Information security 2008xrayjamie79
 
Pedagogisk utprøving med ny vri
Pedagogisk utprøving med ny vriPedagogisk utprøving med ny vri
Pedagogisk utprøving med ny vrirhusem
 

Destaque (20)

แนะนำแบบบ้านราคาประหยัด
แนะนำแบบบ้านราคาประหยัดแนะนำแบบบ้านราคาประหยัด
แนะนำแบบบ้านราคาประหยัด
 
Attitude
AttitudeAttitude
Attitude
 
20150329civictechforum2015lightningtalk
20150329civictechforum2015lightningtalk20150329civictechforum2015lightningtalk
20150329civictechforum2015lightningtalk
 
Das
DasDas
Das
 
Citophobia apa
Citophobia apaCitophobia apa
Citophobia apa
 
Converged data center_f_co_e_iscsi_future_storage_networking
Converged data center_f_co_e_iscsi_future_storage_networkingConverged data center_f_co_e_iscsi_future_storage_networking
Converged data center_f_co_e_iscsi_future_storage_networking
 
RSA Monthly Online Fraud Report -- December 2014
RSA Monthly Online Fraud Report -- December 2014RSA Monthly Online Fraud Report -- December 2014
RSA Monthly Online Fraud Report -- December 2014
 
Doc1
Doc1Doc1
Doc1
 
EMC IT's Journey to Cloud : IT PRODUCTION SERVER VIRTUALIZATION
EMC IT's Journey to Cloud : IT PRODUCTION SERVER VIRTUALIZATION EMC IT's Journey to Cloud : IT PRODUCTION SERVER VIRTUALIZATION
EMC IT's Journey to Cloud : IT PRODUCTION SERVER VIRTUALIZATION
 
The art of_being_healthy
The art of_being_healthyThe art of_being_healthy
The art of_being_healthy
 
We are at
We are atWe are at
We are at
 
White Paper: DB2 and FAST VP Testing and Best Practices
White Paper: DB2 and FAST VP Testing and Best Practices   White Paper: DB2 and FAST VP Testing and Best Practices
White Paper: DB2 and FAST VP Testing and Best Practices
 
Block opp costs and free
Block opp costs and freeBlock opp costs and free
Block opp costs and free
 
The drawbacks of Using Adsense
The drawbacks of Using AdsenseThe drawbacks of Using Adsense
The drawbacks of Using Adsense
 
White Paper: DB2 and FAST VP Testing and Best Practices
White Paper: DB2 and FAST VP Testing and Best Practices   White Paper: DB2 and FAST VP Testing and Best Practices
White Paper: DB2 and FAST VP Testing and Best Practices
 
1948 creation of israel wed
1948 creation of israel wed1948 creation of israel wed
1948 creation of israel wed
 
Information security 2008
Information security 2008Information security 2008
Information security 2008
 
Pedagogisk utprøving med ny vri
Pedagogisk utprøving med ny vriPedagogisk utprøving med ny vri
Pedagogisk utprøving med ny vri
 
50 states
50 states50 states
50 states
 
Auschwitz Speech
Auschwitz SpeechAuschwitz Speech
Auschwitz Speech
 

Semelhante a Confluence performance testing

Exploring No Mans Land with Keyword-Driven Testing
Exploring No Mans Land with Keyword-Driven TestingExploring No Mans Land with Keyword-Driven Testing
Exploring No Mans Land with Keyword-Driven TestingMartinGijsen
 
Vijay & Supriya - Test your service not your ui
Vijay & Supriya - Test your service not your uiVijay & Supriya - Test your service not your ui
Vijay & Supriya - Test your service not your uivodQA
 
Agile Australia Conference 2011 - Devops live accounts- continuous delivery_st
Agile Australia Conference 2011 - Devops live accounts- continuous delivery_stAgile Australia Conference 2011 - Devops live accounts- continuous delivery_st
Agile Australia Conference 2011 - Devops live accounts- continuous delivery_stNish Mahanty
 
JMeter - Performance testing your webapp
JMeter - Performance testing your webappJMeter - Performance testing your webapp
JMeter - Performance testing your webappAmit Solanki
 
Brave New World - A wider perspective of our opportunities
Brave New World - A wider perspective of our opportunitiesBrave New World - A wider perspective of our opportunities
Brave New World - A wider perspective of our opportunitiesJayathirtha Rao
 
Continuous Performance Testing
Continuous Performance TestingContinuous Performance Testing
Continuous Performance TestingMark Price
 
Designing apps for resiliency
Designing apps for resiliencyDesigning apps for resiliency
Designing apps for resiliencyMasashi Narumoto
 
The Key to DevOps? Testing Early in the Pipeline
The Key to DevOps? Testing Early in the PipelineThe Key to DevOps? Testing Early in the Pipeline
The Key to DevOps? Testing Early in the PipelineDevOps.com
 
Soft quality & standards
Soft quality & standardsSoft quality & standards
Soft quality & standardsPrince Bhanwra
 
Soft quality & standards
Soft quality & standardsSoft quality & standards
Soft quality & standardsPrince Bhanwra
 
Database Unit Testing Made Easy with VSTS
Database Unit Testing Made Easy with VSTSDatabase Unit Testing Made Easy with VSTS
Database Unit Testing Made Easy with VSTSSanil Mhatre
 
Using ai and automation to build resiliency into azure dev ops
Using ai and automation to build resiliency into azure dev opsUsing ai and automation to build resiliency into azure dev ops
Using ai and automation to build resiliency into azure dev opsRob Jahn
 
TMPA-2017: Regression Testing with Semiautomatic Test Selection for Auditing ...
TMPA-2017: Regression Testing with Semiautomatic Test Selection for Auditing ...TMPA-2017: Regression Testing with Semiautomatic Test Selection for Auditing ...
TMPA-2017: Regression Testing with Semiautomatic Test Selection for Auditing ...Iosif Itkin
 
[webinar] Cutting-edge Functional UI Testing Techniques - w/ Adam Carmi
[webinar] Cutting-edge Functional UI Testing Techniques - w/ Adam Carmi[webinar] Cutting-edge Functional UI Testing Techniques - w/ Adam Carmi
[webinar] Cutting-edge Functional UI Testing Techniques - w/ Adam CarmiApplitools
 
Issre2014 test defectprediction
Issre2014 test defectpredictionIssre2014 test defectprediction
Issre2014 test defectpredictionKim Herzig
 

Semelhante a Confluence performance testing (20)

Exploring No Mans Land with Keyword-Driven Testing
Exploring No Mans Land with Keyword-Driven TestingExploring No Mans Land with Keyword-Driven Testing
Exploring No Mans Land with Keyword-Driven Testing
 
Chapter 10
Chapter 10Chapter 10
Chapter 10
 
Vijay & Supriya - Test your service not your ui
Vijay & Supriya - Test your service not your uiVijay & Supriya - Test your service not your ui
Vijay & Supriya - Test your service not your ui
 
Agile Australia Conference 2011 - Devops live accounts- continuous delivery_st
Agile Australia Conference 2011 - Devops live accounts- continuous delivery_stAgile Australia Conference 2011 - Devops live accounts- continuous delivery_st
Agile Australia Conference 2011 - Devops live accounts- continuous delivery_st
 
JMeter - Performance testing your webapp
JMeter - Performance testing your webappJMeter - Performance testing your webapp
JMeter - Performance testing your webapp
 
Brave New World - A wider perspective of our opportunities
Brave New World - A wider perspective of our opportunitiesBrave New World - A wider perspective of our opportunities
Brave New World - A wider perspective of our opportunities
 
Continuous Performance Testing
Continuous Performance TestingContinuous Performance Testing
Continuous Performance Testing
 
Designing apps for resiliency
Designing apps for resiliencyDesigning apps for resiliency
Designing apps for resiliency
 
The Key to DevOps? Testing Early in the Pipeline
The Key to DevOps? Testing Early in the PipelineThe Key to DevOps? Testing Early in the Pipeline
The Key to DevOps? Testing Early in the Pipeline
 
Soft quality & standards
Soft quality & standardsSoft quality & standards
Soft quality & standards
 
Soft quality & standards
Soft quality & standardsSoft quality & standards
Soft quality & standards
 
Database Unit Testing Made Easy with VSTS
Database Unit Testing Made Easy with VSTSDatabase Unit Testing Made Easy with VSTS
Database Unit Testing Made Easy with VSTS
 
Using ai and automation to build resiliency into azure dev ops
Using ai and automation to build resiliency into azure dev opsUsing ai and automation to build resiliency into azure dev ops
Using ai and automation to build resiliency into azure dev ops
 
TMPA-2017: Regression Testing with Semiautomatic Test Selection for Auditing ...
TMPA-2017: Regression Testing with Semiautomatic Test Selection for Auditing ...TMPA-2017: Regression Testing with Semiautomatic Test Selection for Auditing ...
TMPA-2017: Regression Testing with Semiautomatic Test Selection for Auditing ...
 
Testing in agile
Testing in agileTesting in agile
Testing in agile
 
Chapter 7 - Verifying the TAS
Chapter 7 - Verifying the TASChapter 7 - Verifying the TAS
Chapter 7 - Verifying the TAS
 
Software Testing
Software Testing Software Testing
Software Testing
 
[webinar] Cutting-edge Functional UI Testing Techniques - w/ Adam Carmi
[webinar] Cutting-edge Functional UI Testing Techniques - w/ Adam Carmi[webinar] Cutting-edge Functional UI Testing Techniques - w/ Adam Carmi
[webinar] Cutting-edge Functional UI Testing Techniques - w/ Adam Carmi
 
Issre2014 test defectprediction
Issre2014 test defectpredictionIssre2014 test defectprediction
Issre2014 test defectprediction
 
Machine centered for noria louisville 07
Machine centered for noria louisville 07Machine centered for noria louisville 07
Machine centered for noria louisville 07
 

Mais de Aleksandr Zhuikov

Mais de Aleksandr Zhuikov (6)

Git glossary
Git glossaryGit glossary
Git glossary
 
Ja coco ignite
Ja coco igniteJa coco ignite
Ja coco ignite
 
Jsr 303
Jsr 303Jsr 303
Jsr 303
 
Client+server side bean validation
Client+server side bean validationClient+server side bean validation
Client+server side bean validation
 
Titanium
TitaniumTitanium
Titanium
 
Running Selenium tests on CI server
Running Selenium tests on CI serverRunning Selenium tests on CI server
Running Selenium tests on CI server
 

Confluence performance testing

  • 1. Confluence performance testing how we did it
  • 2. Why? ● Live and test environment crashed after release ● Functional testing did not show any problems
  • 3. Target ● Make sure that our changes will not crash live environment again ● No intention to define performance limits of live environment
  • 4. How? ● Tests provided by Attlassian ● JMeter ● Own shell script for setup automation ● Dedicated physical machine (not the same as in live) ● Same confluence configuration as in live
  • 5. Performance indicators Indicator Requirement Description 90% line baseline + 1.5 s Upper bound of the 90-percent confidence interval of the average response time (response time for 90% of requests fits below given number) Throughput baseline - 5 req/s Number of requests per second Error rate 0.1% Percentage of failed requests out of total requests