A Framework for Managing Software Testing Outsourcing Projects

F. F. Ismail, R. Razali


Software testing aims to ensure that the software produced is reliable and able to function correctly. In order to do so, the testing execution requires experts and technology that might not be available within an organisation. Therefore, shifting to outsourcing for testing is one preferred option. This alternative provides benefits such as testing expertise, costs and time reduction, better testing technology and high-quality software products. Translating these benefits into practice has, however, proved challenging. Some testing outsourcing projects have failed outright. These projects either exceed the specified time or the allocated budget or failed to deliver the anticipated quality. This paper therefore intends to address this concern by providing guidance in managing software testing outsourcing projects in the form of a framework based on identified success factors. Previous studies have collected the success factors from theoretical and empirical perspectives. The investigation continues by ratifying the factors via software testing and project management experts from both the client and vendor sides. In order to develop the framework, this study adopted a qualitative approach, in which semi-structured interviews were employed to confirm the factors. The data were then analysed using content analysis. The framework consists of two aspects, namely People and Process. Four factors make up the People aspect, while another ten constitute the Process aspect. Each factor contains elements, which represent either the roles that should be played or activities that should be conducted. This framework contributes to the understanding of conducting successful software testing outsourcing projects. It could also act as a reference for future research in the software testing domain.


Outsourcing; Project Management; Software Testing;

Full Text:



Y. Lu, and T. Käkölä, “A dynamic life-cycle model for the provisioning of software testing services : experiences from a case study in the chinese ict sourcing market,” in The 19th European Conf. on Information Systems (ECIS) 2011 Proc., 2011, pp. 48–59.

A. Bertolino, and I. A. Faedo, “Software testing research: achievements, challenges, dreams,” in Future of Software Engineering, 2007 (FOSE '07), 2007, pp. 85-103.

A. M. Ahmed, and W. Zhu, “Outsourcing software testing activities: a case study for eastern ocean solutions (eos) — china,” in 2011 IEEE 3rd Int. Conf. Commun. Softw. Networks (ICCSN), 2011, pp. 742–744.

I. Tervonen, A. Haapalahti, L. Harjumaa, and J. Simila, “Outsourcing software testing: a case study in the oulu area,” in 2013 13th Int. Conf. Qual. Softw. (QSIC), 2013, pp. 65–74.

K. Karhu, O. Taipale, and K. Smolander, “Outsourcing and knowledge management in software testing,” in EASE'07 Proc. of the 11th Int. Conf. on Evaluation and Assessment in Softw. Engineering, 2007, pp. 53-63.

R. S. Poston, J. C. Simon, and R. Jain, “Managing offshore outsourcing of software testing,” Available at https://umdrive.memphis.edu/gmis/www/memphis/step/documents/pa pers/PostonR.step-07.pdf (downloaded02.01.2014).

B. Nicholson, and S. Sahay, “Some political and cultural issues in the globalisation of software development : Case experience from britain and india,” Inf. Organ., vol. 11, no 1, pp. 25–43, Jan 2001.

S. Ullah, M. Niazi, and R. Ahmad, “Factors influencing clients in the selection of offshore software outsourcing vendors : An exploratory study using a systematic literature review,” J. Syst. Softw., vol. 84, no. 4, pp. 686–699, Apr. 2011.

A. U. Alam, and K. U. Siffat, “Knowledge sharing management in offshore software development outsourcing relationships from vendors’ perspective : A systematic literature review protocol,” in 2011 5th Malaysian Conf. Softw. Eng., 2011, pp. 469–474.

A. Yalaho, and N. Nahar, “Key success factors for managing offshore outsourcing of software production using the ICT-supported unified process model: a case experience from Finland, India, Nepal and Russia,” in 2010 Proc. Technol. Manag. Glob. Econ. Growth (PICMET), 2010, pp. 1–14.

R. Hanna, and T. Daim, “Critical success factors in outsourcing: case of software industry,” in Manag. Eng. Technol. Portl. Int. Cent., 2007, pp. 1456 – 1465.

H. Shah, S. Sinha, and M. J. Harrold, “Outsourced, offshored softwaretesting practice: Vendor-side experiences,” in 2011 IEEE Sixth Int. Conf. Glob. Softw. Eng., 2011, pp. 131–140.

O. Taipale, K. Karhu, and K. Smolander, “Observing software testing practice from the viewpoint of organizations and knowledge management,” in First Int. Symp. Empir. Softw. Eng. Meas. (ESEM 2007), 2007, pp. 21–30.

Z. Pei, Z. Zhen-xiang, and H. Chun-ping, “A framework for it outsourcing decision process,” in Serv. Syst. Serv. Manag., 2008, pp. 1–4.

B. Aubert, J.-F. Houde, M. Patry, and S. Rivard, “Characteristics of it outsourcing contracts,” in Proc. 36th Hawaii Int. Conf. Syst. Sci., 2003, pp. 1–9.

F. F. Ismail, and R. Razali, “Contributing factors of successful software testing outsourcing,” in 2014 8th Malaysian Softw. Eng. Conf., 2014, pp. 55–60.

F. F. Ismail, and R. Razali, “A qualitative empirical investigation of contributing success factors for software testing outsourcing projects,” J. Teknol. Science Eng., vol. 77, no. 9, pp. 97–114, 2015.

H. Shah, S. Sinha, and M. J. Harrold, “Studying the influence of culture on outsourced, offshored software-testing practice: an ethnographic approach,” in 2011 IEEE Sixth Int. Conf. Glob. Softw. Eng. Work. (ICGSEW), 2011, pp. 105–107.

R. P. Jain, R. S. Poston, and J. C. Simon, “An empirical investigation of client managers’ responsibilities in managing offshore outsourcing of software-testing projects,” IEEE Trans. Eng. Manag., vol. 58, no. 4, pp. 743–757, Nov. 2011.

I. Tervonen, “Offshoring test automation : observations and lessons learned,” in 2009 Fourth IEEE Int. Conf. Glob. Softw. Eng. Offshoring, 2009, pp. 226-235.

W. K. Abdul and U. K. Siffat, “Critical success factors for offshore software outsourcing contract management from vendors’ perspective: an exploratory study using a systematic literature review,” IET Softw., vol. 7, no. 6, pp. 327–338, Dec. 2013.

T. Herath and R. Kishore, “Offshore outsourcing: risks, challenges, and potential solutions,” Inf. Syst. Manag., vol. 26, no. 4, pp. 312–326, Oct. 2009.

S. P. Frank, T. Ossi, and K. Smolander, “Organizational and customer related challenges of software testing: an empirical study in 11 software companies,” in 2014 IEEE Eighth Int. Conf. Res. Challenges Inf. Sci. (RCIS), 2014, pp. 1–12.

C. Clott, “An uncertain future: a preliminary study of offshore outsourcing from the manager’s perspective,” Manag. Res. News, vol. 30, no. 7, pp. 476–494, June 2007.

L. M. Abdullah and J. M. Verner, “Analysis and application of an outsourcing risk framework,” J. Syst. Softw., vol. 85, no. 8, pp. 1930– 1952, Aug. 2012.

R. T. Nakatsu and C. L. Iacovou, “A comparative study of important risk factors involved in offshore and domestic outsourcing of software development projects: a two-panel delphi study,” Inf. Manag., vol. 46, no. 1, pp. 57–68, Jan. 2009.

S. U. Khan, M. Niazi, and R. Ahmad, “Critical barriers for offshore software development outsourcing vendors: a systematic literature review,” in 2009 16th Asia-Pacific Softw. Eng. Conf., 2009, pp. 79–86.

A. Ghag, “Case study : testing for utilities sector,” in Rightshore!, W. Messner, A. Hendel, and F. Thun, Eds. Springer Berlin Heidelb., 2008, pp. 187–201.

E. Lamas, L. A. V. Dias, and A. M. Da Cunha, “Applying testing to enhance software product quality,” in 2013 10th Int. Conf. Inf. Technol. New Gener (ITNG), 2013, pp. 349–356.

N. Iqbal and M. R. J. Qureshi, “Improvement of key problems of software testing in quality assurance,” Sci. Int., vol. 21, no. 1, pp. 25– 28, Mar. 2009.

A. Sanz, J. García, J. Saldaña, and A. Amescua, “A proposal of a process model to create a test factory,” in Proc. Int. Conf. Softw. Eng., 2009, pp. 65–70.

B. S. Andaloussi, and A. Braun, “A test specification method for software interoperability tests in offshore scenarios : a case study,”in IEEE Int. Conf. Glob. Softw. Eng., 2006, pp. 169-178.

L. Baresi, and M. Pezze, “An introduction to software testing,” Electron. Notes Theor. Comput. Sci., vol. 148, no. 1, pp. 89–111, 2006.

C. Kaner, “An outline for software testing outsourcing,” Available at http://www.kaner.com/pdfs/outsource.pdf (downloaded 02.01.2014), 2000.

N. Oza, T. Hall, A. Rainer, and S. Grey, “Critical factors in software outsourcing: a pilot study,” in ACM Work. Interdiscip. Softw. Eng. Res. WISER 2004, 2004, pp. 67–71.

M. Choi, M. Brand, and J. Kim, “A feasibility evaluation on the outsourcing of quality testing and inspection,” Int. J. Proj. Manag., vol. 27, no. 1, pp. 89–95, Jan 2009.

P. T. Nguyen, M. A. Babar, and J. M. Verner, “Critical factors in establishing and maintaining trust in software outsourcing relationships,” in ICSE’06 Proc. 28th Int. Conf. Softw. Eng., 2006, pp. 624–627.

M. Niazi, S. U. Khan, S. Imtiaz, M. Bano, and N. Ikram, “Establishing trust in offshore software outsourcing relationships: An exploratory study using a systematic literature review,” IET Softw., vol. 7, no. 5, pp. 283–293, Oct. 2013.

F. Li, and W. Ma, “Architecture centric approach to enhance software testing management,” in Eighth Int. Conf. on Intelligent Systems Design and Applications, 2008. ISDA'08., 2008, pp. 654-659.

U. Flick, “An introduction to qualitative research,” in An Introduction to Qualitative Research, 4th ed., London: SAGE Publications, Jan 2010.

K. Krippendorff, “Component of content analysis,” in Content Analysis: An Introduction to its Methodology. Los Angeles: SAGE Publication, 2013.

D. Elfriede, “Efective software testing, ” in 50 Specific Ways to Improve Your Testing, Canada : Pearson Education, Inc, 2003.

R. Black, “Testing throughout the software life cycle,” in Foundations of software Testing: ISTQB certification, United Kingdom: Cenange Learning, 2015.


  • There are currently no refbacks.

Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.

ISSN: 2180-1843

eISSN: 2289-8131