Testability Estimation of Framework Based Applications

Noopur Goel, Manjari Gupta

Department of Computer Science, Banaras Hindu University, Varanasi, India..

DOI: 10.4236/jsea.2012.511097                

Abstract

Quality of software systems is highly demanded in today’s scenario. Highly testable system enhances the reliability also. More than 50% of test effort-time and cost are used to produce a highly testable system. Thus, design-for-testability is needed to reduce the test effort. In order to enhance the quality, productivity and reduced cost of the software organizations are promoting to produce the reuse-oriented products. Incorporating reuse technology in both aspects-software development process and test process may payoff many folds. Keeping this view, our study focus the testability of the object-oriented framework based software systems and identify that flexibility at the variable points of the object-oriented framework, chosen for framework instantiation, greatly affects the testability of object-oriented framework based software at each level of testing. In the current paper, we propose a testability model considering the flexible aspect of the variable point to estimate testability in the early phase, requirement analysis phase, of development process of the framework based software. The proposed model helps to improve the testability of the software before the implementation starts thus reducing the overall development cost.

Keywords

Reuse-Technology; Variation-Points; Object-Oriented Framework Based Software; Basic Test Cases; Framework Interface Classes; Other Application Classes

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	K. Beck and R. Johnson, “Patterns Generate Architectures,” Proceedings of 8th European Conference on Object Oriented Programming, Bologna, 1994, pp. 139-149.
[2]	T. Jeon, S. Lee and H. Seung, “Increasing the Testability of Object-Oriented Frameworks with Built-In Test,” Lecture Notes in Computer Science, Vol. 2402, 2002, pp. 873-881.
[3]	G. Froehlich, H. J. Hoover, L. Liu and P. Sorenson, “Hooking into Object-Oriented Application Frameworks,” Proceedings of the 19th International Conference on Software Engineering, Boston, May 1997, pp. 491-501.
[4]	J. Al. Dallal, “Class-Based Testing of Object-Oriented Framework Interface Classes,” Ph.D. Thesis, Department of Computing Science, University of Alberta, 2003.
[5]	J. Al. Dallal and P. Sorenson, “Estimating the Coverage of the Framework Application Reusable Cluster-Based Test Cases,” Information and Software Technology, Vol. 50, No. 6, 2008, pp. 595-604. doi:10.1016/j.infsof.2007.07.006
[6]	R. V. Binder, “Design for Testability in Object-Oriented Systems,” Communications of the ACM, Vol. 37, No. 9, 1994, pp. 87-101. doi:10.1145/182987.184077
[7]	N. Fenton and S. L. Pfleeger, “Software Metrics: A Rigorous and Practical Approach,” PWS Publishing Company, Boston, 1997.
[8]	R. Bache and M. Mullerburg, “Measure of Testability as a Basis for Quality Assurance,” Software Engineering Journal, Vol. 5, No. 2, 1990, pp. 86-92. doi:10.1049/sej.1990.0011
[9]	IEEE, “IEEE Standard Glossary of Software Engineering Terminology,” IEEE CSP, New York, 1990.
[10]	ISO/IEC 9126, “Software Engineering Product Quality,” 1991.
[11]	W. Pree and H. Sikora, “Design Patterns for Object Oriented Software Development,” ICSE’97, Proceedings of the 19th International Conference on Software Engineering, Boston, 1997, pp. 663-664.
[12]	R. S. Freedman, “Testability of Software Components,” IEEE Transactions on Software Engineering, Vol. 17, No. 6, 1991, pp. 553-564.
[13]	J. M. Voas, “Pie: A Dynamic Failure-Based Technique,” IEEE Transactions on Software Engineering, Vol. 18, No. 8, 1992, pp. 717-727. doi:10.1109/32.153381
[14]	J. Voas and K. W. Miller, “Semantic Metrics for Software Testability,” Journal of Systems and Software, Vol. 20, No. 3, 1993, pp. 207-216. doi:10.1016/0164-1212(93)90064-5
[15]	J. M. Voas and K. W. Miller, “Software Testability: The New Verification,” IEEE Software, Vol. 12, No. 3, 1995, pp. 17-28. doi:10.1109/52.382180
[16]	A. Bertolino and L. Strigini, “On the Use of Testability Measures for Dependability Assessment,” IEEE Transactions on Software Engineering, Vol. 22, No. 2, 1996, pp. 97-108. doi:10.1109/32.485220
[17]	M. Bruntink and A. V. Deursen, “Predicting Class Testability Using Object-Oriented Metrics,” Proceedings of IEEE International Workshop on Source Code Analysis and Manipulation, Chicago, 15-16 September 2004, pp. 136-145. doi:10.1109/SCAM.2004.15
[18]	S. Jungmayr, “Identifying Test-Critical Dependencies,” Proceedings of IEEE International Conference on Software Maintenance, Montreal, 3-6 October 2002, pp. 404-413.
[19]	B. Baudry, Y. L. Tran and G. Sunye, “Measuring Design Testability of a UML Class Diagram,” Information and Software Technology, Vol. 47, No. 1, 2005, pp. 859-879. doi:10.1016/j.infsof.2005.01.006
[20]	S. Mouchawrab, L. C. Briand and Y. Labiche, “A Measurement Framework for Object-Oriented Software Testability,” Information and Software Technology, Vol. 47, No. 1, 2005, pp. 979-997. doi:10.1016/j.infsof.2005.09.003
[21]	Y. Wang, D. Patel, G. King, I. Court, G. Staples, M. Ross and M. Fayad, “On Built-In Test Reuse in Object-Oriented Framework Design,” ACM Computing Surveys, Vol. 32, No. 1, 2000, pp. 7-12. doi:10.1145/351936.351943
[22]	D. Ranjan and A. K. Tripathi, “Variability-Based Models for Testability Analysis of Frameworks,” Journal of Software Engineering and Applications, Vol. 3, No. 5, 2010, pp. 455-459. doi:10.4236/jsea.2010.35051
[23]	D. Ranjan and A. K. Tripathi, “Testability Models for Object-Oriented Frameworks,” Journal of Software Engineering and Applications, Vol. 3, No. 6, 2010, pp. 536-540. doi:10.4236/jsea.2010.36061
[24]	D. Ranjan and A. K. Tripathi, “Effect of Variability of a Framework upon Its Testing Effort: An Empirical Evaluation,” 5th International Conference on Computer Sciences and Convergence Information Technology, Seoul, 30 November-2 December 2010, pp. 146-151. doi:10.1109/ICCIT.2010.5711046
[25]	R. V. Binder, “Testing Object-Oriented Systems: Models, Patterns, and Tools,” Addison-Wesley Professional, 1999.
[26]	J. Al. Dallal and P. Sorenson, “System Testing for Object-Oriented Frameworks Using Hook Technology,” Proceedings of the 17th IEEE International Conference on Automated Software Engineering, Edinburgh, September 2002, pp. 231-236.
[27]	M. E. Fayad and D. C. Schmidt, “Object-Oriented Application Frameworks,” Communications of the ACM, Vol. 40, No. 10, 1997, pp. 32-38. doi:10.1145/262793.262798
[28]	T. Jeon, H. W. Seung and S. Lee, “Embedding Built-In Tests in Hot Spots of an Object-Oriented Framework,” ACM Sigplan Notices, Vol. 37, No. 8, 2002, pp. 25-34. doi:10.1145/596992.597001
[29]	J. Al-Dallal and P. Sorenson, “Reusing Class-Based Test Cases for Testing Object-Oriented Framework Interface Classes,” Journal of Software Maintenance and Evolution: Research and Practice, Vol. 17, No. 3, 2005, pp. 169-196. doi:10.1002/smr.308
[30]	W. Tsai, Y. Tu, W. Shao and E. Ebner, “Testing Extensible Design Patterns in Object-Oriented Frameworks through Scenario Templates,” Proceeding of 23rd Annual International Computer Software and Applications Conference, Phoenix, October 1999, pp. 166-171.
[31]	M. E. Fayad, Y. Wang and G. King, “Built-In Test Re- use,” In: M. E. Fayad, Ed., The Building Application Frameworks, John Wiley and Sons, Chichester, 1999, pp. 488-491.
[32]	E. Gamma, R. Helm, R. Johnson and J. M. Vlissides, “Design Patterns: Elements of Reusable Object-Oriented Software,” Addison-Wesley Professional Computing Series, 1994.
[33]	A. Tevanlinna, J. Taina and R. Kauppinen, “Product Family Testing: A Survey,” ACM Sigsoft Software Engineering Notes, Vol. 29, No. 2, 2004, pp. 12-18. doi:10.1145/979743.979766
[34]	J. Al. Dallal and P. Sorenson, “Testing Software Assets of Framework-Based Product Families during Application Engineering Stage,” Journal of Software, Vol. 3, No. 5, 2008, pp. 11-25.
[35]	R. Kauppinen, J. Taina and A. Tevanlinna, “Hook and Template Coverage Criteria for Testing Framework- Based Software Product Families,” Proceedings of the International Workshop on Software Product Line Testing, Boston, 2004, pp. 7-12.
[36]	B. Meyer, “Applying Design by Contract,” IEEE Computer, Vol. 25, No. 10, 1992, pp. 40-51. doi:10.1109/2.161279
[37]	G. Froehlich, “Hooks: An Aid to the Reuse of Object-Oriented Frameworks,” Ph.D. Thesis, University of Alberta, Department of Computing Science, Edmonton 2002.
[38]	N. Goel, A. K. Tripathi and M. Gupta, “Hook_Test: An Aid to the Hook-Driven Test-First Development of Framework Based Application,” Accepted for publication in International Journal of Computer Science Issues.