Towards efficient measuring of web services API coverage

In this paper, we present a tool supported approach to perform efficient regression testing of web services. Functional and non-functional web service testing is done with the help of WSDL parsing and regression testing is performed by identifying the changes made thereafter. We identify, categorize, and capture the web service regression testing needs into three different categories, namely, changes in WSDL, changes in code, and selective re-testing of web service operations. To capture above three changes we proposed three intermediate forms of WSDL, namely, Difference WSDL (DWSDL), Unit WSDL (UWSDL), and Reduced WSDL (RWSDL), respectively. These intermediate forms of WSDLs are then combined to form Combined WSDL (CWSDL) which is further used for regression testing of the web service. This approach is prototyped as a tool, named as Automatic Web Service Change Management (AWSCM), which helps in performing the efficient regression testing of web services by selecting the relevant test cases to constructing reduced test suite from the old test suite file of SoapUI. The reduction in the effort for regression testing of web service is estimated by two proposed cost metrics. We present three case studies demonstrating the applicability of the proposed tool for the real world projects.

2009

Web Services (WSs) are the W3C-endorsed realization of the Service-Oriented Architecture (SOA). Since they are supposed to be implementation-neutral, WSs are typically tested black-box at their interface. Such an interface is generally specied in an XML-based notation called the WS Description Language (WSDL). Conceptually, these WSDL documents are eligible for fully automated WS test generation using syntax-based testing approaches. Towards such goal, we introduce the WS-TAXI framework, in which we combine the coverage of WS operations with data-driven test generation. In this paper we present an early-stage implementation of WS-TAXI, obtained by the integration of two existing softwares: soapUI, a popular tool for WS testing, and TAXI, an application we have previously developed for the automated derivation of XML instances from a XML schema. WS-TAXI delivers a complete suite of test messages ready for execution. Test generation is driven by basic coverage criteria and by the application of some heuristics. The application of WS-TAXI to a real case study gave encouraging results.

Web Services fall under the so-called emerg- ing technologies category and are getting more and more used for Internet applications or business transactions. Currently, there is an important need for validation tech- niques of web service based architectures. Web services, that are currently proposed into UDDI registries, are not always tested. And for most of them, no specification is provided. So, we propose in this paper, a testing method which can generate test cases only from WSDL descriptions. This method is able to check the following aspects: operation existence, exception management, and session management. We express how to generate test cases and we describe a testing framework, composed of a web service tester, which executes test cases and gives the final test verdict.

Proceedings of the twelfth ACM SIGPLAN workshop on Erlang - Erlang '13, 2013

In this work, we face the problem of generating good quality test suites and test cases for web services. We present a framework to test web services based on their formal description, following a black-box approach and using Property-Based Testing.

Asia-Pacific Services Computing Conference, 2011

Web services are the element based in SOA (i.e., Service Oriented Architecture) applications that are commonly used in software systems. However the validation problem on quality of web services via testing has to be improved. This paper presents two tools for conformance testing of web services. One tool for unit testing that is implemented by an on-line approach. This tool can be used to test a web service-based and/or an orchestration by simulating its partners. The other focuses on verification of a timed trace with respect to a set of constraints. Specially, we can use this tool to verify on-line or off-line a timed trace. Finally, we show our experiments on a real-life case study, Product Retriever, by combining the two tools.

International Conference on Next Generation Web Services Practices, 2006

As web services grow in maturity and use, so do the methods being used to test and maintain them. Although regression testing is a major component of most major testing systems, it has only begun to be applied to Web services. The majority of these tools and techniques focus on test case generation, ignoring the potential benefits of regression test selection. Regression test selection (RTS) is a mechanism for reducing the number of tests that must be rerun to ensure some level of confidence. Safe RTS techniques add an additional constraint, namely no modification revealing tests are left unselected. Since Safe RTS techniques involve white-box testing, they cannot be directly applied to Web services. We will propose a mechanism for applying a safe RTS technique to Java-based Web services in an end-to-end manner using a code transformation-based approach. Additionally, we will provide implementation details as well as an example.

IEEE International Conference on Web Services (ICWS 2007), 2007

Web services are a popular way of implementing a Service-Oriented Architecture (SOA), which has gained rapid adoption and support from leading companies in industry. Testing can be used to help assure both the correctness and robustness of a web service. Because manual testing is tedious, tools are needed to automate test generation and execution for web services. This paper presents a framework and its supporting tool for automatically generating and executing web-service requests and analyzing the subsequent request-response pairs. Given a service provider's Web Service Description Language (WSDL) specification, we first automatically generate necessary Java code to implement a client (service requestor). We then leverage automated unit test generation tools for Java to generate unit tests (including extreme, special, and random input values), and execute the generated unit tests, which in turn invoke the service under test. Finally we analyze the large number of request-response pairs from the web service invocation and identify robustness problems. We have applied our framework to freely available web services and our experiences show that we can quickly generate and execute web-service requests that may reveal robustness problems with no knowledge of the underlying web service implementation.

Web services are the element based in SOA (i.e., Service Oriented Architecture) applications that are commonly used in software systems. However the validation problem on quality of web services via testing has to be improved. This paper presents two tools for conformance testing of web services. One tool for unit testing that is implemented by an on-line approach. This tool can be used to test a web servicebased and/or an orchestration by simulating its partners. The other focuses on verification of a timed trace with respect to a set of constraints. Specially, we can use this tool to verify online or off-line a timed trace. Finally, we show our experiments on a real-life case study, Product Retriever, by combining the two tools.

2012

The web is evolving and expanding continuously and its services are getting more and more complex, public and usable. However, one of the major benefits and challenges in web services is for those services to be offered in a very useful, flexible, effective and secure way. In this paper, we will investigate web services, show their generic structure and show

Lecture Notes in Computer Science, 2013

Web services are a very popular solution to integrate components when building a software system, or to allow communication between a system and third-party users, providing a flexible, reusable mechanism to access its functionalities.