This is my attempt to compare the various SOA testing tools in the market. Please feel free to provide your suggestions or comments.
|
Sr No |
Features | Crosscheck Networks SOAPSonar 3.0.5 | iTKO LISA 3.6e | Mindreef SOAPscope (Progress Actional) | Parasoft SOAtest 5.1 | Rational Service Tester | Greenhat (Rational Test Workbench) | SOAP UI Pro |
|
1 |
Learning curve | Medium | Medium | Simple | Medium | Simple | Medium | Simple |
|
2 |
Simple Navigation | Y | Y | Y | Y | Y | Y | Y |
|
3 |
Dynamic Data Population | Y | Y | Y | Y | Y | Supported in GH Performance (Rational Performance Test Server) | Y |
|
4 |
Project Save, Merge, Import, and Export (allows Team Project Sharing) | Y | Y | Y | Y | Y | Y | Y |
|
5 |
WSDL Merge (services, operations, XSD schema) | Y | X | X | X | X | X | X |
|
6 |
Clone Test Suites, Test Groups, Test Cases, Test Settings | Y | Y | Y | Y | Y | Y | Y |
|
7 |
Run Test Suites from HP Quality Center | Y | Y | X | Y | X | Y | X |
|
8 |
WSDL Operation Response/Request Chaining | Y | Y | Y | Y | Y | Y | Y |
|
9 |
WS-Security and Identity Management | Digital Signature, Encryption, Username, X509, SAML, Kerberos | Y | Y | Y | Y | Y | Y |
|
10 |
SOAP with Attachments (DIME and MIME) | Y | Y | Y | Y | Y | ||
|
11 |
WS-Addressing | Y | Y | X | Y | Y | Y | Y |
|
12 |
XSL Transformation | Y | X | X | X | X | X | |
|
13 |
Design Time WSI-BP 1.1 Compliance | Y | Y | Y | Y | X | Y | Y |
|
14 |
Report generation | PDF, XML, CSV formats | PDF, HTML, CSV, Excel | Y | CSV, HTML, RTF | Y | PDF, HTML, RTF, Word, Excel | |
|
15 |
Data Source Support | CSV, Excel, SQL Server 2000/2005, Oracle | SQL, ODBC, JDBC, Excel, Raw file | SQL Server Oracle DB2 PostgreSQL MSDE Apache Derby |
CSV, Excel, relational databases | X | via JDBC | via JDBC |
|
16 |
Regression Testing Suite | Y | Y | Y | Y | Y | Y | Y |
|
17 |
Record and Playback | X | Y | Y | X | Y | Y | Records HTTP traffic |
|
18 |
Extensible | Y | Java support | Limited | Y | Y | Y | Supports Groovy and JavaScript |
|
19 |
Performance Testing Support | Y | Y | Y | Y | Using Rational Performance Tester | Y | Y |
|
20 |
MQ Support | Y | Y | X | Y | Y | Tibco EMS, IBM MQ, Sonic MQ | X |
|
21 |
REST Service Support | Y | Y | Y | Y | X | Y | Y |
|
22 |
JMS Support | Y | Y | Y | Y | Y | Y | Y |
|
23 |
Stub Generation | Y | Y | Y | Y | Y | Y | Y |
|
24 |
SMTP Support | Y | Y | X | Y | |||
|
25 |
SOAP 1.2 Support | Y | Y | Y | NA | NA | NA | Y |
|
26 |
OS Platforms | Windows. SOAPSonar can be run on MAC and UNIX based systems through the use of a Virtual Machine running a Windows OS | Windows (XP/Vista/Me/2000), Linux, Unix, Solaris, Mac OSX | Microsoft Windows Red Hat Linux, Enterprise Linux, pSeries Solaris (including the x86 series) HP-UX IBM AIX SUSE Linux Enterprise |
Windows, Linux, Solaris, Mac | windows and linux | AIX, Linux, Solaris, Windows | Windows, Linux, Mac |
|
27 |
UDDI Support | Y | X | Y | Y | Y | X | |
|
28 |
Policy Enforcement | Y | Y | Y | Y | Y | WS-Policy | X |
|
29 |
Mock Service | Y | Y | Y | Y | Y | Y | Y |
|
30 |
Asynchronous Service Testing | Y | Y | asynchronous using WS-Notification | Y | X | ||
|
31 |
UI Support | Y | Y | Y | Y | X | Y | X |
|
32 |
Industry Specific Data Formats | X | Out of the box support | X | X | X | HL7, MLLP, SWIFT, FIX, IATA, AMQP | X |
|
33 |
ESB Support | IBM, Tibco, Oracle | IBM, TIBCO , Software AG / webMethods, Oracle , Progress, Cordys, SAP, Microsoft | Oracle, IBM, Jboss, SAP | NA | NA | IBM, Tibco, Software AG, Oracle, SAP NetWeaver | NA |
|
34 |
Variants | Personal Edition, Standard Edition, Automation Edition, Platinum Edition. (Personal Edition lacks features such as WS-Security validation, performance testing, and vulnerability testing) | NA | NA | NA | Rational Service Tester, Rational Performance Tester | GH tester, GH Performance, GH VIE | SOAPUI, SOAPUI Pro |
|
35 |
License | Commercial (Free – Personal Edition) | Commercial | Commercial | Commercial | Commercial | Commercial | Commercial (Free – SOAPUi) |
SOA / Web Services / Java 