Test tracking tools are absolutely necessary for the performance and user experience of any site. Comparisons with Google Analytics may come up, but this list is specifically for free test tracking tools. You don’t want to go paying for something that you could get for free, and I just gave you ten of them!
This post is a complete list of the best free test tracking tools on the web. With a lot of these testing platforms now charging, it’s easy to lose track of the free solutions out there. So today, we are going to make sure that doesn’t happen. We’ll start off by looking at some different approaches to running tests (from those who keep it simple and free with tools like VWO to high-end platforms designed for enterprise digital analytics). We’ll then be looking at my pick of the best overall tests for each approach. If you are interested in testing – be sure to bookmark this page as I’ll also be collecting new testing approaches and vendor reviews from time to time as well.
Before you get lost in the deep indexes of Google trying to figure out the best software testing tools for your needs, take a look at this trusty list developed by the software testing experts here at Tricentis. Be sure to check out our software testing tools after spending some time here.
Here’s what you can expect:
There are 100+ software testing tools and 8 categories all with the following information:
- Summary of the testing tool
- UI Screen Shots
- Key Features
- What you need to know
- Links to customer reviews (where applicable)
- Pricing (if available)
We’ve broken down our recommendations into 8 categories, plus a bonus section with up and coming tools to keep an eye on.
| Test Automation | Usability Testing | Bug Tracking |
| Performance Testing | Test Setup & Infrastructure | Niche Testing |
| Test Management | Mobile Testing | Up & Coming Testing Tools |
Test Automation Tools
Test automation is one of the most mature software testing segments. Currently, the rise of good open source options and the push toward DevOps and multichannel models are transforming this segment.
We can break down test automation tools into two subcategories:
- Functional testing
- Integration/API testing
Functional Software Testing Tools
Why use Functional Testing tools? Functional Testing tools drive automated tests by interacting with the UI layer of an application. These tools usually provide a record and playback interface, making it easier for nontechnical testers to provide automation coverage. However, these tests can be slow and brittle.
1. Tricentis Tosca
Summary: Provides model-based test automation focused on test case design versus problem solving. Tricentis Tosca also offers end-to-end testing and recording capabilities.
Features:
- Offers support for Agile
- Includes a more complete set of tools around test data management, service virtualization and orchestration
- Delivers model-based automation that allows for easier reuse/less maintenance and does not require coding knowledge
What you really need to know: With the Tosca Testsuite, we have focused on creating model-based automation and a “mini-suite” that goes beyond pure test automation to provide risk coverage and test case design as well.
For more information: Check out our site.
Reviews: Head over to ITCentralStation.com or G2Crowd.com to read reviews.
2. HP (Now Micro Focus) Unified Functional Testing (UFT)
Summary: Previously known as QuickTest Professional (QTP), HP UFT (Now Micro Focus UFT) automates GUI functionality and back-end service testing. It also offers reusable test components, helps convert manual testing assets into automated ones, embraces the shift left to make testing part of the Agile development cycle, and allows for testing across multiple machines and devices.
Features:
- Strong partner network
- Increasing support for newer browsers and mobile (though HP does fall behind other market leaders)
- Integrated offering that includes other test tools
What you really need to know: Although HP remains the market share leader in paid test automation, it has recently struggled to focus on newer platforms, ceding ground to competitors.
For more information: Check out the Micro Focus UFT site
Reviews: Checkout UFT reviews over at ITCentralStation.com
3. IBM Rational Functional Tester
Summary: Part of IBM’s larger Rational testing platform, the Rational Functional Tester uses data-driven testing to automate functional and regression testing. It supports a variety of applications and allows for both storyboard testing and test scripting.
Features:
- Integrated offering that includes other test tools
- Supports legacy platforms and frameworks
- Offers mature and dependable tools
What you really need to know: Once a true market leader, IBM has had to focus on standing its ground against rising competition from HP and up and coming players in recent years.
For more information: Check out the IBM Rational Functional Testing site.
Reviews: Checkout a few reviews over at TrustRadius.com and ITCentralStation.com.
Pricing: Plans start at $3,400 per month with 6 pricing tiers. Visit their pricing page to learn more.
4. Katalon Studio
Summary: A complete web and mobile automation framework built on top of Selenium and Appium, Katalon Studio is packed with essential features that only available in commercial tools while remaining as a free solution
Features:
- Dual scripting interface for new and advanced users
- Out of the box integration with qTest and JIRA
- Support Agile team with CI workflow
What you really need to know: Katalon Studio is a cross-platform tool to transform your manual testing into automation that requires minimum program background.
For more information: Check out the Katalon Studio site.
Reviews: Head over to Capterra and SoftwareTestingHelp to read reviews.
Pricing: Free
5. Worksoft Certify
Summary: Automates functional testing of business processes across the entire application landscape. Worksoft Certify offers capabilities around discovery, validation, measurement, compliance and scale.
Features:
- Takes a scriptless approach
- Compatible with package software as well as custom built code/extensions
- Easy to use
- Well supported
What you really need to know: Although Certify works with a wide variety of applications and custom built code/extensions, it’s focus is on supporting package software like SAP, Oracle, Salesforce, etc.
For more information: Checkout Worksoft Certify automated business process testing.
Reviews: Checkout reviews at ITCentralStation.com.
6. EggPlant Functional
Summary: An automated functional testing tool that uses an image-based approach, which looks at the screen of any device the same way a user would. This image-based UI testing differs from the traditional approach because it tests from the perspective of a user rather than by looking at code. Eggplant Functional works across all device types.
Features:
- Allows for reuse of functional automation for performance testing
- Fast development
- Offers lab management and CI integration
- Supports all major platforms including web, mobile, POS systems – anything behind a pane of glass
What you really need to know: eggPlant Functional’s use of an image-based approach to automation can help solve complex automation problems. Their approach allows testers with little to no automation skills to achieve robust automation overage and for teams that have struggled to implement automation, its a way to get over the hump.
For more information: See eggPlant Functional’s download page.
Reviews: Head over to ITCentralStation.com to read a couple reviews.
7. Ranorex
Summary: Allows for setup and execution of test automation scripts and offers GUI object recognition, reusable code modules and record/play back functionality. Ranorex also offers script-free functionality.
Features:
- Developer-friendly
- Delivers strong object recognition
- Offers a straightforward and affordable pricing model
What you really need to know: Ranorex provides similar functionality to integrated suite vendors with lower cost licenses and maintenance.
For more information: Checkout the Ranorex site.
Reviews: G2Crowd.com and ITCentralStation.com have a good amount of reviews.
Pricing: Plans start at 2,990 USD per license with 3 pricing tiers. Visit their pricing page to learn more.
Integration/API Software Testing Tools
Integration/API testing tools send various types of payloads through APIs to make sure they accept valid inputs and reject improper ones with proper messages.
Some of these software testing tools can also provide testing for load. Integration/API testing is especially important for cloud, mobile and PaaS. Let’s look at a handful of Integration/API testing tools to consider:
1. CA Technologies Application Test (Now part of BroadCom’s portfolio)
Summary: Uses a declarative workflow model that focuses on building tests over scripting. CA Application Test (now part of the BroadCom Continuous Testing solution) embraces the shift left by allowing for API testing before UI development. It also offers automated mobile testing, visual tests, customized load testing and advanced analytics.
Features:
- Allows for integration of mobile testing
- Integrates with Selenium for improved visual editing
- Offers robust mainframe support
- Allows for reuse of LISA test cases and infrastructure
- Creates a load on an internal network with few resources
What you really need to know: CA Technologies is mostly focused on competing in the mainframe space and testing desktop applications and complex infrastructure using LISA.
For more information: Checkout the Broadcom Continuous Testing website.
2. IBM Rational Test Workbench
Summary: A comprehensive test automation tool with integration testing capabilities as well as mobile, regression, performance and scalability testing capabilities. In terms of integration testing, IBM Rational Test Workbench allows for service-level testing, automatic scheduling and execution of testing via an integration with the IBM Rational collaborative lifecycle management tool.
Features:
- Allows for continuous integration testing
- Integrates with the larger IBM Rational testing suite for expanded capabilities
- Provides lifecycle collaboration
- Supports automaton
What you really need to know: IBM Rational Test Workbench provides a complete set of enterprise-ready testing tools that cover testing needs throughout the development lifecycle.
For more information: Checkout the Rational Test Workbench automation solution for load and integration testing.
3. Parasoft SOAtest
Summary: Provides test automation for end-to-end scenarios across multiple endpoints with support for REST, web services and over 120 protocols/message types. Parasoft SOAtest creates extensible and reusable tests. In addition to API testing, it also offers SOA testing, web and performance testing, web UI testing, runtime error testing, API security testing, service virtualization, and development testing.
Features:
- Offers capabilities beyond integration/API testing
- Supports a wide selection of messaging/protocols
What you really need to know: Parasoft SOAtest offers automated API testing as well as several other testing capabilities. Its most unique feature is the extensive list of environments, including protocols, platforms and messaging formats, that it supports.
For more information: Checkout Parasofts SOAtest API testing solution.
Reviews: Read a few reviews of SOAtest at ITCentralStation.com
4. SmartBear ReadyAPI
Summary: A complete API testing platform with support for API functional testing, API load testing, API security testing, service virtualization, API testing in code, API performance management and defining, building, and managing APIS. SmartBear Ready! API provides project management, metrics and reporting, script support, discovery, and continuous integration across all of these API testing capabilities.
Features:
- Provides a wide variety of API testing capabilities
- Supports continuous integration
What you really need to know: SmartBear ReadyAPI is a comprehensive API testing tool that covers API testing across functional, performance and post-deployment testing. It also integrates with the larger SmartBear testing environment.
For more information: Checkout SmartBears ReadyAPI testing tool.
5. Crosscheck Networks SOAPSonar
Summary: Provides API service testing, API emulation and virtualization and API security gateway technologies. Crosscheck Networks uses a dynamic mutation technology to deliver functional automation, performance and security testing. It also offers API simulated behavior modeling with support for a variety of protocols and messages.
Features:
- Provides virtualization and security testing as well as API service testing
- Supports a variety of protocols and messages, including JSON, REST and SOAP
What you really need to know: Crosscheck Networks SOAPSonar offers a variety of API testing capabilities, although it emphasizes functional, performance and security testing for service endpoints. It runs these tests using a patented mutation technology.
For more information: Checkout Crosscheck Service Testing.
Open Source Integration Testing Tools:
There are also several open source options for integration and API testing. If you decide to go the open source route, consider these tools:
| Tool | Capability |
| Apache JMeter | API Testing |
| SoapUI | API Testing |
| PowerMock | Object Mocking |
| EasyMock | Object Mocking |
| REST Assured | API Testing |
| WebInject | API Testing |
| Mockito | Object Mocking |
| Jmockit | Object Mocking |
| mocktail | Object Mocking |
| WireMock | Object Mocking |
| Betamax | Object Mocking |
| Mockserver | Object Mocking |
Performance Testing Tools
Performance testing tools take a simple automation script and run it through hundreds or thousands of machines to simulate how an application will perform under load.
These tests are typically expensive and are run less frequently than functional automation tests. Performance testing is particularly important for cloud applications and there are two main types to consider:
- Pure Play
- Extension Tools
This list represents both pure play and extension tools, each of which has its pros and cons. Here’s what you need to know about the difference between the two types of tools:
Pure Play Performance Testing Tools
Pros:
- Typically cheaper
- Creates less friction during purchase and implementation processes
- Offers faster development with best of breed tools
- Supports more integration and open source use
Cons:
- Requires separate scripts/languages to train and maintain
Extension Performance Testing Tools
Pros:
- Allows for reuse of past automation scripts
- Uses familiar languages
- Offers a single vendor relationship across multiple tools
Cons:
- Follows slower, less focused development
- Provides a closed ecosystem that limits access to best of breed tools
- Typically more expensive and geared toward large organizations
1. Tricentis Flood
Tricentis Flood is a cloud-based, distributed load testing platform that helps teams test how their applications scale with massive load generated from around the world. Flood can generate load using popular open source load testing tools (such as Apache JMeter, Flood Element, Gatling and Chrome) as well as Tricentis Tosca functional testing cases (API and UI).
Flood is easily integrated with CI tools like Jenkins and Bamboo, as well as the most popular APM tools like New Relic, AppDynamics, and Dynatrace. Additionally, Flood can be integrated into your own private hosting account with providers like AWS and Azure.
Flood’s free trial comes with 5 node hours that can be used to jump-start your load testing. Subscriptions come in flexible options to meet your budget, with different options of testing capacity, features, hosting, and term length. Try it free here.
2. Automation Anywhere Testing Anywhere
Summary: Automates any type of testing and offers cross platform support for mobile, web and desktop. Automation Anywhere can convert scripts into load scripts and allows for machine learning and analytics.
Features:
- Offers easy conversion from automation
- Less expensive but similar to HP
- Includes a TestLab to control testing devices
Tool Type: Extension
What you really need to know: Automation Anywhere is a lower end competitor to HP that offers some test case management capabilities as well as more robust automation capabilities.
For more information: Check out their automation solution.
Reviews: Head over to G2Crowd.com or ITCentralStation.com to read a few reviews.
3. BlazeMeter
Summary: Runs open source-based performance tests as well as scalable load testing. BlazeMeter is compatible with Apache JMeter, offers real-time reporting and mobile capture, simulates network conditions and allows developers to create and edit performance tests.
Features:
- Scalable
- DevOps ready
- Uses open source and AWS
- Offers strong support for APIs and customization
Tool Type: Pure Play
What you really need to know: BlazeMeter is a growing player in the cloud performance testing space. Although it has limited use cases and does not offer monitoring or post-production capabilities, it is popular with developers.
For more information: Checkout the BlazeMeter performance testing solution.
4. Borland (Now Micro Focus) Silk Performer
Summary: Offers unlimited scalability to simulate any size load as well as a variety of network technologies, including mobile. Silk Performer also provides visual diagnostics and stress testing with pattern detection. As part of Borland’s larger Silk Central platform, Silk Performer also includes a wide variety of supporting capabilities.
Features:
- Offers cross-platform support
- Mature
- Well-integrated into Silk Central
- Integrates with monitoring tools and IDEs
Tool Type: Extension
What you really need to know: Borland is a robust competitor to HP (although it does offer similarly high prices), with strong cross-platform support and cloud load capabilities.
For more information: Checkout Silk Performer load and stress performance testing.
Reviews: Head over to ITCentralStation.com to read a few reviews.
6. Micro Focus LoadRunner
Features:
- Robust and mature tools
- Supports legacy and newer technologies
- Cloud enabled
- Offers record and playback or scripting
- Allows for reuse of Unified Functional Testing tests
Tool Type: Extension
What you really need to know: With both LoadRunner and Performance Center, HP was traditionally a leader in this space, particularly for testing legacy enterprise applications. Micro Focus acquired these tools and rebranded under theLoadRunner family.
For more information: Check out the LoadRunner site.
Reviews: Read LoadRunner reviews here.
7. IBM Rational Performance Tester
Summary: Offers code-free testing and real-time reporting as well as root cause analysis tools. IBM Rational Performance Tester also compares test results to SLA targets, integrates with IBM Rational Quality Manager and includes a test recorder.
Features:
- Robust and mature tool
- Supports legacy and newer technologies
- Cloud enabled
- Offers record and playback or scripting
- Allows for reuse of Rational Functional Tester tests
Tool Type: Extension
What you really need to know: IBM Rational Performance Tester is cloud enabled and offers web and desktop support, but its mobile support is extremely weak.
For more information: Checkout the Rational performance test automation solution.
Reviews: Head over to ITCentralStation.com to read reviews.
8. Neotys NeoLoad
Summary: NeoLoad uses an intuitive GUI for use case creation, target identification and test execution. It allows you to simulate load locally or using the Neotys Cloud Platform, supports web and mobile and monitors all servers during load testing.
Features:
- Provides end-to-end testing
- Offers cross-platform capabilities
- More affordable pricing than legacy solutions
- Cloud and on premise enabled
Tool Type: Pure Play
What you really need to know: Neotys is a small but fast-growing player with cross-platform support for web and mobile (via NeoLoad) and post-production monitoring capabilities (via NeoSense).
For more information: Visit Neotys.com to learn more.
Reviews: Visit ITCentralStation.com to read reviews.
9. Parasoft Load Test
Summary: Provides performance, stress and concurrency testing with the ability to simulate various loads and test from different locations. Parasoft Load Test can also enforce Quality of Service metrics and run tests using tests previously created in Parasoft.
Features:
- Supports legacy applications
- Mature tool
- Allows for reuse of other tests created with Parasoft
- Offers performance monitoring capabilities
Tool Type: Extension
What you really need to know: While Parasoft Load Test does allow for reuse of test cases under load and provides performance monitoring and desktop and web support, it does not have any mobile capabilities and is not cloud enabled.
For more information: Learn more about Parasoft load testing.
Reviews: Visit the Parasoft review page on TrustRaidus.com and ITCentral Station.com
10. Radview WebLOAD
Summary: Simulates a variety of load conditions for an unlimited number of users and distributes the load across any number of machines. Radview WebLOAD can also monitor server performance and offers cross-platform support for web, desktop and mobile (via PerfectoMobile).
Features:
- Mature tool
- Some cross-platform support
- Some open source support (supports Selenium)
Tool Type: Pure Play
What you really need to know: Radview is a fledgling player in performance testing that was previously publicly listed but has since been delisted and is not performing very well currently (it has scaled down from 100 employees to about 25).
For more information: Checkout Radview performance testing
Reviews: Visit G2Crowd.com to read Radview reviews.
Pricing: Request pricing here.
11. SmartBear LoadComplete
Summary: A desktop tool for load, stress and scalability testing that works with both HTML sites and rich internet applications. SmartBear LoadComplete can generate load from virtual machines, on premise computers or the cloud and offers record and replay capabilities, visual programming, a test cost simulator, distributed load testing, analytics and functional test reuse.
Features:
- Mature tool
- Offers performance monitoring capabilities
- Allows for easy deployment of tests both on desktop and in the cloud
- Lower priced than HP
Tool Type: Extension
What you really need to know: LoadComplete is a core SmartBear product and extension of TestComplete. It offers web support, is cloud enabled and provides monitoring capabilities, but it has no mobile capabilities.
For more information: Learn more about LoadComplete performance testing.
Pricing: Offers a free version with plans start at $230 per year and 5 pricing tiers. View pricing here.
12. Akami CloudTest
Summary: Offers continuous load testing at any scale with real-time analytics. Akami CloudTest also has embedded user monitoring capabilities and allows users to build tests using RUM-based data and application-specific scenarios.
Features:
- Offers cross-platform support
- Innovative tool
- Ties in directly with performance monitoring
- Enterprise-ready
Tool Type: Pure Play
What you really need to know: Soasta is the largest player in the pure play space, with more than $75 million in funding to date. It provides cross-platform support with CloudTest for web and TouchTest for mobile (which also provides mobile automation) and offers post-production performance monitoring with mPulse.
For more information: Learn more about CloudTest load and performance testing.
Reviews: Read CloudTest reviews on ITCentralStation.com
Pricing: Offers a free version with plans start at $2500 per year and 2 pricing tiers. View pricing here.
13. Eggplant Performance
Summary: Provides cloud-based, distributed load simulations with dynamic test controls and standard scripting languages. It also provides application-level virtual users for more complete test coverage. TestPlant’s eggPlant Performance tool is part of the larger eggPlant range of testing tools.
Features:
- Offers cross-platform support
- Allows for reuse of functional tests as performance tests
- Can traverse various layers of applications including UI, API and command line layers
Tool Type: Extension
What you really need to know: eggPlant Performance can support web, desktop and mobile testing as an extension of eggPlant Functional.
For more information: Learn more about eggplant Performance here.
Pricing: No prices listed, but view licensing and pricing information here.
Test Management Tools
Test management is a mature testing segment currently being transformed by the widespread adoption of Agile, DevOps and Test Driven development. Most test management tools are either geared toward Agile or Waterfall development methodologies.
Below are Test management tools to consider:
1. qTest Manager by Tricentis
Summary: Provides tracking, management, organization and reporting capabilities for software testing and test case management. qTest Manager sets up and manages requirements, organizes and manages test cases, executes tests, tracks defects and reports on test data. It also integrates with Jira, Rally and VersionOne as well as other popular automation tools.
Features:
- User-friendly interface
- Allows for a variety of integrations such as JIRA, Jenkins, Rally and automation
- Supports manual, exploratory and automated testing all in once place
- Market leader in software testing tools built for Agile teams.
What you really need to know: qTest Manager is a market leader in test management tools and is the only platform tool that offers a single source of truth for manual, exploratory and automated testing. It also offers the most comprehensive view of testing efforts, reporting and provides seamless integrations with leading automation tools and JIRA.
For more information: Learn more about qTest Manager here.
Reviews: Read qTest reviews on their G2Crowd.com listing page.
2. SmartBear QAComplete
Summary: Provides visibility into the testing process with capabilities to manage, organize and report on tests. SmartBear QAComplete offers out-of-the-box templates or custom workflow options, defect logging, the ability to trace tests to user stories and reusability across the testing cycle. It also integrates with tools like Jira, Selenium and SoapUI.
Features:
- Highly customizable
- Supports a variety of integrations
What you really need to know: SmartBear QAComplete provides a single location to manage testing. Through customization, it can work for both Agile and Waterfall development processes.
For more information: Learn more about QAComplete.
3. Zephyr
Summary: Supports creation, planning, execution and tracking of tests. Zephyr supports structured and free-form tests as well as manual and automated tests and integrates with leading tools like JIRA, Confluence and Bugzilla. SmartBear acquired Zephyr in 2018.
Features:
- Offers real-time visibility
- Supports execution of multiple tests at once
What you really need to know: Zephyr is another player in the test management space, with an emphasis on real-time, on-demand testing. It is particularly focused on the smaller to mid markets segment through Atlassian, but is not built for the Enterprise.
For more information: Learn more about this test management tool at GetZephyr.com.
Pricing: Read how to buy Zephyr here.
4. Testuff
Summary: A SaaS test management tool with both web and desktop clients that support various testing methodologies and offer management capabilities throughout the entire testing lifecycle. Testuff also supports automated testing, two-way integrations with bug trackers and video tracking of defects.
Features:
- Offers a video recording feature for defect tracking
- Lower priced
- User-friendly
What you really need to know: Testuff is a SaaS tool whose most unique feature is its video defect tracking. It also offers a multitude of integrations with bug trackers and several integrations with automation tools.
For more information: You can learn more at Testuff.com
Pricing: Plans start at $27 per user per month with 3 pricing tiers. View pricing here.
Note the Open Source Test Management Tools as well:
There are also several open source options for test management. If you decide to go the open source route, consider these tools:
-ity Testing Tools
Named based on the shared suffix of its subcategories (security, usability, compatibility), -ity testing is more of an emerging segment featuring typically expensive and specialized tools. These tools are evolving, becoming easier to use and offering improved service, to assist smaller teams who cannot yet invest in dedicated resources.
We can break down -ity testing tools into three subcategories:
- Security
- Usability
- Compatibility
Security Testing Tools
Security testing tools are typically built around a particular platform and/or technology. There is little open source pressure for security testing, so these are usually expensive, specialized tools that include heavy services. Here are the top security testing tools to consider:
1. HP (now Micro Focus) Fortify On Demand
Summary: Provides application security as a service with a single platform to view and manage security risk, develop security testing schedules and run remediation projects. Fortify on Demand runs automated tests with a full audit of results and includes support for the SAST, DAST and IAST spaces (due to addition of the legacy WebInspect tool) as well as limited support for MAST.
Features:
- Strongest set of combined offerings with full support across languages
- Includes RASP support
What you really need to know: HP is undoubtedly the largest player in the security space, with tools for SAST, DAST, IAST and MAST.
For more information: To learn more, visit the Fortify website.
Reviews: Visit ITCentralStation.com for a list of reviews.
Pricing: Plans start at $2000 per application with 4 pricing tiers. Request pricing here.
2. Veracode
Summary: Veracode offers tools for SAST, DAST, IAST and MAST. Its binary static analysis is built toward Agile, while its DAST and IAST tools offer true cloud hosting and web perimeter monitoring. Additionally, almost all of its offerings are targeted to mobile.
Features:
- Strongest player for cloud and mobile technologies
- Integrates with numerous bug tracking and QA tools, such as TFS
- Includes RASP support
What you really need to know: Veracode is the largest player in the security space without its own testing and SDLC tools.
For more information: Learn more at Veracode.com.
Reviews: Head over to Gartner.com to read reviews for Veracode.
3. IBM Application Security APPScan
Summary: Offers a single console for testing, reporting and policies and automates the correlation of static, dynamic and interactive security testing. IBM’s AppScan static testing tool is well known in the security space, although its DAST tools rely on third party solutions and its IAST tools only work with .Net and Java.
Features:
- Strong in SAST
- Includes a complete suite of offerings
What you really need to know: IBM competes with HP as a similar full service offering, with some focus on downstream security tools like SIEM.
For more information: Head over to IBMs website to learn more.
Reviews: Visit ITCentralStation.com or Gartner.com for reviews.
Pricing: Plans start at $10,700 per install. Request pricing here.
Usability Testing Tools
Usability testing tools tend to be more basic and offer easy deployment within applications. The value of usability tools generally lies in the expertise or community provided. Take a look at the top usability software testing tools to consider:
1. UserTesting
Summary: Creates videos of people using a website or application and delivers a report that calls out problems and answers to any user surveys. UserTesting pools users from its own network or your company’s that match your target audience.
Features:
- Lower cost
- Easy to use
- Flexible licensing (per video pricing)
- Large network of testers
What you really need to know: UserTesting focuses solely on usability testing for websites and mobile apps. Its network of users and experts is strong and includes dedicated UX professionals. Although the product has traditionally been weak, it is improving.
For more information: Visit the UserTesting website to learn more.
Pricing: Pricing starts at $99 per video with 2 pricing tiers. View pricing here.
2. Validately
Summary: Allows you test live websites, mock HTML, images or prototypes and analyze the results via path reports and videos automatically flagged at issue points. Validately makes it easy to test on your own customers or find testers from its network and enables you to talk to these testers live.
Features:
- Lower cost
- Easy to use
- Offers the ability to get feedback before coding, saving costs and reducing throwaway work
What you really need to know: Validately focuses on user feedback before coding takes place. It is designed for users to interact with and provide feedback on desktop, web and mobile wireframes (not apps).
For more information: Visit Validately.com to learn more.
Pricing: Pricing starts at $79 per month with 3 pricing tiers. View pricing here.
Compatibility Testing Tools
Compatibility testing provides value based on efficient cross-browser mobile and web testing. Compatibility testing is simple to conduct manually, but is time consuming, expensive and risk prone. Technical or crowd automated tools bring efficiency to this process. Checkout the top compatibility testing tools to consider:
1. Browsera
Summary: Provides a detailed report of layout problems to avoid combing through screenshots, locates Javascript errors and tests dynamic pages. Browsera can also test pages that require a login and test entire sites at once, eliminating the need to go page by page.
Features:
- Pinpoints layout differences
- Eliminates the need to test page-by-page for entire websites
- Offers testing for dynamic pages and Javascript
What you really need to know: Browsera offers both free and enterprise versions of its compatibility testing tool. Its most unique features include the ability to detect layout differences across browsers and to identify Javascript errors.
For more information: Learn more on Broswera.com.
2. Browserling
Summary: Provides live interactive sessions for cross-browser testing with responsive testing and SSH tunnels for local testing. Browslering also offers screenshots, screen sharing, a bug hunter and videos. It is for web testing only.
Features:
- Lower priced
- Detect Javascript errors
- No installation
- Test dynamic pages
What you really need to know: Founded in 2011, Browserling focuses only on web and does not support automated testing.
For more information: Learn more at Browserling.com
Pricing: There is a free plan, but pricing starts at $49 per month with 3 pricing tiers. View pricing here.
Test Setup & Infrastructure Testing Tools
Test setup and infrastructure is a rapidly changing segment due to trends in mobile, web (cloud), NoSQL and containers, with many new companies emerging.
We can break down test setup and infrastructure tools into four subcategories:
- Test cloud
- Mobile device farm
- Test data management
- Environment management
Test Cloud Tools
Test cloud tools provide a network of virtual machines where desktop and web testing can occur at a lower cost, saving organizations money. Containers and AWS/cloud providers are lowering the barrier to entry for this market. Below are some of the top Test Cloud tools to consider:
1. Sauce Labs
Summary: Provides cross-browser, mobile and manual testing options as well as automation to test both web and mobile in parallel. Sauce Labs uses tunnel technology to encrypt traffic between individual tests and its cloud and offers access to live remote desktop sessions during tests.
Features:
- Lower cost
- Offers open source compatibility
- Includes additional functionality for manual and cross-browser testing
- Tight CI integration
What you really need to know: Sauce Labs offers everything as one product with additional enterprise capabilities in enhanced subscriptions. It currently only works with open source technologies like Selenium, Appium and JS Unit Testing. The additional manual testing and cross-browser comparison features it offers are very nice to have.
For more information: Learn more at Sauce Labs
Reviews: Visit G2Crowd.com or ITCentralStation.com to read reviews about SauceLabs.
Pricing: Pricing starts at $19 per month with 6 pricing tiers. View pricing here.
2. HP StormRunner Load
Summary: A SaaS load and performance tool for planning, executing and scaling web and mobile testing. HP StormRunner Load provides anomaly detection and real-time predictive analytics. It also supports the use of real mobile devices in cloud performance testing as well as test recordings.
Features:
- Supports Agile development processes
- Highly scalable
- Integrates with other HP testing tools
What you really need to know: HP StormRunner Load is a highly scalable solution for Agile cloud testing.
For more information: View the HP StormRunner Load site.
Reviews: Head over to ITCentralStation.com to read reviews about StormRunner Load.
Pricing: LoadRunner/StormRunner Load is priced at $.56 per virtual user per day, but they have a free edition as well. See their pricing here.
3. IBM Smart Business Development and Test Cloud
Summary: A self-service platform designed to simplify the assessment, planning, designing and implementation of development and testing private cloud environments. IBM Smart Business Development and Test Cloud also offers on demand provisioning of physical and virtualized test resources.
Features:
- Offers support for building complex testing environments
- Delivers automated provisioning and configuration management
- Integrates with IBM CloudBurst
What you really need to know: IBM’s Smart Business Development and Test Cloud is more focused on creating test environments than it is on creating machines/browsers from which to test.
For more information: Learn more about IBMs Smart Business Development tool.
4. Borland (now Micro Focus) Silk Central Connect
Summary: Offers pre-configured cross-browser test environments in the cloud and allows for reusable test scripts. Silk Central Connect also provides side-by-side results of cross-browser testing for easy comparison and integrates with Silk Test.
Features:
- Offers support for commercial automation (via Silk Test)
What you really need to know: Silk Central is a more enterprise-grade version of Sauce Labs. Like Sauce Labs, it offers mobile support via emulators. However, it only runs Silk Test scripts.
For more information: Learn more about Silk Central Connect.
Reviews: Head over to G2Crowd.com to read Silk Central reviews.
5. BroswerTap
Summary: Broadcasts a live RTMP stream of a browser to enable testing in real-time. BrowserTap offers parallel views to test multiple browsers at once and allows for testing of responsive design.
Features:
- Enables real-time changes due to live stream of browser feed
- Supports testing for responsive design
What you really need to know: BrowserTap has a long list of useful features it intends to implement, however it is still in the early stages of doing so and has a long way to go.
For more information: Learn more about BroswerTap.
Mobile Device Farm Testing Tools
Mobile device farms provide a network of mobile devices for testing to occur, saving device acquisition, management and maintenance costs. A recent entrance by Amazon with a fixed price offering has shaken up the market.
Mobile device farms to consider include Pure Play vs. Extension Tools. The list below represents both pure play and extension tools, each of which has its pros and cons. Here’s what you need to know about the difference between the two types of tools:
Pure Play
Pros:
- Typically cheaper
- Creates less friction during purchase and implementation processes
- Offers faster development with best of breed tools
- Supports more integration and open source use
Cons:
- Requires separate scripts/languages to train and maintain
Extension
Pros:
- Allows for reuse of past automation scripts
- Uses familiar languages
- Offers a single vendor relationship across multiple tools
Cons:
- Follows slower, less focused development
- Provides a closed ecosystem that limits access to best of breed tools
- Typically more expensive and geared toward large organizations
1. Amazon Web Service Device Farm
Summary: Provides automated testing against real mobile devices in the AWS cloud as well as remote access. AWS Device Farm also allows for manual reproduction of issues, integrations with development environments and use of built-in test suites, open source frameworks or manual tests.
Features:
- Lower pricing
- Wide device selection options
- Open source support
- Developer-friendly
- Integrates with AWS for billing, etc.
Tool Type: Pure Play
What you really need to know: Amazon released Device Farm as an extension of Amazon Web Services in July 2015. Later in 2015, it release support for an internal scriptless UI automation framework in addition to existing Calabash, Appium and Espresso integrations. This framework is not yet popular, as most users are still using the open source integrations.
For more information: Visit the Device Farm.
Reviews: Head over to G2crowd.com for reviews.
Pricing: Plans start at $.17 per min with 2 pricing tiers. View pricing here.
2. Micro Focus Silk Test
Summary: Provides a management hub designed for continuous delivery workflows. Silk Mobile Testing also supports cross-platform automation tests, supports manual or exploratory testing and provides screenshots, videos and status reports from tests. It also integrates with Silk Performer and Silk Central.
Features:
- Offers cross-platform and cross-device support
- Well-integrated into Silk Central
Tool Type: Extension
What you really need to know: Micro Focus acquired. this tool from Borland. While competitive at the time of acquisition, Micro Focus tools tend to be costly and not as fequently updated as competitors.
For more information: Check out the Silk Test website for more information.
3. Experitest SeeTestCloud
Summary: Offers device inventory, application, user and project management for mobile, enables remote access and integrates with performance testing tools like LoadRunner and JMeter. Experitest offers both an onsite and a hosted, online version of SeeTestCloud.
Features:
- High security
- Compatible with companies that own their own devices
- Provides commercial automation support
- Offers network visualization
- Allows for device monitoring
Tool Type: Extension
What you really need to know: Experitest SeeTestCloud is an onsite device cloud that hooks into your available mobile devices. Experitest also offers SeeTestAutomation, which integrates with HP UFT and LoadRunner as well as some open source tools like JMeter.
For more information: Learn more about SeeTestCloud here.
Pricing: Plans start at $2000 per year with 2 pricing tiers. View pricing here.
4. HP Mobile Center
Summary: Provides both real devices and emulators that support app testing, live monitoring and user insight delivery. HP Mobile Center also enables device management and user permissions, recording and replaying of interactions, structured manual testing or automated testing and security assessments.
Features:
- Integrates with HP UFT and LeanFT for improved automated testing
- Uses real devices with the option for emulators
Tool Type: Extension
What you really need to know: HP Mobile Center integrates with other HP testing tools to provide a more complete, end-to-end testing experience. Its support for both real devices and emulators provides flexibility in testing options.
For more information: Visit the HP Mobile Center site page for more information.
Reviews: Head over to ITCentralstation.com to read reviews.
Pricing: Plans start at $12,000 per year with 2 pricing tiers. View pricing here.
5. Keynote Mobile Testing
Summary: Provides test automation for real mobile devices. Keynote Mobile Testing supports unit, build acceptance, regression, explorative and negative testing. It also allows for test creation via scripting or integrations with open source frameworks and integrates with several CI applications.
Features:
- Uses real mobile devices and provides support for new devices immediately after their release
- Integrates with leading CI applications, including Appium and Selenium
- Offers various pricing plans
Tool Type: Extension
What you really need to know: Keynote Mobile Testing allows for automated testing across a wide variety of devices and supports a multitude of integrations that allow the tool to work seamlessly with an Agile development process.
For more information: Learn more at the Keynote website.
Pricing: Plans start at $180 per mo with 3 pricing tiers. View pricing here.
6. Mobile Labs deviceConnect
Summary: Provides remote device management, tracking and monitoring as well as user and application management. Mobile Labs deviceConnect also offers manual and automated application testing, all from its private cloud testing platform.
Features:
- High security
- Compatible with companies that own their own devices
- Provides commercial automation support
Tool Type: Pure Play
What you really need to know: Mobile Labs deviceConnect is a private cloud-based mobile cart that allows users to connect devices they own to a private cloud for functional, automated or performance testing. Mobile Labs partners exclusively with HP for automated testing.
For more information: Learn more at the deviceConnect product page.
7. Perfecto Mobile Monitoring
Summary: Offers cloud-based, automated testing as well as usability and performance monitoring. Perfecto’s Mobile Monitoring solution also offers visual reports and integrations with various automation frameworks, including open source options and HP UFT.
Features:
- High security
- Wide availability of devices
- Supports various automation frameworks
- Offers performance testing and monitoring support
Tool Type: Extension
What you really need to know: Perfecto Mobile offers a combination of privately-hosted and shared/cloud-hosted devices.
For more information: Learn more at the Perfecto Mobile website.
Reviews: Head over to G2Crowd.com & TrustTradius.com to read reviews.
Pricing: Plans start at $99 per month with 3 pricing tiers. Request pricing here.
8. Sauce Labs
Summary: Provides automated testing for emulators, simulators and real devices for native, hybrid and mobile web tests. Sauce Labs is based on open source standards and works with both iOS and Android devices.
Features:
- Lower cost
- Open source compatibility
- Offers additional functionality for manual and cross-browser testing
- Tight CI integration
Tool Type: Pure Play
What you really need to know: Sauce Labs offers everything as one product with additional enterprise capabilities in enhanced subscriptions. It currently only works with open source technologies like Selenium, Appium and JS Unit Testing. It is the only mobile testing tool that supports automation for native, hybrid and mobile web testing across all device types (real, emulators and simulators).
For more information: Head over to Saucelabs.com to learn more.
Reviews: Visit G2Crowd.com or ITCentralStation.com to read reviews about SauceLabs.
Pricing: Pricing starts at $19 per month with 6 pricing tiers. View pricing here.
9. Smart Software Testing Solutions pCloudy
Summary: Supports continuous development and testing on real devices. pCloudy also offers location testing, HTML5 browser functionality and debugging capabilities.
Features:
- Aligns with continuous development practices
- Offers a unique debugging feature
- Uses real devices
Tool Type: Extension
What you really need to know: Smart Software Testing Solution’s pCloudy emphasizes continuous development and testing as well as debugging.
For more information: Checkout their website here.
Pricing: Pricing starts at $20 per 5 hours with 6 pricing tiers. View pricing here.
10. Xamarin Platform (now part of Microsoft Visual Studio)
Summary: Provides native user interfaces, native API access and native performance for mobile app testing. Xamarin Platform also allows for shared projects and portable class libraries and supports testing on iOS, Android and Mac. Its testing model uses the C# language.
Features:
- Allows for use of a single language across all platforms
- Offers debugging capabilities
Tool Type: Extension
What you really need to know: Xamarin allows for native development and testing across iOS, Android and Mac, however it uses the C# language exclusively.
For more information: Visit Microsoft’s Visual Studio site to learn more.
Test Data Management
Test data management tools automate the process of deploying “gold” test data to databases. The introduction of open source databases first shook up the market, and it is facing change again due to the rise of NoSQL/Big Data stores. Let’s look at the top Test data management tools to consider.
1. Informatica Test Data Management (TDM)
Summary: Offers sensitive data discovery and classification, data masking, test data generation, data subsetting, data connectivity, pre-built application accelerators and monitoring and compliance reporting. Informatica TDM can be deployed on premise, in the cloud or using a hybrid cloud model.
Features:
- Offers the strongest standalone toolset
- Provides a diverse set of other data tools
- Includes a rich partner network of integrations
What you really need to know: Informatica offers a best of breed solution around data security and data management. Its test data management solution offers persistent data masking, test data generation, data subsetting and cloud and warehouse capabilities.
For more information: Visit the Informatica TDM product page.
2. CA Technologies (now Broadcom) Test Data Manager
Summary: A test-oriented and fully automated solution that is built for reusability. Test Data Manager provides synthetic data generation, data masking, data subsetting, coverage analysis, test data allocation, test data warehouse and virtualization. It is also geared toward the Agile model of continuous delivery.
Features:
- Offers the strongest integrated toolset
- Provides a diverse set of virtualization and application development tools
What you really need to know: CA Technologies is highly focused on test data management as it relates to DevOps and automation. Its Test Data Manager solution, which came from a 2015 acquisition of GridTools, provides data masking, data provisioning and test data generation.
For more information: Learn more on the Broadcom website.
3. IBM InfoSphere Optim
Summary: Uses pre-built workflows and services on demand for continuous testing and Agile development. IBM InfoSphere Optim makes it easy to create production-like environments, allows for functional, regression integration and load testing via integrations with the Rational Test Workbench and allows for data masking and enterprise test data management policy development and enforcement.
Features:
- Offers a strong integration with IBM testing tools
- Works across pre-production and production environments
- Integrates with IBM hosting
What you really need to know: IBM gained test data management capabilities in 2005 through its acquisition of Ascential Software. Its InfoSphere Optim test data management solution supports data masking, data subsetting and data generation and integrates with the Rational Test Workbench.
For more information: Visit the IBM
CONCLUSION
As a tester, you should test everything — functionality, usability, graphics, performance, etc. But after the test (whether it be a user test or an automated test), many of you want to track the bugs and defects you found. You might use Excel, JIRA, or Bugzilla — whatever works for your team. That is why I decided to write this post recommending some free testing tools to track your bugs and defects.