Test automation frameworks are basically the groundwork for automating test scripts. Different frameworks offer different rules, guidelines, and procedures to help efficiently develop and execute tests.
The best choice for each tester is, of course, dependent on their preferences and needs. In this post, we’ll differentiate the multiple frameworks and open source automation tools to make the best testing and development.
No Reason to Make Your Own
While it is possible to create your own testing framework, there are plenty of pre-defined frameworks to simplify test execution and help you meet your browser automation goals.
“I’ve seen some teams take it to the extreme by building their own, elaborate automation framework from scratch,” said TestTalks Founder Joe Colantonio. “This drives me crazy, because they could have easily made use of existing open-source tools and libraries that would have met their needs without writing any code — in most cases with better results.”
Rather than wasting time trying to build an adequate framework, check out some of developers’ trusted choices. These resources make it easier for your team to collaborate for better quality, security, speed and readability.
Tool Frameworks
The test writing frameworks that we discuss further along in this post require a prior knowledge of foundational browser automation tools. Selenium, Appium, Capybara, and Watir are the original open source tools that provide a basic infrastructure for other frameworks to add to for increased features, capabilities, and efficient test execution.
Selenium WebDriver is a tool and API framework for web browser automation. The big selling point of WebDriver for developers is that it allows them to test in any preferred programming language, which also makes it one of the most popular open-source automation frameworks.
Appium, on the other hand, is an open source automation framework for mobile apps. The framework allows native, hybrid, and mobile testing and drives iOS, Android, and Windows apps using WebDriver. Just like Selenium, it’s a cross-platform tool that can run scripts in any language.
Capybara is a library written in Ruby and is another framework that makes it simple to automate web application testing using an intuitive API that simulates an actual user. It offers a user-friendly DSL (Domain Specific Language) and locates elements in the DOM (Document Object Model).
Watir (pronounced like water) is another family of Ruby libraries for automating web browsers in an app no matter what technology it’s been developed in. Watir only supports Internet Exploreer on Windows, but Watir-WebDriver (which is powered by Selenium) supports Chrome, Firefox, Internet Explorer, Opera and can also run in HTMLUnit headless mode
What all these tool frameworks have in common is that they communicate directly with the browser to perform tasks in the same way that a human would, so executing automated tasks is as accurate as manually testing them.
Test Writing Frameworks
WebDriver.io – WebdriverIO makes it easier to setup, manage, and write Selenium tests in JavaScript by implementing the WebDriver protocol API. The custom libraries include a test runner for integration testing and provides a plethora of shortcuts to make code cleaner and easier to read. Learn more about testing with WebDriverIO here.
Robot Framework – Robot Framework is implemented using Python as its core but can also run on Java and other languages through a remote interface. It utilizes keyword-driven testing, which makes it simple for testers to perform either normal test automation or ATDD. The modular architecture can be bundled with self-made test libraries in addition to the many included tools and libraries.
Nightwatch.JS – For end-to-end testing, this easy to use Node.js based framework uses Selenium WebDriver’s API to perform commands and assertions on DOM elements. Nightwatch.js also has a built-in command-line test runner that can execute tests sequentially or in parallel. Learn more about testing with Nightwatch here.
Cucumber – Cucumber is a Behavior Driven Development (BDD) framework that lets you execute plain-text functional descriptions as automated text. It’s written in Ruby but also tests in other languages including Java and Python. The point of Cucumber is that even people without highly technical knowledge are able to read the code, making it more accessible for collaboration across different business departments.
Lettuce – Another BDD framework but for Python, Lettuce allows you to execute automated tests from plain-text descriptions that almost anyone can understand. It’s actually based off Cucumber, which has a few more features, but Lettuce aims to cover the most common tasks on BDD and is a fairly straightforward option. Learn more about testing with Lettuce here.
Protractor – Protractor is an end-to-end test framework for AngularJS applications that can simulate a user’s interaction with an Angular application running in a browser or mobile device. It has added hooks for running in Selenium that enable you to get more data and benefit from other Angular features. Additionally, a really cool feature is that it lets you separate your tests into various test suites, which allows you to enter a single command and run a group of test cases for different scenarios. Learn more about testing with Protractor here.
Mocha – Mocha is a feature-rich JavaScript test framework running on Node.js and in the browser. It’s great for unit and integration testing, and self-described as making asynchronous testing “simple and fun.” It also includes test coverage reports and use of most JavaScript assertion libraries — most popularly Chai. Learn more about testing with Mocha here.