Need advice about which tool to choose?Ask the StackShare community!
Applitools vs BrowserStack: What are the differences?
- Key Difference 1: Pricing Model - Applitools offers a subscription-based pricing model, where customers pay a monthly fee based on their usage levels and the number of visual tests executed. On the other hand, BrowserStack offers a usage-based pricing model, where customers pay for the hours of usage on their virtual machines and browsers. This allows customers to choose a pricing model that best fits their budget and usage requirements.
- Key Difference 2: Integration with Test Automation Frameworks - Applitools provides seamless integration with popular test automation frameworks like Selenium and Appium, allowing developers to easily incorporate visual testing into their existing test scripts. BrowserStack, on the other hand, also supports integration with Selenium and Appium, but it also offers built-in support for additional test automation frameworks like TestNG and JUnit. This provides customers with more flexibility and options when it comes to choosing their preferred test automation framework.
- Key Difference 3: Scalability and Device Coverage - Applitools offers a cloud-based testing platform that provides scalable infrastructure to run tests across a wide range of devices, browsers, and screen resolutions. It also provides AI-powered visual testing capabilities to ensure consistent and accurate results across different environments. BrowserStack, on the other hand, is known for its extensive device and browser coverage, with support for over 2000 real devices and browsers. This makes it a preferred choice for customers who require a broad range of device and browser coverage.
- Key Difference 4: Collaborative Testing Tools - Applitools provides a collaborative testing platform that allows teams to easily share and manage test results, collaborate on issues, and track the progress of their visual testing efforts. It also provides features like Baseline Management and Smart Test Analyzer to help teams efficiently manage and analyze their visual tests. BrowserStack, on the other hand, offers a collaborative testing tool called App Live, which allows teams to test and debug their mobile apps in real-time. This makes it a preferred choice for teams that require real-time collaboration during the testing process.
- Key Difference 5: Support and Documentation - Applitools offers a comprehensive support package, including 24/7 technical support, documentation, and a vibrant community forum where users can ask questions and get help from other users. It also provides extensive documentation and tutorials to help users get started with visual testing. BrowserStack also provides 24/7 technical support, along with detailed documentation and tutorials. However, it also offers a dedicated Customer Success Manager for enterprise customers to provide personalized support and assistance. This makes it a preferred choice for customers who require dedicated support and personalized assistance.
- Key Difference 6: Testing Environments - Applitools supports cross-browser and cross-device testing, allowing customers to test their applications on various browsers, operating systems, and screen sizes. It also provides support for testing mobile apps on real devices and simulators/emulators. BrowserStack, on the other hand, offers a broader range of testing environments, including support for mobile testing on real devices, simulators/emulators, and even physical devices connected to a remote cloud. This provides customers with more options and flexibility when it comes to testing their applications across different environments.
In Summary, Applitools is known for its subscription-based pricing model, seamless integration with popular test automation frameworks, scalable infrastructure, and collaborative testing tools. On the other hand, BrowserStack is known for its usage-based pricing model, extensive device and browser coverage, real-time collaborative testing capabilities, dedicated support, and a broader range of testing environments.
I am looking to purchase one of these tools for Mobile testing for my team. It should support Native, hybrid, and responsive app testing. It should also feature debugging, parallel execution, automation testing/easy integration with automation testing tools like Selenium, and the capability to provide availability of devices specifically for us to use at any time with good speed of performing all these activities.
I have already used Perfecto mobile, and Sauce Labs in my other projects before. I want to know how different or better is AWS Device farm in usage and how advantageous it would be for us to use it over other mentioned tools
A SaaS offering like Sauce Labs (or BrowserStack or LambdaTest, etc) will provide a remote Selenium/Appium Grid including the ability to run test automation in parallel (up to the amount based your subscription level) an a wide array of browsers and mobile devices.
These tools can be expensive, but if you can afford them, the expertise and effort of maintaining the grid, browser updates, etc. is worth it.
AWS Device Farm can be significantly cheaper, but is much more work to setup and run. It will not give you as many devices, or the reporting and screen/video capture you get with the the services. And there is no support for AWS Device Farm, and very poor documentation. I have used it, but do not recommend it. Running your own grid and physical device lab is better, but I'd stick with a service like Sauce Labs or Perfecto which will save you time and give you better services despite the higher price tag.
Stability - Just works. Availability - More than 15 datacenters. Enterprise features like SSO, local testing and SOC2/GDPR compliant.
BitBar's Dedicated Devices would be a great option for you. It allows you to dedicate (reserve) devices for your use only which also having access to all of the devices in the shared cloud. BitBar has the features and integrations that you are looking for as well.
The problem I have is I would like to automate visual validation of a web page instead of having to do it manually which takes time. I already have automation which is capable of validating functionality but not so good at finding visual bugs such as rendering, font, layout and the lots before customer finds them.
The most important factors for me are; support for visual validation, reduced false negatives, reduce or minimal effort to integrate with existing testing framework and support for cross browser testing and hand held devices.
Pros of Applitools
- Visual AI is 99.9999% accurate3
- Augments any testing framework - easy to implement2
- AI & ML eliminate false positives (vs. pixel-based))2
- Test against multiple browsers, viewports, and devices2
- Fast cross-browser test execution2
- Increase test coverage - finds functional & visual bugs2
- Reduce test code & locators1
- Visual AI is 5.8X more efficient1
Pros of BrowserStack
- Multiple browsers135
- Ease of use76
- Real browsers65
- Ability to use it locally44
- Good price27
- Great web interface21
- IE support19
- Official mobile emulators17
- Cloud-based access15
- Instant access15
- Real mobile devices12
- Multiple Desktop OS8
- Selenium compatible8
- Screenshots8
- Can be used for Testing and E2E7
- Pre-installed developer tools6
- Video of test runs5
- Supports Manual, Functional and Visual Diff Testing4
- Favourites4
- Webdriver compatible4
- Many browsers4
- Test Management3
- Test automation dashboard3
- Cypress Compatible3
- Bi-directional Jira Sync3
- Free for Open Source3
- Unify and track test cases3
- Cross-browser testing3
- Speed is fast2
- Real devices2
- Private devices1
- Test WCAG Compliance1
- Web accessibility1
- Visual testing and review1
Sign up to add or upvote prosMake informed product decisions
Cons of Applitools
- Lot of bugs2
- Problems with integration2
- Documentation not clear2
- Cannot do well with low res images2
- Mismatched image test results2
- Ambiguous2
- Colours with small contrast diff are not identified2
Cons of BrowserStack
- Very limited choice of minor versions2