Need advice about which tool to choose?Ask the StackShare community!
AWS Device Farm vs BrowserStack: What are the differences?
AWS Device Farm and BrowserStack are both popular testing platforms that allow developers to test their applications on multiple devices and browsers. Let's explore the key differences between the two.
Supported Platforms: AWS Device Farm is specifically designed for testing mobile applications and supports both Android and iOS devices. On the other hand, BrowserStack supports testing on both mobile and desktop browsers, making it suitable for both web and mobile application testing.
Device and Browser Coverage: AWS Device Farm provides a comprehensive range of real devices for testing, including popular smartphones and tablets. It also offers various versions of Android and iOS operating systems. In contrast, BrowserStack offers an extensive range of real and virtual devices, as well as multiple versions of popular desktop and mobile browsers. This gives developers access to a wide range of devices and browsers for testing.
Testing Capabilities: AWS Device Farm offers automated and manual testing capabilities for mobile applications. It allows developers to run tests on multiple devices in parallel, perform performance and usability testing, and generate detailed reports. BrowserStack, on the other hand, offers both automated and manual testing capabilities for mobile and web applications. It also provides additional features such as visual testing, responsive design testing, and network simulation.
Integration with Development Tools: AWS Device Farm seamlessly integrates with popular CI/CD tools like Jenkins, Bitbucket, and GitHub. This allows developers to easily incorporate testing into their existing development workflows. BrowserStack also offers seamless integrations with popular CI/CD tools, making it convenient for developers to include testing as part of their development process.
Price and Pricing Model: AWS Device Farm offers a pay-as-you-go pricing model, where developers pay for the minutes and devices they use for testing. The pricing varies based on the device type and testing duration. On the other hand, BrowserStack offers subscription-based pricing plans that provide unlimited access to devices and browsers based on the selected plan. The pricing is fixed and does not change based on usage.
Additional Services and Support: AWS Device Farm is part of the larger AWS ecosystem and offers additional services such as device provisioning, remote access, and Appium integration. It also provides technical support through the AWS Support Center. BrowserStack offers additional services like real-time collaboration and Live debugging, as well as 24/7 technical support through their support channels.
In summary, AWS Device Farm is focused on mobile application testing with support for real devices and tight integration with the AWS ecosystem, while BrowserStack offers a wider range of testing capabilities including web and mobile applications, and extensive device and browser coverage.
I am looking to purchase one of these tools for Mobile testing for my team. It should support Native, hybrid, and responsive app testing. It should also feature debugging, parallel execution, automation testing/easy integration with automation testing tools like Selenium, and the capability to provide availability of devices specifically for us to use at any time with good speed of performing all these activities.
I have already used Perfecto mobile, and Sauce Labs in my other projects before. I want to know how different or better is AWS Device farm in usage and how advantageous it would be for us to use it over other mentioned tools
A SaaS offering like Sauce Labs (or BrowserStack or LambdaTest, etc) will provide a remote Selenium/Appium Grid including the ability to run test automation in parallel (up to the amount based your subscription level) an a wide array of browsers and mobile devices.
These tools can be expensive, but if you can afford them, the expertise and effort of maintaining the grid, browser updates, etc. is worth it.
AWS Device Farm can be significantly cheaper, but is much more work to setup and run. It will not give you as many devices, or the reporting and screen/video capture you get with the the services. And there is no support for AWS Device Farm, and very poor documentation. I have used it, but do not recommend it. Running your own grid and physical device lab is better, but I'd stick with a service like Sauce Labs or Perfecto which will save you time and give you better services despite the higher price tag.
Stability - Just works. Availability - More than 15 datacenters. Enterprise features like SSO, local testing and SOC2/GDPR compliant.
BitBar's Dedicated Devices would be a great option for you. It allows you to dedicate (reserve) devices for your use only which also having access to all of the devices in the shared cloud. BitBar has the features and integrations that you are looking for as well.
Pros of AWS Device Farm
- 1000 free minutes3
- Pay as you go pricing2
Pros of BrowserStack
- Multiple browsers134
- Ease of use75
- Real browsers64
- Ability to use it locally43
- Good price26
- Great web interface20
- IE support18
- Official mobile emulators16
- Instant access14
- Cloud-based access14
- Real mobile devices11
- Multiple Desktop OS7
- Selenium compatible7
- Screenshots7
- Can be used for Testing and E2E6
- Pre-installed developer tools5
- Video of test runs4
- Many browsers3
- Favourites3
- Webdriver compatible3
- Supports Manual, Functional and Visual Diff Testing3
- Free for Open Source2
- Unify and track test cases2
- Test automation dashboard2
- Test Management2
- Cross-browser testing2
- Cypress Compatible2
- Bi-directional Jira Sync2
- Speed is fast1
- Real devices1
- Visual testing and review0
- Test WCAG Compliance0
- Web accessibility0
Sign up to add or upvote prosMake informed product decisions
Cons of AWS Device Farm
- Records all sessions, blocks on processing when done1
- You need to remember to turn airplane mode off1
Cons of BrowserStack
- Very limited choice of minor versions2
