BrowserStack vs Karma vs Selenium

Need advice about which tool to choose?Ask the StackShare community!

BrowserStack

2.7K
2K
+ 1
498
Karma

2.5K
602
+ 1
181
Selenium

15.4K
12.3K
+ 1
525
Advice on BrowserStack, Karma, and Selenium

I am looking to purchase one of these tools for Mobile testing for my team. It should support Native, hybrid, and responsive app testing. It should also feature debugging, parallel execution, automation testing/easy integration with automation testing tools like Selenium, and the capability to provide availability of devices specifically for us to use at any time with good speed of performing all these activities.

I have already used Perfecto mobile, and Sauce Labs in my other projects before. I want to know how different or better is AWS Device farm in usage and how advantageous it would be for us to use it over other mentioned tools

See more
Replies (3)
Aaron Evans
Testing Strategist at One Shore · | 3 upvotes · 7.7K views

A SaaS offering like Sauce Labs (or BrowserStack or LambdaTest, etc) will provide a remote Selenium/Appium Grid including the ability to run test automation in parallel (up to the amount based your subscription level) an a wide array of browsers and mobile devices.

These tools can be expensive, but if you can afford them, the expertise and effort of maintaining the grid, browser updates, etc. is worth it.

AWS Device Farm can be significantly cheaper, but is much more work to setup and run. It will not give you as many devices, or the reporting and screen/video capture you get with the the services. And there is no support for AWS Device Farm, and very poor documentation. I have used it, but do not recommend it. Running your own grid and physical device lab is better, but I'd stick with a service like Sauce Labs or Perfecto which will save you time and give you better services despite the higher price tag.

See more
Recommends
on
BrowserStackBrowserStack

Stability - Just works. Availability - More than 15 datacenters. Enterprise features like SSO, local testing and SOC2/GDPR compliant.

See more
Jaymie Falconi
Recommends
on
BitBarBitBar

BitBar's Dedicated Devices would be a great option for you. It allows you to dedicate (reserve) devices for your use only which also having access to all of the devices in the shared cloud. BitBar has the features and integrations that you are looking for as well.

See more
Needs advice
on
JestJestSeleniumSelenium
and
WebdriverIOWebdriverIO
in

we are having one web application developed in Reacts.js. in the application, we have only 4 to 5 pages that we need to test. I am having experience in selenium with java. Please suggets which tool I should use. and why ............................ ............................ .............................

See more
Replies (1)
Prashanth Marappa
Senior Software Engineer at Mphasis · | 1 upvotes · 216.4K views
Recommends
on
SeleniumSelenium

with the help of selenium we can automate react js for functional testing

See more
Get Advice from developers at your company using StackShare Enterprise. Sign up for StackShare Enterprise.
Learn More
Pros of BrowserStack
Pros of Karma
Pros of Selenium
  • 134
    Multiple browsers
  • 75
    Ease of use
  • 63
    Real browsers
  • 43
    Ability to use it locally
  • 26
    Good price
  • 20
    Great web interface
  • 18
    IE support
  • 16
    Official mobile emulators
  • 14
    Instant access
  • 14
    Cloud-based access
  • 11
    Real mobile devices
  • 7
    Selenium compatible
  • 7
    Screenshots
  • 7
    Multiple Desktop OS
  • 6
    Can be used for Testing and E2E
  • 5
    Pre-installed developer tools
  • 4
    Video of test runs
  • 3
    Webdriver compatible
  • 3
    Many browsers
  • 3
    Supports Manual, Functional and Visual Diff Testing
  • 3
    Favourites
  • 2
    Cypress Compatible
  • 2
    Test automation dashboard
  • 2
    Unify and track test cases
  • 2
    Free for Open Source
  • 2
    Test Management
  • 2
    Cross-browser testing
  • 2
    Bi-directional Jira Sync
  • 1
    Speed is fast
  • 1
    Real devices
  • 0
    Web accessibility
  • 0
    Test WCAG Compliance
  • 0
    Visual testing and review
  • 61
    Test Runner
  • 35
    Open source
  • 27
    Continuous Integration
  • 22
    Great for running tests
  • 18
    Test on Real Devices
  • 11
    Backed by google
  • 5
    Easy Debugging
  • 2
    Remote Control
  • 175
    Automates browsers
  • 154
    Testing
  • 101
    Essential tool for running test automation
  • 24
    Record-Playback
  • 24
    Remote Control
  • 8
    Data crawling
  • 7
    Supports end to end testing
  • 6
    Easy set up
  • 6
    Functional testing
  • 4
    The Most flexible monitoring system
  • 3
    End to End Testing
  • 3
    Easy to integrate with build tools
  • 2
    Comparing the performance selenium is faster than jasm
  • 2
    Record and playback
  • 2
    Compatible with Python
  • 2
    Easy to scale
  • 2
    Integration Tests
  • 0
    Integrated into Selenium-Jupiter framework

Sign up to add or upvote prosMake informed product decisions

Cons of BrowserStack
Cons of Karma
Cons of Selenium
  • 2
    Very limited choice of minor versions
  • 1
    Slow, because tests are run in a real browser
  • 1
    Requires the use of hacks to find tests dynamically
  • 8
    Flaky tests
  • 4
    Slow as needs to make browser (even with no gui)
  • 2
    Update browser drivers

Sign up to add or upvote consMake informed product decisions

- No public GitHub repository available -

What is BrowserStack?

BrowserStack is the leading test platform built for developers & QAs to expand test coverage, scale & optimize testing with cross-browser, real device cloud, accessibility, visual testing, test management, and test observability.

What is Karma?

Karma is not a testing framework, nor an assertion library. Karma just launches a HTTP server, and generates the test runner HTML file you probably already know from your favourite testing framework. So for testing purposes you can use pretty much anything you like.

What is Selenium?

Selenium automates browsers. That's it! What you do with that power is entirely up to you. Primarily, it is for automating web applications for testing purposes, but is certainly not limited to just that. Boring web-based administration tasks can (and should!) also be automated as well.

Need advice about which tool to choose?Ask the StackShare community!

What companies use BrowserStack?
What companies use Karma?
What companies use Selenium?

Sign up to get full access to all the companiesMake informed product decisions

What tools integrate with BrowserStack?
What tools integrate with Karma?
What tools integrate with Selenium?

Sign up to get full access to all the tool integrationsMake informed product decisions

Blog Posts

What are some alternatives to BrowserStack, Karma, and Selenium?
Browserling
We run the browsers on our servers. Fully interactive sessions, not static screenshots. No flash, no applets, nothing to install. Powered entirely by <canvas> and javascript.
LambdaTest
LambdaTest platform provides secure, scalable and insightful test orchestration for website, and mobile app testing. Customers at different points in their DevOps lifecycle can leverage Automation and/or Manual testing on LambdaTest.
Ghost Inspector
It lets you create and manage UI tests that check specific functionality in your website or application. We execute these automated browser tests continuously from the cloud and alert you if anything breaks.
AWS Device Farm
Run tests across a large selection of physical devices in parallel from various manufacturers with varying hardware, OS versions and form factors.
Appium
Appium is an open source test automation framework for use with native, hybrid, and mobile web apps. It drives iOS and Android apps using the WebDriver protocol. Appium is sponsored by Sauce Labs and a thriving community of open source developers.
See all alternatives