Need advice about which tool to choose?Ask the StackShare community!
Cypress vs Jest vs Mocha: What are the differences?
Introduction
Cypress, Jest, and Mocha are popular testing frameworks used in web development. While they all serve the same purpose of facilitating testing, there are key differences between them that make each framework unique. In this Markdown code, we will explore these differences and provide a concise comparison between Cypress, Jest, and Mocha.
Ease of Setup: Cypress, as an end-to-end testing framework, provides an all-in-one setup experience. It includes built-in dependencies and an intuitive user interface, making it easy to start testing without much configuration. On the other hand, both Jest and Mocha require additional setup, including the installation of test runners, assertion libraries, and other necessary packages.
Testing Approach: Cypress focuses on end-to-end testing and provides a comprehensive testing environment for simulating user interactions and testing the entire application stack. It uses a real browser environment, allowing developers to perform actions as if they were a user. In contrast, Jest and Mocha are primarily used for unit testing and focus on isolating and testing individual units of code, such as functions or components.
Syntax and Framework Support: Cypress uses a JavaScript-based syntax with a fluent and easy-to-understand API. It provides direct support for modern frameworks like React, Vue, and Angular, making it seamless to test applications built with these frameworks. Jest, on the other hand, has a similar JavaScript syntax but also supports TypeScript out of the box. While Mocha supports both JavaScript and TypeScript, it does not have built-in support for any specific framework.
Mocking and Spies: Cypress, being an end-to-end testing framework, does not have built-in support for mocking and spying functionalities. Instead, it encourages the use of network stubbing and fixtures to simulate server responses. In contrast, Jest and Mocha provide comprehensive mocking and spying functionalities, allowing developers to easily mock dependencies and track function invocations.
Code Coverage: Jest is known for its excellent code coverage capabilities. It provides detailed reports indicating which parts of the codebase are covered by tests and which are not. This feature helps identify areas of the code that require additional testing. While Cypress can generate code coverage reports, it is not as detailed as Jest. Mocha, on the other hand, does not have built-in code coverage capabilities and requires the integration of additional tools like Istanbul to generate coverage reports.
Community and Ecosystem: Cypress has gained popularity for its extensive documentation, active community support, and growing ecosystem of plugins and custom commands. It has strong backing from the Cypress team and regular updates and enhancements. Jest also has a large and active community, with numerous plugins and integrations available. Mocha has been around for quite some time and has a mature community and ecosystem, although it may not have the same level of growth and updates as Cypress and Jest.
In summary, Cypress offers an easy setup and end-to-end testing capabilities while providing excellent support for modern frameworks. Jest is well-known for its code coverage capabilities and extensive community support, while Mocha has a mature community and is great for unit testing but lacks some of the features offered by Cypress and Jest.
In the company I will be building test automation framework and my new company develops apps mainly using AngularJS/TypeScript. I was planning to build Protractor-Jasmine framework but a friend of mine told me about Cypress and heard that its users are very satisfied with it. I am trying to understand the capabilities of Cypress and as the final goal to differentiate these two tools. Can anyone advice me on this in a nutshell pls...
I've used both Protractor and Cypress extensively. Cypress is the easier and more reliable tool, whereas Protractor is the more powerful tool. Your choice of tool should depend on your specific testing needs. Here are some advantages and disadvantages of each tool:
Cypress advantages:
Faster
More reliable (tends to throw fewer intermittent false failures)
Easier to read code (handles promises gracefully)
Cypress disadvantages:
Cannot switch between browser tabs
Cannot switch to iFrames
Cannot specify clicks or keypresses explicitly as if a real user was interacting
Cannot move the mouse to specific co-ordinates
Sometimes has trouble switching between different top-level domains, so not good for testing external links
Cypress is a newer tool with less extensive documentation and less community support
Protractor advantages:
More powerful because it is Selenium-based - it can switch between tabs, it can handle external links to other domains, it can handle iFrames, simulate keypresses and clicks, and move the mouse to specific co-ordinates within the browser.
More extensive community support and documentation
Protractor disadvantages:
Slower and more brittle - in general there is a higher likelihood of cryptic and/or intermittent errors which may cause your tests to fail even though there is nothing wrong with your application
For highly experienced automation engineers, the fundamental "brittle" nature of Selenium can be worked around - it can be reliable but only if you really know what you are doing
Less graceful handling of promises - relies on async/await or .then to manage the order of execution. Therefore it is a bit harder to read the code.
Harder to set up, and the method of setup impacts its reliability. For example, a hub/node configuration where the selenium jar is on a different physical machine than the browser under test will cause unreliability in your tests. Not everyone knows about this type of thing, so it's common to find Selenium frameworks that are set up poorly.
It's probably better to use Cypress if
you're at a smaller company and have a close relationship with developers who can help write hooks or stubs in their code to assist your testing
you don't need to do things like switch between tabs or test links to external top-level domains
It's probably better to use Protractor if
You might need to switch between tabs or test external links to other domains within the scope of your framework
You want to use a more accurate simulation of how a real user interacts with a browser (i.e. click at this location, type these keys)
You're at a company where you won't have any support from developers in writing hooks or stubs to make their code more testable in a less powerful framework like Cypress
Please try Handow, the e2e tool basing on Puppeteer.
Gherkin syntax compatible
Chrome/Chromium orentied, driven by Puppeteer engine
Complete JavaScript programming
Create test suites rapidly without coding (or a little bit), basing on built-in steps library
Schedule test with plans and arrange stories with sequential stages
Fast running, execute story groups in parallel by multi-workers
Built-in single page report render
Cover page view, REST API and cookies test
As we all know testing is an important part of any application. To assist with our testing we are going to use both Cypress and Jest. We feel these tools complement each other and will help us get good coverage of our code. We will use Cypress for our end to end testing as we've found it quite user friendly. Jest will be used for our unit tests because we've seen how many larger companies use it with great success.
Postman will be used to do integration testing with the backend API we create. It offers a clean interface to create many requests, and you can even organize these requests into collections. It helps to test the backend API first to make sure it's working before using it in the front-end. Jest can also be used for testing and is already embedded into React. Not only does it offer unit testing support in javascript, it can also do snapshot testing for the front-end to make sure components are rendering correctly. Enzyme is complementary to Jest and offers more functions such as shallow rendering. UnitTest will be used for Python testing as it is simple, has a lot of functionality and already built in with python. Sentry will be used for keeping track of errors as it is also easily integratable with Heroku because they offer it as an add-on. LogDNA will be used for tracking logs which are not errors and is also a Heroku add-on. Its good to have a separate service to record logs, monitor, track and even fix errors in real-time so our application can run more smoothly.
We use Mocha for our FDA verification testing. It's integrated into Meteor, our upstream web application framework. We like how battle tested it is, its' syntax, its' options of reporters, and countless other features. Most everybody can agree on mocha, and that gets us half-way through our FDA verification and validation (V&V) testing strategy.
Pros of Cypress
- Open source29
- Great documentation22
- Simple usage20
- Fast18
- Cross Browser testing10
- Easy us with CI9
- Npm install cypress only5
- Good for beginner automation engineers2
Pros of Jest
- Open source36
- Mock by default makes testing much simpler32
- Testing React Native Apps23
- Parallel test running20
- Fast16
- Bundled with JSDOM to enable DOM testing13
- Mock by default screws up your classes, breaking tests8
- Out of the box code coverage7
- Promise support7
- One stop shop for unit testing6
- Great documentation3
- Assert Library Included2
- Built in watch option with interactive filtering menu1
- Preset support1
- Can be used for BDD0
- Karma0
Pros of Mocha
- Open source137
- Simple102
- Promise support81
- Flexible48
- Easy to add support for Generators29
- For browser and server testing12
- Curstom assertion libraries7
- Works with Karma5
- No other better tools3
- Simple setup1
- Works with saucelabs1
- Lots of tutorials and help online1
- Default reporter is nice, clean, and itemized1
- Works with BrowserStack1
- Simple integration testing1
Sign up to add or upvote prosMake informed product decisions
Cons of Cypress
- Cypress is weak at cross-browser testing21
- Switch tabs : Cypress can'nt support14
- No iFrame support12
- No page object support9
- No multiple domain support9
- No file upload support8
- No support for multiple tab control8
- No xPath support8
- No support for Safari7
- Cypress doesn't support native app7
- Re-run failed tests retries not supported yet7
- No support for multiple browser control7
- $20/user/thread for reports5
- Adobe4
- Using a non-standard automation protocol4
- Not freeware4
- No 'WD wire protocol' support3
Cons of Jest
- Documentation4
- Ambiguous configuration4
- Difficult3
- Many bugs still not fixed months/years after reporting2
- Multiple error messages for same error2
- Difficult to run single test/describe/file2
- Ambiguous2
- Bugged2
- BeforeAll timing out makes all passing tests fail1
- Slow1
- Reporter is too general1
- Unstable1
- Bad docs1
- Still does't support .mjs files natively1
- Can't fail beforeAll to abort tests1
- Interaction with watch mode on terminal0
Cons of Mocha
- Cannot test a promisified functions without assertion3
- No assertion count in results2
- Not as many reporter options as Jest1