Need advice about which tool to choose?Ask the StackShare community!

Codecov

2.7K
322
+ 1
102
Coveralls

1.6K
277
+ 1
68
Add tool

Codecov vs Coveralls: What are the differences?

Codecov vs Coveralls

Code coverage tools play a crucial role in the software development process. Two popular options are Codecov and Coveralls. While both aim to measure and track code coverage, there are several key differences between them:

  1. Integration and Platform Support: Codecov supports a wide range of languages and platforms, including popular ones like Java, JavaScript, Python, and Ruby. On the other hand, Coveralls has limited language support, primarily focusing on Ruby, JavaScript, and Python.

  2. Interface and User Experience: Codecov offers a comprehensive and user-friendly interface with various features like pull request integration, code commenting, and visual coverage reports. Coveralls, on the other hand, has a simpler interface with basic features and less intuitive navigation.

  3. Integrations and Ecosystem: Codecov integrates seamlessly with popular code hosting platforms like GitHub and Bitbucket. It also has extensive integration options with various CI/CD tools. While Coveralls also supports GitHub integration, it lacks the same level of integrations with other code hosting and CI/CD platforms.

  4. Metrics and Analysis: Codecov provides detailed metrics, allowing developers to measure not only overall code coverage but also specific coverage metrics like line, branch, and function coverage. Coveralls, however, focuses primarily on overall coverage percentage, lacking more granular metrics.

  5. Security and Privacy: Codecov offers advanced security features like token scanning, secret detection, and security advisories, ensuring the protection of sensitive data. While Coveralls ensures the privacy of code coverage reports, it doesn't provide the same level of security features as Codecov.

  6. Pricing and Plans: Codecov offers a free tier with limited functionality and additional paid plans that unlock advanced features. Coveralls also has a free plan but its features are more limited, and it primarily offers paid plans for teams or organizations.

In summary, Codecov and Coveralls differ in terms of integration and platform support, interface and user experience, integrations and ecosystem, metrics and analysis capabilities, security and privacy measures, as well as pricing and plans. Making a choice between the two ultimately depends on individual needs and preferences.

Decisions about Codecov and Coveralls

My website is brand new and one of the few requirements of testings I had to implement was code coverage. Never though it was so hard to implement using a #docker container. Given my lack of experience, every attempt I tried on making a simple code coverage test using the 4 combinations of #TravisCI, #CircleCi with #Coveralls, #Codecov I failed. The main problem was I was generating the .coverage file within the docker container and couldn't access it with #TravisCi or #CircleCi, every attempt to solve this problem seems to be very hacky and this was not the kind of complexity I want to introduce to my newborn website. This problem was solved using a specific action for #GitHubActions, it was a 3 line solution I had to put in my github workflow file and I was able to access the .coverage file from my docker container and get the coverage report with #Codecov.

See more
Get Advice from developers at your company using StackShare Enterprise. Sign up for StackShare Enterprise.
Learn More
Pros of Codecov
Pros of Coveralls
  • 17
    More stable than coveralls
  • 17
    Easy setup
  • 14
    GitHub integration
  • 11
    They reply their users
  • 10
    Easy setup,great ui
  • 5
    Easily see per-commit coverage in GitHub
  • 5
    Steve is the man
  • 4
    Merges coverage from multiple CI jobs
  • 4
    Golang support
  • 3
    Free for public repositories
  • 3
    Code coverage
  • 3
    JSON in web hook
  • 3
    Newest Android SDK preinstalled
  • 2
    Cool diagrams
  • 1
    Bitbucket Integration
  • 45
    Free for public repositories
  • 13
    Code coverage
  • 7
    Ease of integration
  • 2
    More stable than Codecov
  • 1
    Combines coverage from multiple/parallel test runs

Sign up to add or upvote prosMake informed product decisions

Cons of Codecov
Cons of Coveralls
  • 1
    GitHub org / team integration is a little too tight
  • 0
    Delayed results by hours since recent outage
  • 0
    Support does not respond to email
    Be the first to leave a con

    Sign up to add or upvote consMake informed product decisions

    What is Codecov?

    Our patrons rave about our elegant coverage reports, integrated pull request comments, interactive commit graphs, our Chrome plugin and security.

    What is Coveralls?

    Coveralls works with your CI server and sifts through your coverage data to find issues you didn't even know you had before they become a problem. Free for open source, pro accounts for private repos, instant sign up with GitHub OAuth.

    Need advice about which tool to choose?Ask the StackShare community!

    What companies use Codecov?
    What companies use Coveralls?
    See which teams inside your own company are using Codecov or Coveralls.
    Sign up for StackShare EnterpriseLearn More

    Sign up to get full access to all the companiesMake informed product decisions

    What tools integrate with Codecov?
    What tools integrate with Coveralls?

    Sign up to get full access to all the tool integrationsMake informed product decisions

    Blog Posts

    What are some alternatives to Codecov and Coveralls?
    Code Climate
    After each Git push, Code Climate analyzes your code for complexity, duplication, and common smells to determine changes in quality and surface technical debt hotspots.
    SonarQube
    SonarQube provides an overview of the overall health of your source code and even more importantly, it highlights issues found on new code. With a Quality Gate set on your project, you will simply fix the Leak and start mechanically improving.
    Codacy
    Codacy automates code reviews and monitors code quality on every commit and pull request on more than 40 programming languages reporting back the impact of every commit or PR, issues concerning code style, best practices and security.
    JaCoCo
    It is a free code coverage library for Java, which has been created based on the lessons learned from using and integration existing libraries for many years.
    Istanbul
    It is a JS code coverage tool that computes statement, line, function and branch coverage with module loader hooks to transparently add coverage when running tests. Supports all JS coverage use cases including unit tests, server side functional tests and browser tests. Built for scale.
    See all alternatives