Need advice about which tool to choose?Ask the StackShare community!

Codecov

2.4K
322
+ 1
102
Codefresh

62
111
+ 1
47
Add tool

Codecov vs Codefresh: What are the differences?

What is Codecov? Hosted coverage reports with awesome features to enhance your CI workflow. Our patrons rave about our elegant coverage reports, integrated pull request comments, interactive commit graphs, our Chrome plugin and security.

What is Codefresh? CI/CD Tailor-Made For Docker. Automate and parallelize testing. Codefresh allows teams to spin up on-demand compositions to run unit and integration tests as part of the continuous integration process. Jenkins integration allows more complex pipelines.

Codecov can be classified as a tool in the "Code Coverage" category, while Codefresh is grouped under "Container Tools".

Some of the features offered by Codecov are:

  • Beautiful Reports
  • Pull Request Comments
  • Interactive Commit Graphs

On the other hand, Codefresh provides the following key features:

  • Instant Dev, test and feature preview environments: Enables all team members to run any image as a standalone or composition for feature preview, manual testing, bug reproduction and more. Collaborate on features before pushing them into staging and production.
  • Testing with every step: Configure your pipeline to run integration and unit tests with every step
  • Instantly test all code changes in the Codefresh build system before pushing to staging & production. Run integration, unit tests in parallel.

"More stable than coveralls" is the top reason why over 14 developers like Codecov, while over 6 developers mention "Fastest and easiest way to work with Docker" as the leading cause for choosing Codefresh.

Decisions about Codecov and Codefresh

My website is brand new and one of the few requirements of testings I had to implement was code coverage. Never though it was so hard to implement using a #docker container. Given my lack of experience, every attempt I tried on making a simple code coverage test using the 4 combinations of #TravisCI, #CircleCi with #Coveralls, #Codecov I failed. The main problem was I was generating the .coverage file within the docker container and couldn't access it with #TravisCi or #CircleCi, every attempt to solve this problem seems to be very hacky and this was not the kind of complexity I want to introduce to my newborn website. This problem was solved using a specific action for #GitHubActions, it was a 3 line solution I had to put in my github workflow file and I was able to access the .coverage file from my docker container and get the coverage report with #Codecov.

See more
Manage your open source components, licenses, and vulnerabilities
Learn More
Pros of Codecov
Pros of Codefresh
  • 17
    More stable than coveralls
  • 17
    Easy setup
  • 14
    GitHub integration
  • 11
    They reply their users
  • 10
    Easy setup,great ui
  • 5
    Easily see per-commit coverage in GitHub
  • 5
    Steve is the man
  • 4
    Merges coverage from multiple CI jobs
  • 4
    Golang support
  • 3
    Free for public repositories
  • 3
    Code coverage
  • 3
    JSON in web hook
  • 3
    Newest Android SDK preinstalled
  • 2
    Cool diagrams
  • 1
    Bitbucket Integration
  • 11
    Fastest and easiest way to work with Docker
  • 7
    Great support/fast builds/awesome ui
  • 6
    Great onboarding
  • 5
    Freestyle build steps to support custom CI/CD scripting
  • 4
    Robust feature-preview/qa environments on-demand
  • 4
    Easy setup
  • 2
    Kubernetes Integration
  • 2
    Codefresh Runner for supporting hybrid infra
  • 2
    GitOps friendly
  • 2
    Firendly API
  • 2
    Slack Integration

Sign up to add or upvote prosMake informed product decisions

Cons of Codecov
Cons of Codefresh
  • 1
    GitHub org / team integration is a little too tight
  • 0
    Delayed results by hours since recent outage
  • 0
    Support does not respond to email
  • 1
    Questionable product quality and stability
  • 1
    Expensive compared to alternatives

Sign up to add or upvote consMake informed product decisions

What is Codecov?

Our patrons rave about our elegant coverage reports, integrated pull request comments, interactive commit graphs, our Chrome plugin and security.

What is Codefresh?

Automate and parallelize testing. Codefresh allows teams to spin up on-demand compositions to run unit and integration tests as part of the continuous integration process. Jenkins integration allows more complex pipelines.

Need advice about which tool to choose?Ask the StackShare community!

What companies use Codecov?
What companies use Codefresh?
Manage your open source components, licenses, and vulnerabilities
Learn More

Sign up to get full access to all the companiesMake informed product decisions

What tools integrate with Codecov?
What tools integrate with Codefresh?

Sign up to get full access to all the tool integrationsMake informed product decisions

Blog Posts

What are some alternatives to Codecov and Codefresh?
Code Climate
After each Git push, Code Climate analyzes your code for complexity, duplication, and common smells to determine changes in quality and surface technical debt hotspots.
Coveralls
Coveralls works with your CI server and sifts through your coverage data to find issues you didn't even know you had before they become a problem. Free for open source, pro accounts for private repos, instant sign up with GitHub OAuth.
SonarQube
SonarQube provides an overview of the overall health of your source code and even more importantly, it highlights issues found on new code. With a Quality Gate set on your project, you will simply fix the Leak and start mechanically improving.
Codacy
Codacy automates code reviews and monitors code quality on every commit and pull request on more than 40 programming languages reporting back the impact of every commit or PR, issues concerning code style, best practices and security.
JaCoCo
It is a free code coverage library for Java, which has been created based on the lessons learned from using and integration existing libraries for many years.
See all alternatives