Appveyor vs Coveralls

Overview

Coveralls

Stacks1.7K

Followers278

Votes68

Appveyor

Stacks123

Followers131

Votes94

Appveyor vs Coveralls: What are the differences?

What is Appveyor? Continuous Integration and Deployment service for busy Windows developers. AppVeyor aims to give powerful Continuous Integration and Deployment tools to every .NET developer without the hassle of setting up and maintaining their own build server.

What is Coveralls? Track your project's code coverage over time, changes to files, and badge your GitHub repo. Coveralls works with your CI server and sifts through your coverage data to find issues you didn't even know you had before they become a problem. Free for open source, pro accounts for private repos, instant sign up with GitHub OAuth.

Appveyor can be classified as a tool in the "Continuous Integration" category, while Coveralls is grouped under "Code Coverage".

Some of the features offered by Appveyor are:

Scriptless, repetitive, one-click deployment of build artifacts to multiple environments
YAML configuration
Backed by Windows Azure platform

On the other hand, Coveralls provides the following key features:

Repository Coverage Statistics
Individual File Coverage Reports
Line By Line Coverage

"Github integration" is the top reason why over 18 developers like Appveyor, while over 44 developers mention "Free for public repositories" as the leading cause for choosing Coveralls.

According to the StackShare community, Coveralls has a broader approval, being mentioned in 58 company stacks & 45 developers stacks; compared to Appveyor, which is listed in 19 company stacks and 16 developer stacks.

Share your Stack

Help developers discover the tools you use. Get visibility for your team's tech choices and contribute to the community's knowledge.

View Docs

CLI (Node.js)

Manual

Advice on Coveralls, Appveyor

Felipe

May 24, 2020

Needs advice

My website is brand new and one of the few requirements of testings I had to implement was code coverage. Never though it was so hard to implement using a #docker container.
Given my lack of experience, every attempt I tried on making a simple code coverage test using the 4 combinations of #TravisCI, #CircleCi with #Coveralls, #Codecov I failed. The main problem was I was generating the .coverage file within the docker container and couldn't access it with #TravisCi or #CircleCi, every attempt to solve this problem seems to be very hacky and this was not the kind of complexity I want to introduce to my newborn website.
This problem was solved using a specific action for #GitHubActions, it was a 3 line solution I had to put in my github workflow file and I was able to access the .coverage file from my docker container and get the coverage report with #Codecov.

198k views198k

Comments

Detailed Comparison

Coveralls	Appveyor
Coveralls works with your CI server and sifts through your coverage data to find issues you didn't even know you had before they become a problem. Free for open source, pro accounts for private repos, instant sign up with GitHub OAuth.	AppVeyor aims to give powerful Continuous Integration and Deployment tools to every .NET developer without the hassle of setting up and maintaining their own build server.
Repository Coverage Statistics;Individual File Coverage Reports;Line By Line Coverage;Repository Overview	Scriptless, repetitive, one-click deployment of build artifacts to multiple environments;YAML configuration;Backed by Windows Azure platform;Built-in NuGet feeds with project artifacts;Build artifacts are stored in a highly-durable Geo-redundant cloud storage;
Statistics
Stacks 1.7K	Stacks 123
Followers 278	Followers 131
Votes 68	Votes 94
Pros & Cons
Pros 45 Free for public repositories 13 Code coverage 7 Ease of integration 2 More stable than Codecov 1 Combines coverage from multiple/parallel test runs	Pros 20 Github integration 18 Simple, reliable & powerful 12 Hosted 11 YML-based configuration 10 Nuget support Cons 1 Complex user interface 1 Poor documentation
Integrations
Travis CI CircleCI Semaphore Jenkins Codeship	GitHub Bitbucket .NET

What are some alternatives to Coveralls, Appveyor?

Jenkins

In a nutshell Jenkins CI is the leading open-source continuous integration server. Built with Java, it provides over 300 plugins to support building and testing virtually any project.

Travis CI

Free for open source projects, our CI environment provides multiple runtimes (e.g. Node.js or PHP versions), data stores and so on. Because of this, hosting your project on travis-ci.com means you can effortlessly test your library or applications against multiple runtimes and data stores without even having all of them installed locally.

Codeship

Codeship runs your automated tests and configured deployment when you push to your repository. It takes care of managing and scaling the infrastructure so that you are able to test and release more frequently and get faster feedback for building the product your users need.

CircleCI

Continuous integration and delivery platform helps software teams rapidly release code with confidence by automating the build, test, and deploy process. Offers a modern software development platform that lets teams ramp.

TeamCity

TeamCity is a user-friendly continuous integration (CI) server for professional developers, build engineers, and DevOps. It is trivial to setup and absolutely free for small teams and open source projects.

Drone.io

Drone is a hosted continuous integration service. It enables you to conveniently set up projects to automatically build, test, and deploy as you make changes to your code. Drone integrates seamlessly with Github, Bitbucket and Google Code as well as third party services such as Heroku, Dotcloud, Google AppEngine and more.

wercker

Wercker is a CI/CD developer automation platform designed for Microservices & Container Architecture.

GoCD

GoCD is an open source continuous delivery server created by ThoughtWorks. GoCD offers business a first-class build and deployment engine for complete control and visibility.

Shippable

Shippable is a SaaS platform that lets you easily add Continuous Integration/Deployment to your Github and BitBucket repositories. It is lightweight, super simple to setup, and runs your builds and tests faster than any other service.

Buildkite

CI and build automation tool that combines the power of your own build infrastructure with the convenience of a managed, centralized web UI. Used by Shopify, Basecamp, Digital Ocean, Venmo, Cochlear, Bugsnag and more.

Related Comparisons

Some of the features offered by Appveyor are:

Scriptless, repetitive, one-click deployment of build artifacts to multiple environments
YAML configuration
Backed by Windows Azure platform

On the other hand, Coveralls provides the following key features:

Repository Coverage Statistics
Individual File Coverage Reports
Line By Line Coverage

"Github integration" is the top reason why over 18 developers like Appveyor, while over 44 developers mention "Free for public repositories" as the leading cause for choosing Coveralls.

Appveyor vs Coveralls