Buildbot vs Codeship: What are the differences?
What is Buildbot? Python-based continuous integration testing framework. BuildBot is a system to automate the compile/test cycle required by most software projects to validate code changes. By automatically rebuilding and testing the tree each time something has changed, build problems are pinpointed quickly, before other developers are inconvenienced by the failure.
What is Codeship? A Continuous Integration Platform in the cloud. Codeship runs your automated tests and configured deployment when you push to your repository. It takes care of managing and scaling the infrastructure so that you are able to test and release more frequently and get faster feedback for building the product your users need.
Buildbot and Codeship can be primarily classified as "Continuous Integration" tools.
Some of the features offered by Buildbot are:
- run builds on a variety of slave platforms
- arbitrary build process: handles projects using C, Python, whatever
- minimal host requirements: Python and Twisted
On the other hand, Codeship provides the following key features:
- Run you automated tests | Easily set up Codeship with Github or Bitbucket and trigger your automated tests with a simple push to your repository.
- 100 builds & 5 private projects free per month.
- Free for OSS.
"Highly configurable builds" is the top reason why over 8 developers like Buildbot, while over 214 developers mention "Simple deployments" as the leading cause for choosing Codeship.
Buildbot is an open source tool with 4K GitHub stars and 1.37K GitHub forks. Here's a link to Buildbot's open source repository on GitHub.
According to the StackShare community, Codeship has a broader approval, being mentioned in 277 company stacks & 82 developers stacks; compared to Buildbot, which is listed in 7 company stacks and 6 developer stacks.
What is Buildbot?
What is Codeship?
Need advice about which tool to choose?Ask the StackShare community!
Sign up to add, upvote and see more prosMake informed product decisions
What are the cons of using Buildbot?
Sign up to get full access to all the companiesMake informed product decisions
Sign up to get full access to all the tool integrationsMake informed product decisions
When it comes to continuous Integration services, the choice is hard. There are several solutions available and it looks like the dev scene is very split. We've read and reviewed several solutions and we ended up making the choice between Codeship and Semaphore . Although Semaphore is used by slightly more developers, we've experienced a faster and easy flow using Codeship. Both do integrate Slack and GitHub very well, so this is not a point to set them apart. Both have a complex pricing system that is not that easy to calculate and predict. However, out in the wild, we found Codeship to have a better price point at heavy use.
We are using GitLab CI and were very happy with it. The integration of all tools like CI/CD, tickets, etc makes it very easy to stay on top of things. But be aware, Gitlab currently does not have iOS build support. So if you want to exchange that for CircleCI / Codeship to have to invest some effort. We are using a managed Mac OS device and installed the Gitlab runner there, to have iOS builds.
Working for a web agency, I have access to many premium services for all parts of the development process which leads to two things when it comes to working on my personal projects at home.
1: I am more fussy about the quality of tools and services that I use than I was before I went from just messing around with programming to having a developer job.
2: I really don't want to pay a single fee or any kind of subscription to services as after using them all day at work I find it hard to justify personally paying a premium to use them for a bit of time at home after work.
However with Code ship neither of these things caused any issues as I found it to be very high quality and free.
On the subject of it being free, I know there are other CI solutions that are free however if you wish to use it with a private repository then unless you already have private Github repos then the fact that Code Ship integrates with Bitbucket can be extremely convenient as it means you can set up your personal projects with free private repository and a free CI / testing solution for absolutely free.
Overall Codeship has really impressed me in every way from its pricing to its clean and simple UI and its ease of use.
Setting up continuous integration is complex and time consuming. I've used Codeship for 1 year now and I would never go back to previous systems such as self hosted Jenkins for any kind of web applications. The ability to change developer access on a per repository basis with the click of a button is very helpful and integration with all our services such as Github and Heroku make testing and deployment happen in the background so we can concentrate on our application and not worry about what state the live code is in. We also find the Slack integration (and flowdock before that) to be a great way to share the current code status with the whole team without getting spammed with emails on each commit and build state change while testing prototype branches or working on pull-requests.
Like most developers I'd love it if my deployment processes were always the same for every project so I never had to think about deployment. However, that's probably never going to happen unless we stop having clients. Codeship allows me to organize all of my deployments into one place and set them up once so that I don't have to remember the process for every nuance of every client.
Whether it's deploying a Drupal or Wordpress site to a private server, a Meteor.js app to Modulus, or just about anything else Codeship gives me the flexibility of writing my own shell scripts for custom jobs (private server) but also one-click solutions for common problems (deployment to Modulus).
Highly recommend them!
It's not easy to differentiate a CI/CD service because integrations matter so much more than the service itself. Didn't even need to read any docs, it just works exactly as you expect it to.
- Pipelines for running tests in parallel (freemium).
- Easiest setup of any CI service I've tried.
- Mandatory build status image service.
- Test runners are alright, but not that powerful. Py.test can run tests in parallel on its own, but enabling that feature doesn't seem to speed up Codeship runs.
- Doesn't detect tox environments, so you have to specify one environment per pipeline manually.
I spent half a day grepping CodeShip and now I have a sweet deployment process for WP sites. After a month of wrestling with Bamboo I decided to give CodeShip a try thanks to an article by CodeShip's Roman Kuba about deploying WP sites
I am now killin' WP development with my CodeShip + WPEngine setup. This is also making WP development/deployment fun for the first time. CodeShip f*cking rocks.
We use this as a CI tool when working on our API and related tools. The setup is relatively painless and it hooks directly into our Github repo's to provide reports and feedback.
Runs a full test suite whenever we push changes to master and if everything is good, automatically deploys our changes to production.