Jenkins聽vs聽Sauce Labs

Need advice about which tool to choose?Ask the StackShare community!

Jenkins

39.9K
32.6K
+ 1
2.2K
Sauce Labs

289
365
+ 1
436
Add tool

Jenkins vs Sauce Labs: What are the differences?

Jenkins: An extendable open source continuous integration server. In a nutshell Jenkins CI is the leading open-source continuous integration server. Built with Java, it provides over 300 plugins to support building and testing virtually any project; Sauce Labs: Test mobile or web apps instantly across 700+ browser/OS/device platform combinations - without infrastructure setup. Cloud-based automated testing platform enables developers and QEs to perform functional, JavaScript unit, and manual tests with Selenium or Appium on web and mobile apps. Videos and screenshots for easy debugging. Secure and CI-ready.

Jenkins belongs to "Continuous Integration" category of the tech stack, while Sauce Labs can be primarily classified under "Browser Testing".

Some of the features offered by Jenkins are:

  • Easy installation
  • Easy configuration
  • Change set support

On the other hand, Sauce Labs provides the following key features:

  • 700+ browser/OS/device combinations for cross-browser and platform testing to improve web and mobile app quality and eliminate the overhead of internal infrastructure
  • Highly reliable, on-demand cloud for enterprise-grade scalability and industry standard security
  • Optimized for popular testing frameworks, CI systems, and surrounding tools and services

"Hosted internally" is the top reason why over 497 developers like Jenkins, while over 54 developers mention "Selenium-compatible" as the leading cause for choosing Sauce Labs.

Jenkins is an open source tool with 13.2K GitHub stars and 5.43K GitHub forks. Here's a link to Jenkins's open source repository on GitHub.

According to the StackShare community, Jenkins has a broader approval, being mentioned in 1753 company stacks & 1479 developers stacks; compared to Sauce Labs, which is listed in 66 company stacks and 11 developer stacks.

Advice on Jenkins and Sauce Labs

I am looking to purchase one of these tools for Mobile testing for my team. It should support Native, hybrid, and responsive app testing. It should also feature debugging, parallel execution, automation testing/easy integration with automation testing tools like Selenium, and the capability to provide availability of devices specifically for us to use at any time with good speed of performing all these activities.

I have already used Perfecto mobile, and Sauce Labs in my other projects before. I want to know how different or better is AWS Device farm in usage and how advantageous it would be for us to use it over other mentioned tools

See more
Replies (2)
Jaymie Falconi
Recommends
BitBar

BitBar's Dedicated Devices would be a great option for you. It allows you to dedicate (reserve) devices for your use only which also having access to all of the devices in the shared cloud. BitBar has the features and integrations that you are looking for as well.

See more
Recommends
BrowserStack

Stability - Just works. Availability - More than 15 datacenters. Enterprise features like SSO, local testing and SOC2/GDPR compliant.

See more
Needs advice
on
Jenkins
and
Azure Pipelines

We are currently using Azure Pipelines for continous integration. Our applications are developed witn .NET framework. But when we look at the online Jenkins is the most widely used tool for continous integration. Can you please give me the advice which one is best to use for my case Azure pipeline or jenkins.

See more
Replies (1)
Recommends
GitHub

If your source code is on GitHub, also take a look at Github actions. https://github.com/features/actions

See more
Mohammad Hossein Amri
Chief Technology Officer at Axceligent Solutions | 3 upvotes 路 187.7K views
Needs advice
on
Jenkins
and
GoCD

I'm open to anything. just want something that break less and doesn't need me to pay for it, and can be hosted on Docker. our scripting language is powershell core. so it's better to support it. also we are building dotnet core in our pipeline, so if they have anything related that helps with the CI would be nice.

See more
Replies (1)
Ankit Malik
Software Developer at CloudCover | 1 upvotes 路 174.3K views

Google cloud build can help you. It is hosted on cloud and also provide reasonable free quota.

See more
Needs advice
on
Jenkins
and
Concourse

I'm planning to setup complete CD-CD setup for spark and python application which we are going to deploy in aws lambda and EMR Cluster. Which tool would be best one to choose. Since my company is trying to adopt to concourse i would like to understand what are the lack of capabilities concourse have . Thanks in advance !

See more
Replies (1)
Maxi Krone
Cloud Engineer at fme AG | 2 upvotes 路 90.9K views
Recommends
Concourse

I would definetly recommend Concourse to you, as it is one of the most advanced modern methods of making CI/CD while Jenkins is an old monolithic dinosaur. Concourse itself is cloudnative and containerbased which helps you to build simple, high-performance and scalable CI/CD pipelines. In my opinion, the only lack of skills you have with Concourse is your own knowledge of how to build pipelines and automate things. Technincally there is no lack, i would even say you can extend it way more easily. But as a Con it is more easy to interact with Jenkins if you are only used to UIs. Concourse needs someone which is capable of using CLIs.

See more
Needs advice
on
Jenkins
Travis CI
and
CircleCI

From a StackShare Community member: "Currently we use Travis CI and have optimized it as much as we can so our builds are fairly quick. Our boss is all about redundancy so we are looking for another solution to fall back on in case Travis goes down and/or jacks prices way up (they were recently acquired). Could someone recommend which CI we should go with and if they have time, an explanation of how they're different?"

See more
Replies (6)
Dustin Falgout
Developer at Elegant Themes | 13 upvotes 路 195.1K views

We use CircleCI because of the better value it provides in its plans. I'm sure we could have used Travis just as easily but we found CircleCI's pricing to be more reasonable. In the two years since we signed up, the service has improved. CircleCI is always innovating and iterating on their platform. We have been very satisfied.

See more
Peter Thomas
Distinguished Engineer at Intuit | 9 upvotes 路 173.2K views
Recommends
Travis CI
at

As the maintainer of the Karate DSL open-source project - I found Travis CI very easy to integrate into the GitHub workflow and it has been steady sailing for more than 2 years now ! It works well for Java / Apache Maven projects and we were able to configure it to use the latest Oracle JDK as per our needs. Thanks to the Travis CI team for this service to the open-source community !

See more

I use Google Cloud Build because it's my first foray into the CICD world(loving it so far), and I wanted to work with something GCP native to avoid giving permissions to other SaaS tools like CircleCI and Travis CI.

I really like it because it's free for the first 120 minutes, and it's one of the few CICD tools that enterprises are open to using since it's contained within GCP.

One of the unique things is that it has the Kaniko cache, which speeds up builds by creating intermediate layers within the docker image vs. pushing the full thing from the start. Helpful when you're installing just a few additional dependencies.

Feel free to checkout an example: Cloudbuild Example

See more
Recommends
Travis CI

I use Travis CI because of various reasons - 1. Cloud based system so no dedicated server required, and you do not need to administrate it. 2. Easy YAML configuration. 3. Supports Major Programming Languages. 4. Support of build matrix 6. Supports AWS, Azure, Docker, Heroku, Google Cloud, Github Pages, PyPi and lot more. 7. Slack Notifications.

See more
Oded Arbel
Recommends
GitLab CI

You are probably looking at another hosted solution: Jenkins is a good tool but it way too work intensive to be used as just a backup solution.

I have good experience with Circle-CI, Codeship, Drone.io and Travis (as well as problematic experiences with all of them), but my go-to tool is Gitlab CI: simple, powerful and if you have problems with their limitations or pricing, you can always install runners somewhere and use Gitlab just for scheduling and management. Even if you don't host your git repository at Gitlab, you can have Gitlab pull changes automatically from wherever you repo lives.

See more
Recommends
Buildkite

If you are considering Jenkins I would recommend at least checking out Buildkite. The agents are self-hosted (like Jenkins) but the interface is hosted for you. It meshes up some of the things I like about hosted services (pipeline definitions in YAML, managed interface and authentication) with things I like about Jenkins (local customizable agent images, secrets only on own instances, custom agent level scripts, sizing instances to your needs).

See more
Decisions about Jenkins and Sauce Labs
Stephen Badger | Vital Beats
Senior DevOps Engineer at Vital Beats | 2 upvotes 路 74.4K views

Within our deployment pipeline, we have a need to deploy to multiple customer environments, and manage secrets specifically in a way that integrates well with AWS, Kubernetes Secrets, Terraform and our pipelines ourselves.

Jenkins offered us the ability to choose one of a number of credentials/secrets management approaches, and models secrets as a more dynamic concept that GitHub Actions provided.

Additionally, we are operating Jenkins within our development Kubernetes cluster as a kind of system-wide orchestrator, allowing us to use Kubernetes pods as build agents, avoiding the ongoing direct costs associated with GitHub Actions minutes / per-user pricing. Obviously as a consequence we take on the indirect costs of maintain Jenkins itself, patching it, upgrading etc. However our experience with managing Jenkins via Kubernetes and declarative Jenkins configuration has led us to believe that this cost is small, particularly as the majority of actual building and testing is handled inside docker containers and Kubernetes, alleviating the need for less supported plugins that may make Jenkins administration more difficult.

See more

Jenkins is a pretty flexible, complete tool. Especially I love the possibility to configure jobs as a code with Jenkins pipelines.

CircleCI is well suited for small projects where the main task is to run continuous integration as quickly as possible. Travis CI is recommended primarily for open-source projects that need to be tested in different environments.

And for something a bit larger I prefer to use Jenkins because it is possible to make serious system configuration thereby different plugins. In Jenkins, I can change almost anything. But if you want to start the CI chain as soon as possible, Jenkins may not be the right choice.

See more
Get Advice from developers at your company using Private StackShare. Sign up for Private StackShare.
Learn More
Pros of Jenkins
Pros of Sauce Labs
  • 522
    Hosted internally
  • 464
    Free open source
  • 314
    Great to build, deploy or launch anything async
  • 243
    Tons of integrations
  • 209
    Rich set of plugins with good documentation
  • 109
    Has support for build pipelines
  • 72
    Open source and tons of integrations
  • 63
    Easy setup
  • 61
    It is open-source
  • 54
    Workflow plugin
  • 11
    Configuration as code
  • 10
    Very powerful tool
  • 9
    Many Plugins
  • 8
    Great flexibility
  • 8
    Git and Maven integration is better
  • 7
    Continuous Integration
  • 6
    Slack Integration (plugin)
  • 6
    Github integration
  • 5
    Self-hosted GitLab Integration (plugin)
  • 5
    100% free and open source
  • 5
    Easy customisation
  • 4
    Docker support
  • 3
    Platform idnependency
  • 3
    Excellent docker integration
  • 3
    Fast builds
  • 3
    Pipeline API
  • 2
    Hosted Externally
  • 2
    It`w worked
  • 2
    Can be run as a Docker container
  • 2
    Customizable
  • 2
    AWS Integration
  • 2
    It's Everywhere
  • 2
    JOBDSL
  • 1
    NodeJS Support
  • 1
    PHP Support
  • 1
    Ruby/Rails Support
  • 1
    Universal controller
  • 1
    Easily extendable with seamless integration
  • 1
    Build PR Branch Only
  • 59
    Selenium-compatible
  • 46
    Webdriver compatible
  • 35
    Video recordings of every test
  • 31
    Qa
  • 29
    Mobile support
  • 26
    Any programming language
  • 23
    Developer tools
  • 21
    Test local and firewalled servers
  • 20
    Jenkins integration
  • 18
    Pristine VMs
  • 17
    CI Compatible
  • 11
    Appium support
  • 9
    Parallel testing
  • 8
    Rapid environment preparation
  • 7
    Easy testing on almost any device
  • 7
    Allows me to Focus more test automation rather than IT
  • 7
    Mobile device support
  • 6
    Secure testing and easy setup
  • 5
    Easy setup with CI and fast automated tests
  • 5
    Quick support response
  • 4
    Fast and reliable to host the automated tests
  • 4
    Easy to setup and understand,
  • 3
    Easy onboarding, do not need to manager VMs/OS/Browsers
  • 3
    Easy setup and integration with Travis Ci
  • 3
    Maintained browser matrix
  • 2
    Generous free trial
  • 2
    Easy. Straightforward. Scalable
  • 2
    Great way to integrate test suite on cloud
  • 2
    Hany for platform testing
  • 2
    Teamcity Integration and mobile testing win
  • 2
    Great documentation
  • 2
    Simplicity of Sauce-connect
  • 2
    Efficient tool to verify product quality
  • 1
    It's great for my QA work
  • 1
    QE support
  • 1
    Secure testing
  • 1
    Stable
  • 1
    Very Good, Quick, flexible Infrastructure Support
  • 1
    Amazing service to do cloud cross browser testing
  • 1
    Depth of integrations
  • 1
    Because of its cloud based support for appium
  • 1
    Manuals are not very well versed for beginners
  • 1
    Cheaper than browserstack
  • 1
    Having this available for CI servers is fantastic
  • 1
    Awesome tech support
  • 1
    Easy setup, Works great with selenium.
  • 0
    Simple to set up and integrate so many browser configs

Sign up to add or upvote prosMake informed product decisions

Cons of Jenkins
Cons of Sauce Labs
  • 12
    Workarounds needed for basic requirements
  • 8
    Groovy with cumbersome syntax
  • 6
    Limited abilities with declarative pipelines
  • 6
    Plugins compatibility issues
  • 5
    Lack of support
  • 4
    No YAML syntax
  • 2
    Too tied to plugins versions
  • 2
    Expensive
  • 1
    Relatively slow

Sign up to add or upvote consMake informed product decisions

- No public GitHub repository available -

What is Jenkins?

In a nutshell Jenkins CI is the leading open-source continuous integration server. Built with Java, it provides over 300 plugins to support building and testing virtually any project.

What is Sauce Labs?

Cloud-based automated testing platform enables developers and QEs to perform functional, JavaScript unit, and manual tests with Selenium or Appium on web and mobile apps. Videos and screenshots for easy debugging. Secure and CI-ready.

Need advice about which tool to choose?Ask the StackShare community!

What companies use Jenkins?
What companies use Sauce Labs?
See which teams inside your own company are using Jenkins or Sauce Labs.
Sign up for Private StackShareLearn More

Sign up to get full access to all the companiesMake informed product decisions

What tools integrate with Jenkins?
What tools integrate with Sauce Labs?

Sign up to get full access to all the tool integrationsMake informed product decisions

Blog Posts

Mar 24 2021 at 12:57PM

Pinterest

+7
3
1474
+4
4
1721
Dec 4 2019 at 8:01PM

Pinterest

+4
5
2917
+22
17
13284
+42
53
19673
What are some alternatives to Jenkins and Sauce Labs?
TeamCity
TeamCity is a user-friendly continuous integration (CI) server for professional developers, build engineers, and DevOps. It is trivial to setup and absolutely free for small teams and open source projects.
CircleCI
Continuous integration and delivery platform helps software teams rapidly release code with confidence by automating the build, test, and deploy process. Offers a modern software development platform that lets teams ramp.
Travis CI
Free for open source projects, our CI environment provides multiple runtimes (e.g. Node.js or PHP versions), data stores and so on. Because of this, hosting your project on travis-ci.com means you can effortlessly test your library or applications against multiple runtimes and data stores without even having all of them installed locally.
Bamboo
Focus on coding and count on Bamboo as your CI and build server! Create multi-stage build plans, set up triggers to start builds upon commits, and assign agents to your critical builds and deployments.
Apache Maven
Maven allows a project to build using its project object model (POM) and a set of plugins that are shared by all projects using Maven, providing a uniform build system. Once you familiarize yourself with how one Maven project builds you automatically know how all Maven projects build saving you immense amounts of time when trying to navigate many projects.
See all alternatives