Get Advice Icon

Need advice about which tool to choose?Ask the StackShare community!

AWS CloudFormation

1.5K
1.3K
+ 1
88
Concourse

261
393
+ 1
54
Add tool

AWS CloudFormation vs Concourse: What are the differences?

Introduction:

AWS CloudFormation and Concourse are both popular tools used for infrastructure automation and configuration management. However, they have several key differences that set them apart in terms of functionality and use cases.

1. Integration with AWS Services: AWS CloudFormation is tightly integrated with other AWS services, allowing users to easily provision and manage resources within the AWS ecosystem. On the other hand, Concourse is more focused on continuous integration and continuous delivery (CI/CD) pipelines and may have limited integration with specific cloud providers such as AWS.

2. Templating and Configuration Management: AWS CloudFormation utilizes JSON or YAML templates to define and provision resources in a declarative manner, making it easy to manage infrastructure as code. Concourse, on the other hand, is primarily designed for automating workflows and pipelines, with a focus on running tasks and jobs rather than defining infrastructure configurations.

3. Workflow Automation: Concourse excels in automating complex workflows, especially in the software development lifecycle, where it can orchestrate multiple tasks and stages seamlessly. AWS CloudFormation, while capable of provisioning resources in a structured manner, may not offer the same level of workflow automation and pipeline management capabilities as Concourse.

4. User Community and Support: AWS CloudFormation has a large user base and extensive documentation and support provided by Amazon Web Services, making it easier for users to troubleshoot issues and find resources for learning and development. Concourse, while popular in the CI/CD community, may have a smaller user community and may require more effort to find relevant information and support.

5. Scalability and Flexibility: AWS CloudFormation is well-suited for managing large-scale infrastructure deployments and environments, with capabilities for handling complex dependencies and resource configurations. Concourse, while scalable for CI/CD workflows, may not offer the same level of flexibility and customization for infrastructure provisioning and management tasks.

6. Cost Considerations: When considering cost implications, AWS CloudFormation is a service provided by AWS, so users may incur costs based on their resource usage and provisioning. Concourse, being an open-source tool, may provide a cost-effective solution for organizations looking to implement CI/CD pipelines without additional licensing fees or service charges.

In Summary, AWS CloudFormation is ideal for infrastructure provisioning and management within the AWS ecosystem, while Concourse is more focused on automating workflows and pipelines in the CI/CD process, with differences in integration, templating, workflow automation, community support, scalability, and cost considerations.

Advice on AWS CloudFormation and Concourse
Needs advice
on
ConcourseConcourse
and
JenkinsJenkins

I'm planning to setup complete CD-CD setup for spark and python application which we are going to deploy in aws lambda and EMR Cluster. Which tool would be best one to choose. Since my company is trying to adopt to concourse i would like to understand what are the lack of capabilities concourse have . Thanks in advance !

See more
Replies (1)
Maxi Krone
Cloud Engineer at fme AG · | 2 upvotes · 436.6K views
Recommends
on
ConcourseConcourse

I would definetly recommend Concourse to you, as it is one of the most advanced modern methods of making CI/CD while Jenkins is an old monolithic dinosaur. Concourse itself is cloudnative and containerbased which helps you to build simple, high-performance and scalable CI/CD pipelines. In my opinion, the only lack of skills you have with Concourse is your own knowledge of how to build pipelines and automate things. Technincally there is no lack, i would even say you can extend it way more easily. But as a Con it is more easy to interact with Jenkins if you are only used to UIs. Concourse needs someone which is capable of using CLIs.

See more
Decisions about AWS CloudFormation and Concourse
Kirill Shirinkin
Cloud and DevOps Consultant at mkdev · | 3 upvotes · 153.6K views

Ok, so first - AWS Copilot is CloudFormation under the hood, but the way it works results in you not thinking about CFN anymore. AWS found the right balance with Copilot - it's insanely simple to setup production-ready multi-account environment with many services inside, with CI/CD out of the box etc etc. It's pretty new, but even now it was enough to launch Transcripto, which uses may be a dozen of different AWS services, all bound together by Copilot.

See more

Because Pulumi uses real programming languages, you can actually write abstractions for your infrastructure code, which is incredibly empowering. You still 'describe' your desired state, but by having a programming language at your fingers, you can factor out patterns, and package it up for easier consumption.

See more
Sergey Ivanov
Overview

We use Terraform to manage AWS cloud environment for the project. It is pretty complex, largely static, security-focused, and constantly evolving.

Terraform provides descriptive (declarative) way of defining the target configuration, where it can work out the dependencies between configuration elements and apply differences without re-provisioning the entire cloud stack.

Advantages

Terraform is vendor-neutral in a way that it is using a common configuration language (HCL) with plugins (providers) for multiple cloud and service providers.

Terraform keeps track of the previous state of the deployment and applies incremental changes, resulting in faster deployment times.

Terraform allows us to share reusable modules between projects. We have built an impressive library of modules internally, which makes it very easy to assemble a new project from pre-fabricated building blocks.

Disadvantages

Software is imperfect, and Terraform is no exception. Occasionally we hit annoying bugs that we have to work around. The interaction with any underlying APIs is encapsulated inside 3rd party Terraform providers, and any bug fixes or new features require a provider release. Some providers have very poor coverage of the underlying APIs.

Terraform is not great for managing highly dynamic parts of cloud environments. That part is better delegated to other tools or scripts.

Terraform state may go out of sync with the target environment or with the source configuration, which often results in painful reconciliation.

See more

I personally am not a huge fan of vendor lock in for multiple reasons:

  • I've seen cost saving moves to the cloud end up costing a fortune and trapping companies due to over utilization of cloud specific features.
  • I've seen S3 failures nearly take down half the internet.
  • I've seen companies get stuck in the cloud because they aren't built cloud agnostic.

I choose to use terraform for my cloud provisioning for these reasons:

  • It's cloud agnostic so I can use it no matter where I am.
  • It isn't difficult to use and uses a relatively easy to read language.
  • It tests infrastructure before running it, and enables me to see and keep changes up to date.
  • It runs from the same CLI I do most of my CM work from.
See more
Manage your open source components, licenses, and vulnerabilities
Learn More
Pros of AWS CloudFormation
Pros of Concourse
  • 43
    Automates infrastructure deployments
  • 21
    Declarative infrastructure and deployment
  • 13
    No more clicking around
  • 3
    Any Operative System you want
  • 3
    Atomic
  • 3
    Infrastructure as code
  • 1
    CDK makes it truly infrastructure-as-code
  • 1
    Automates Infrastructure Deployment
  • 0
    K8s
  • 16
    Real pipelines
  • 10
    Containerised builds
  • 9
    Flexible engine
  • 6
    Fast
  • 4
    Open source
  • 3
    No Snowflakes
  • 3
    Simple configuration management
  • 2
    You have to do everything
  • 1
    Fancy Visualization

Sign up to add or upvote prosMake informed product decisions

Cons of AWS CloudFormation
Cons of Concourse
  • 4
    Brittle
  • 2
    No RBAC and policies in templates
  • 2
    Fail forward instead of rollback pattern

Sign up to add or upvote consMake informed product decisions

8.3K
541
76
429
- No public GitHub repository available -

What is AWS CloudFormation?

You can use AWS CloudFormation’s sample templates or create your own templates to describe the AWS resources, and any associated dependencies or runtime parameters, required to run your application. You don’t need to figure out the order in which AWS services need to be provisioned or the subtleties of how to make those dependencies work.

What is Concourse?

Concourse's principles reduce the risk of switching to and from Concourse, by encouraging practices that decouple your project from your CI's little details, and keeping all configuration in declarative files that can be checked into version control.

Need advice about which tool to choose?Ask the StackShare community!

What companies use AWS CloudFormation?
What companies use Concourse?
Manage your open source components, licenses, and vulnerabilities
Learn More

Sign up to get full access to all the companiesMake informed product decisions

What tools integrate with AWS CloudFormation?
What tools integrate with Concourse?

Sign up to get full access to all the tool integrationsMake informed product decisions

Blog Posts

What are some alternatives to AWS CloudFormation and Concourse?
AWS CodeDeploy
AWS CodeDeploy is a service that automates code deployments to Amazon EC2 instances. AWS CodeDeploy makes it easier for you to rapidly release new features, helps you avoid downtime during deployment, and handles the complexity of updating your applications.
Chef
Chef enables you to manage and scale cloud infrastructure with no downtime or interruptions. Freely move applications and configurations from one cloud to another. Chef is integrated with all major cloud providers including Amazon EC2, VMWare, IBM Smartcloud, Rackspace, OpenStack, Windows Azure, HP Cloud, Google Compute Engine, Joyent Cloud and others.
Terraform
With Terraform, you describe your complete infrastructure as code, even as it spans multiple service providers. Your servers may come from AWS, your DNS may come from CloudFlare, and your database may come from Heroku. Terraform will build all these resources across all these providers in parallel.
AWS Elastic Beanstalk
Once you upload your application, Elastic Beanstalk automatically handles the deployment details of capacity provisioning, load balancing, auto-scaling, and application health monitoring.
AWS Config
AWS Config is a fully managed service that provides you with an AWS resource inventory, configuration history, and configuration change notifications to enable security and governance. With AWS Config you can discover existing AWS resources, export a complete inventory of your AWS resources with all configuration details, and determine how a resource was configured at any point in time. These capabilities enable compliance auditing, security analysis, resource change tracking, and troubleshooting.
See all alternatives