Scaling PostgreSQL at Thumbtack: Load Balancing And Health Checks

6,770

By Marco Almeida, Site Reliability Engineer at Thumbtack.


Introduction

Running PostgreSQL on a single primary master node is simple and convenient. There is a single source of truth, one instance to handle all reads and writes, one target for all clients to connect to, and only a single configuration file to maintain. However, such a setup usually does not last forever. As traffic increases, so does the number of concurrent reads and writes, the read/write ratio may become too high, a fast and reliable recovery plan needs to exist, the list goes on…

No single approach solves all possible scaling challenges, but there are quite a few options for scaling PostgreSQL depending on the requirements. When the read/write ratio is high enough, there is fairly straightforward scaling strategy: setup secondary PostgreSQL nodes (replicas) that stream data from the primary node (master) and split SQL traffic by sending all writes (INSERT, DELETE, UPDATE, UPSERT) to the single master node and all reads (SELECT) to the replicas. There can be many replicas, so this strategy scales better with a higher read/write ratio. Replicas are also valuable to implement a disaster recovery plan as it’s possible to promote one to master in the event of a failure.

Context

In 2014, Thumbtack was running PostgreSQL 9.1 on two servers: a basic master – slave setup leveraging PostgreSQL’s built-in streaming replication. Our infrastructure was comprised of a few dozen physical machines on SoftLayer running RHEL 5 and we were using HAproxy with Keepalived for load balancing. The future, already being planned for, would be powered by EC2 instances on AWS, running Debian 7 behind Elastic Load Balancers.

As traffic grew, we knew we would need to scale out PostgreSQL further. Thumbtack’s SQL traffic was (and still is) quite read-intensive, with less than 3% of all queries being executed on the master node. This was good news as it meant we could scale out by sending SELECT statements to a cluster of read-only replicas and leaving the master alone to process DML commands.

In order to properly implement this we would need:

  • an arbitrary number of read-only replicas behind a load balancer;
  • the load balancer itself could not be a single point of failure;
  • a way of performing health checks on each server, executed from the load balancer, so that failed nodes would be taken in and out of rotation automatically;
  • to support SoftLayer and AWS environments during the transition period.

Replication, high-availability, and load-balancing

We knew what we wanted the infrastructure to look like from a high-level perspective and had the tools available to implement almost all of it on both providers (Fig. 1).

Thumbtack Postgres Acrhictecture

One critical detail, however, was far from being a solved problem: health checks.

A basic ping on port 5432 was not enough. Performance and replication lag were (and still are!) very important factors to us — if a given replica is lagging behind by more than N (varying according to the database and the cluster we’re connecting to) seconds, we prefer not to use it until it recovers as it would otherwise lead to stale reads.

Custom health checks

Not having found an open source tool that implements powerful enough health-checks for PostgreSQL, we decided to write our own. These were the requirements:

  1. Work equally well on both environments — RHEL 5/HAproxy on Softlayer and Debian 7/ELBs on AWS
  2. Check basic TCP connectivity, on an arbitrary port, with a configurable timeout
  3. Check server availability by running a test query with a time limit — if a server is under load, it may be responding to TCP but not able to process a simple query (SELECT 1). We need to distinguish between these two scenarios, and potentially take different actions
  4. Check replication lag (time elapsed since the last transaction was replayed)
  5. Support custom health checks in the form of SQL queries — extensible and future-proof
  6. Low memory footprint — avoid “stealing” memory from PostgreSQL
  7. Minimal list of external dependencies

A web service, exposing a simple HTTP endpoint, would work in any environment and easily be able to test TCP connectivity. Simple queries and testing replication lag are just a special case of running arbitrary SQL queries as a health check, so we just focused on this one and implemented the others as a form of syntactic sugar.

Programming languages One important decision for delivering a platform independent solution with low memory footprint and minimal dependencies was the choice of the programming language. We considered a few from Python (there was already a reasonably large Python code base at Thumbtack), to Go (we were taking our first steps with it), and even Rust (too immature at the time).

We ended up writing it in C. It was easy to meet all requirements with only one external dependency for implementing the web server, clearly no challenges running it on any of the Linux distributions we were maintaining, and arguably the implementation with the smallest memory footprint given the choices above.

The final result

We named the project pgDoctor and made it publicly available on our Github repository. It uses microhttpd to implement a very simple web service that listens on port 8071, logs to the local7 syslog facility (configurable), and provides a reasonably rich set of configuration parameters. The behavior is quite simple: an HTTP GET request to :8071 returns 200 if all checks pass, 500 otherwise. All errors are logged.

pgDoctor has been running flawlessly on all our PostgreSQL replicas for roughly 3 years now, having gone through two major upgrades (9.1 –> 9.4 –> 9.6). As of now, there are 18 streaming replicas, all running pgDoctor alongside PostgreSQL, and distributed among 4 clusters. Each cluster supports different use cases and requires slightly different health checks.

PostgreSQL replicas are sometimes taken out of rotation. The most common reasons are temporary high replication lag or some transient issue with the underlying EC2 instance. As expected, they are added back to the cluster without any intervention once normality is restored and the health checks succeed.

Figure 2 shows a diagram of (a downsized version of) our production environment:

  • Three availability zones;
  • One master node and two hot-standby instances on different availability zones;
  • Three clusters of read-only replicas, streaming from the master, each with its own load balancer;
  • Several clients, on all availability zones, reading from one or more clusters and writing to the master.

Thumbtack Postgres Architecture 2

Does this sound interesting? There is a lot more to be done. Join Thumbtack and help us build, scale, and operate a high reliability service!

Related work

http://www.severalnines.com/mysql-load-balancing-haproxy-tutorial#issues https://www.digitalocean.com/community/tutorials/how-to-use-haproxy-to-set-up-mysql-load-balancing--3 http://www.severalnines.com/mysql-load-balancing-haproxy-tutorial#issues


Originally posted on Thumbtack Engineering

Tools mentioned in article
Open jobs at Thumbtack
iOS Engineer
, United States

We’re the technology leader building the modern home management platform. Today, millions of people use Thumbtack to effortlessly manage their homes. We help them confidently know what to do, when to do it and who to hire.

Our goal is simple: to be the only platform homeowners need to fix, maintain and improve their homes. As a long-term partner for homeowners, our promise is to turn what was once confusing and intimidating into something straightforward — and a lot less stressful.

At Thumbtack, we're not just creating a new era of homeownership. We’re supporting local economies and building stronger communities. Each day, we connect local professionals across America with busy homeowners so they can grow their businesses.

Thumbtack is for everyone. Our customers and pros come from all walks of life and every county in the country. We want our team to reflect that. If you come from an underrepresented background in tech, we strongly encourage you to apply.

Our North Star is bright and our ambitions are big. We’ve been at this for over a decade, but the way we see it: we’re just getting started.

Thumbtack by the Numbers

  • Available in all 3,143 U.S. counties.
  • Nearly 4.5 million customers in the last 12 months
  • Hundreds of thousands of local professionals on our platform
  • 65 million projects started on Thumbtack
  • Over 7 million 5-star reviews left for stellar pros

About the Engineering Team

At Thumbtack, engineers at every level build products and systems that directly impact our customers and professionals. Our challenges span a wide variety of areas, ranging from building search and booking experiences, to optimizing pricing systems, to building tools to help professionals grow their businesses. We believe in tackling these hard problems together as a team, with strong values around collaboration, ownership and transparency. To read more about the hard problems that our team is taking on, visit our engineering blog.

About the Role

We are looking to build an amazing mobile experience for hundreds of thousands of users. Can you imagine what you might do if you could run your business from your phone? If you could hire a service provider at any time day or night with just a few taps? The sky's the limit. We develop much of our products mobile first and have seen this investment pay off incredibly. We’re looking for engineers excited to build a fantastic product.

Responsibilities

  • Drive engineering projects to completion, with a tenacious focus on the business impact of those projects. Skilled at prioritizing tasks to deliver on goals with a sense of urgency.
  • Execute new ideas quickly and effectively on iOS while also being a resource to other teams and engineers.
  • Willing, when necessary, to solve tough technical problems at any level of the stack, and be persistent in getting to the solution.
  • Work collaboratively with cross-functional teams to plan and execute on engineering projects.

Must-Have Qualifications

If you don't think you meet all of the criteria below but still are interested in the job, please apply. Nobody checks every box, and we're looking for someone excited to join the team.

  • Passionate iOS engineer who is an expert in  building, testing, releasing, and maintaining applications in either Swift or Objective C
  • Minimum of 4 years of industry experience in engineering
  • History of shipping consumer focused apps that users love on the App Store, you can show what you’ve owned
  • Excited by the potential of mobile technology to transform the lives of small businesses around the country

Nice-to-Have Qualifications

  • Experience with libraries, frameworks, and services like Core Data, AFNetworking, Xcode UI Testing, Crashlytics, Firebase, and Apollo (GraphQL) 
  • Strong eye for beautiful design and user experience
  • Great communicator; we find that people who are good writers tend to be great thinkers and great coders
  • You’re data-­driven and dedicated to thorough testing to maintain high-­quality software

More About Us

Thumbtack is a technology leader building the modern home management platform. Through the Thumbtack app, homeowners can effortlessly manage their homes — confidently knowing what to do, when to do it, and who to hire. Bringing the $500 billion home services industry online, Thumbtack empowers millions of homeowners to fix, maintain, and improve their most valuable asset. 

Founded in 2008, Thumbtack is backed by over $500 million in funding from folks that include Sequoia Capital, CapitalG, Tiger Global Management, Javelin Investment Partners, Baillie Gifford. 

Thumbtack is a virtual-first company, meaning you can live and work from any one of our approved locations across the United States, Ontario or the Philippines. When it is safe to gather, we will begin to host in-person events on a regular basis. Remote employees will be expected to travel occasionally for these events to a Thumbtack library or offsite team-building location. In cities with 5+ employees, we are establishing local communities, where employees can gather for local events. Additionally, employees in the San Francisco, Salt Lake City, Toronto and Manila areas will have opt-in access to communal workspace at one of our Thumbtack libraries. We always prioritize the health and safety of our employees. Currently, participation in these events and Thumbtack library use are optional. Both require employees to be fully vaccinated.

#LI-Remote

Thumbtack embraces diversity. We are proud to be an equal opportunity workplace and do not discriminate on the basis of sex, race, color, age, sexual orientation, gender identity, religion, national origin, citizenship, marital status, veteran status, or disability status. Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

If you are a California resident, please review information regarding your rights under California privacy laws contained in Thumbtack’s Privacy policy available at https://www.thumbtack.com/privacy/.



Senior Software Engineer
, United States

We’re the technology leader building the modern home management platform. Today, millions of people use Thumbtack to effortlessly manage their homes. We help them confidently know what to do, when to do it and who to hire.

Our goal is simple: to be the only platform homeowners need to fix, maintain and improve their homes. As a long-term partner for homeowners, our promise is to turn what was once confusing and intimidating into something straightforward — and a lot less stressful.

At Thumbtack, we're not just creating a new era of homeownership. We’re supporting local economies and building stronger communities. Each day, we connect local professionals across America with busy homeowners so they can grow their businesses.

Thumbtack is for everyone. Our customers and pros come from all walks of life and every county in the country. We want our team to reflect that. If you come from an underrepresented background in tech, we strongly encourage you to apply.

Our North Star is bright and our ambitions are big. We’ve been at this for over a decade, but the way we see it: we’re just getting started.

Thumbtack by the Numbers

  • Available in all 3,143 U.S. counties.
  • Nearly 4.5 million customers in the last 12 months
  • Hundreds of thousands of local professionals on our platform
  • 65 million projects started on Thumbtack
  • Over 7 million 5-star reviews left for stellar pros

About the Engineering Team

At Thumbtack, engineers at every level build products and systems that directly impact our customers and professionals. Our challenges span a wide variety of areas, ranging from building search and booking experiences to optimizing pricing systems, to building tools to help professionals grow their businesses. We believe in tackling these hard problems together as a team, with strong values around collaboration, ownership, and transparency. To read more about the hard problems that our team is taking on, visit our engineering blog.

About the Role

As a Senior Software Engineer, you’ll focus on bringing the Thumbtack vision to life. You’ll collaborate with other engineers, designers and product managers to execute on a broad range of projects. This could include building new features to improve the experience of our users, architecting infrastructure to support a fast-­growing user base, or optimizing our marketplace mechanics to make better matches between customers and professionals.

Responsibilities

  • Drive engineering projects to completion, with a tenacious focus on the business impact of those projects. Skilled at prioritizing tasks to deliver on goals with a sense of urgency.
  • Solve tough technical problems at any level of the stack, and be persistent in getting to the solution, whether it involves front-end, back-end, or infrastructure work.
  • Work collaboratively with cross-functional teams to plan and execute on engineering projects.

Must-Have Qualifications

If you don't think you meet all of the criteria below but still are interested in the job, please apply. Nobody checks every box, and we're looking for someone excited to join the team.

  • Minimum of 5+ years of industry experience in engineering.
  • You’re fluent in at least one major programming language and would be able to switch between multiple languages. In our stack, we mainly use Go, Scala, Php, with Swift, Kotlin and Java for our mobile apps.
  • You have solid experience building software on top of relational databases such as Postgres or MySQL.
  • You know what it means to write high quality, maintainable, testable code, and you enjoy doing it.
  • You can break down complex problems rigorously and understand the tradeoffs necessary to deliver great, impactful products.
  • You’re curious, you’re data-driven, you love to ask questions, and you think critically about problems.
  • You love delivering value to your users and your teammates through your work.

Nice-to-Have Qualifications

  • You have experience building and maintaining reliable, performant distributed systems.
  • You’ve owned and driven the development of complex projects or feature areas over the course of several months or years.
  • You’ve used AWS and/or GCP and its suite of technologies such as DynamoDB, Elastic Beanstalk, etc.
  • You’re familiar with the big data ecosystem (Hadoop/HDFS, Hive, Spark, etc).
  • You’ve demonstrated your ability to thrive in a fast-paced startup environment.

More About Us

Thumbtack is a technology leader building the modern home management platform. Through the Thumbtack app, homeowners can effortlessly manage their homes — confidently knowing what to do, when to do it, and who to hire. Bringing the $500 billion home services industry online, Thumbtack empowers millions of homeowners to fix, maintain, and improve their most valuable asset. 

Founded in 2008, Thumbtack is backed by over $500 million in funding from folks that include Sequoia Capital, CapitalG, Tiger Global Management, Javelin Investment Partners, Baillie Gifford. 

Thumbtack is a virtual-first company, meaning you can live and work from any one of our approved locations across the United States, Ontario or the Philippines. When it is safe to gather, we will begin to host in-person events on a regular basis. Remote employees will be expected to travel occasionally for these events to a Thumbtack library or offsite team-building location. In cities with 5+ employees, we are establishing local communities, where employees can gather for local events. Additionally, employees in the San Francisco, Salt Lake City, Toronto and Manila areas will have opt-in access to communal workspace at one of our Thumbtack libraries.

#LI-Remote

Thumbtack embraces diversity. We are proud to be an equal opportunity workplace and do not discriminate on the basis of sex, race, color, age, sexual orientation, gender identity, religion, national origin, citizenship, marital status, veteran status, or disability status. Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

If you are a California resident, please review information regarding your rights under California privacy laws contained in Thumbtack’s Privacy policy available at https://www.thumbtack.com/privacy/.

Senior Software Engineer, Growth
, United States

We’re the technology leader building the modern home management platform. Today, millions of people use Thumbtack to effortlessly manage their homes. We help them confidently know what to do, when to do it and who to hire.

Our goal is simple: to be the only platform homeowners need to fix, maintain and improve their homes. As a long-term partner for homeowners, our promise is to turn what was once confusing and intimidating into something straightforward — and a lot less stressful.

At Thumbtack, we're not just creating a new era of homeownership. We’re supporting local economies and building stronger communities. Each day, we connect local professionals across America with busy homeowners so they can grow their businesses.

Thumbtack is for everyone. Our customers and pros come from all walks of life and every county in the country. We want our team to reflect that. If you come from an underrepresented background in tech, we strongly encourage you to apply.

Our North Star is bright and our ambitions are big. We’ve been at this for over a decade, but the way we see it: we’re just getting started.

Thumbtack by the Numbers

  • Available in all 3,143 U.S. counties.
  • Nearly 4.5 million customers in the last 12 months
  • Hundreds of thousands of local professionals on our platform
  • 65 million projects started on Thumbtack
  • Over 7 million 5-star reviews left for stellar pros

About the Engineering Team

Growth Engineering team’s charter is to enable Thumbtack’s Growth Marketing team to acquire customers and pros and ensure they are set up for success.  We partner with product, design, analytics, and data engineering teams to ensure we get maximum return on the millions of dollars spent towards marketing.  We believe in tackling these hard problems together as a team, with strong values around collaboration, ownership, and transparency. To read more about the hard problems Thumbtack engineering tackles on a daily basis, visit our engineering blog.

About the Role

As a Senior Software Engineer on the Growth team, you’ll focus on executing on Thumbtack’s growth strategy, working on both organic and paid growth. You’ll collaborate with other engineers, designers, product managers, analysts, data scientists and data engineers to execute on a broad range of projects.  This includes defining and executing on growth infrastructure roadmap, self serve and automation tools, making 3rd party data available to data engineers, and much more.

Responsibilities

  • Become the subject matter expert in marketing and growth technology.
  • Drive engineering projects to completion, with a tenacious focus on the business impact of those projects. Skilled at prioritizing tasks to deliver on goals with a sense of urgency.
  • Solve tough technical problems at any level of the stack, and be persistent in getting to the solution, whether it involves back-end, or infrastructure work.
  • Work collaboratively with cross-functional teams to plan and execute on engineering projects.

Must-Have Qualifications

If you don't think you meet all of the criteria below but still are interested in the job, please apply. Nobody checks every box, and we're looking for someone excited to join the team.

  • Minimum of 5+ years of industry experience in engineering
  • Understanding of marketing and growth technology to enable experimentations, automation, paid and engagement marketing and SEO initiatives
  • Experience evaluating, implementing and integrating 3rd party marketing tools (ex:  Optimizely, Iterable, Intercom, Linear and OTT ad tools)
  • Fluency in at least one major programming language and would be able to switch between multiple languages. In our stack, we mainly use Go, Scala, and PHP
  • You know what it means to write high quality, maintainable, testable code, and you enjoy doing it
  • You can break down complex problems rigorously and understand the tradeoffs necessary to deliver great, impactful products
  • You’re curious, you’re data-driven, you love to ask questions, and you think critically about problems

Nice-to-Have Qualifications

  • Experience or knowledge in growth and marketing
  • Experience with data pipelines (Airflow, BigQuery)
  • Experience leading or mentoring engineering teams
  • Demonstrated ability to thrive in a fast-paced startup environment

More About Us

Thumbtack is a technology leader building the modern home management platform. Through the Thumbtack app, homeowners can effortlessly manage their homes — confidently knowing what to do, when to do it, and who to hire. Bringing the $500 billion home services industry online, Thumbtack empowers millions of homeowners to fix, maintain, and improve their most valuable asset. 

Founded in 2008, Thumbtack is backed by over $500 million in funding from folks that include Sequoia Capital, CapitalG, Tiger Global Management, Javelin Investment Partners, Baillie Gifford. 

Thumbtack is a virtual-first company, meaning you can live and work from any one of our approved locations across the United States, Ontario or the Philippines. When it is safe to gather, we will begin to host in-person events on a regular basis. Remote employees will be expected to travel occasionally for these events to a Thumbtack library or offsite team-building location. In cities with 5+ employees, we are establishing local communities, where employees can gather for local events. Additionally, employees in the San Francisco, Salt Lake City, Toronto and Manila areas will have opt-in access to communal workspace at one of our Thumbtack libraries.We always prioritize the health and safety of our employees. Currently, participation in these events and Thumbtack library use are optional. Both require employees to be fully vaccinated.

#LI-Remote

Thumbtack embraces diversity. We are proud to be an equal opportunity workplace and do not discriminate on the basis of sex, race, color, age, sexual orientation, gender identity, religion, national origin, citizenship, marital status, veteran status, or disability status. Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

If you are a California resident, please review information regarding your rights under California privacy laws contained in Thumbtack’s Privacy policy available at https://www.thumbtack.com/privacy/.

 

Senior iOS Engineer
, Ontario

We’re the technology leader building the modern home management platform. Today, millions of people use Thumbtack to effortlessly manage their homes. We help them confidently know what to do, when to do it and who to hire.

Our goal is simple: to be the only platform homeowners need to fix, maintain and improve their homes. As a long-term partner for homeowners, our promise is to turn what was once confusing and intimidating into something straightforward — and a lot less stressful.

At Thumbtack, we're not just creating a new era of homeownership. We’re supporting local economies and building stronger communities. Each day, we connect local professionals across America with busy homeowners so they can grow their businesses.

Thumbtack is for everyone. Our customers and pros come from all walks of life and every county in the country. We want our team to reflect that. If you come from an underrepresented background in tech, we strongly encourage you to apply.

Our North Star is bright and our ambitions are big. We’ve been at this for over a decade, but the way we see it: we’re just getting started.

Thumbtack by the Numbers

  • Available in all 3,143 U.S. counties.
  • Nearly 4.5 million customers in the last 12 months
  • Hundreds of thousands of local professionals on our platform
  • 65 million projects started on Thumbtack
  • Over 7 million 5-star reviews left for stellar pros

About the Engineering Team

At Thumbtack, engineers at every level build products and systems that directly impact our customers and professionals. Our challenges span a wide variety of areas, ranging from building search and booking experiences, to optimizing pricing systems, to building tools to help professionals grow their businesses. We believe in tackling these hard problems together as a team, with strong values around collaboration, ownership and transparency. To read more about the hard problems that our team is taking on, visit our engineering blog.

About the Role

We are looking to build an amazing mobile experience for hundreds of thousands of users. Can you imagine what you might do if you could run your business from your phone? If you could hire a service provider at any time day or night with just a few taps? The sky's the limit. We develop much of our products mobile first and have seen this investment pay off incredibly. We’re looking for engineers excited to build a fantastic product.

Responsibilities

  • Drive engineering projects to completion, with a tenacious focus on the business impact of those projects. Skilled at prioritizing tasks to deliver on goals with a sense of urgency.
  • Execute new ideas quickly and effectively on iOS while also being a resource to other teams and engineers.
  • Willing, when necessary, to solve tough technical problems at any level of the stack, and be persistent in getting to the solution.
  • Work collaboratively with cross-functional teams such as Product and Design to plan and execute on engineering projects
  • Work on large projects and lead small teams of engineers

Must-Have Qualifications

If you don't think you meet all of the criteria below but still are interested in the job, please apply. Nobody checks every box, and we're looking for someone excited to join the team.

  • Passionate iOS engineer who is an expert in  building, testing, releasing, and maintaining applications in either Swift or Objective C
  • Minimum of 5 years of industry experience in engineering
  • History of shipping consumer focused apps that users love on the App Store, you can show what you’ve owned
  • Excited by the potential of mobile technology to transform the lives of small businesses around the country

Nice-to-Have Qualifications

  • Experience with libraries, frameworks, and services like Core Data, AFNetworking, Xcode UI Testing, Crashlytics, Firebase, and Apollo (GraphQL) 
  • Strong eye for beautiful design and user experience
  • Great communicator; we find that people who are good writers tend to be great thinkers and great coders
  • You’re data-­driven and dedicated to thorough testing to maintain high-­quality software

More About Us

Thumbtack is a technology leader building the modern home management platform. Through the Thumbtack app, homeowners can effortlessly manage their homes — confidently knowing what to do, when to do it, and who to hire. Bringing the $500 billion home services industry online, Thumbtack empowers millions of homeowners to fix, maintain, and improve their most valuable asset. 

Founded in 2008, Thumbtack is backed by over $500 million in funding from folks that include Sequoia Capital, CapitalG, Tiger Global Management, Javelin Investment Partners, Baillie Gifford. 

Thumbtack is a virtual-first company, meaning you can live and work from any one of our approved locations across the United States, Ontario or the Philippines. When it is safe to gather, we will begin to host in-person events on a regular basis. Remote employees will be expected to travel occasionally for these events to a Thumbtack library or offsite team-building location. In cities with 5+ employees, we are establishing local communities, where employees can gather for local events. Additionally, employees in the San Francisco, Salt Lake City, Toronto and Manila areas will have opt-in access to communal workspace at one of our Thumbtack libraries. We always prioritize the health and safety of our employees. Currently, participation in these events and Thumbtack library use are optional. Both require employees to be fully vaccinated.

#LI-Remote

Thumbtack embraces diversity. We are proud to be an equal opportunity workplace and do not discriminate on the basis of sex, race, color, age, sexual orientation, gender identity, religion, national origin, citizenship, marital status, veteran status, or disability status. Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

If you are a California resident, please review information regarding your rights under California privacy laws contained in Thumbtack’s Privacy policy available at https://www.thumbtack.com/privacy/.

 

Verified by
Infra & Data Eng Manager
You may also like