Principal Engineer - Data PlatformApply
Twilio's Data Platform group delivers a self-service platform of powerful, scalable, reliable and high performance data services and infrastructure to keep up with our rapid growth and the increasing demands of our product teams, business units and external customers. As a Principal/Senior Engineer, you will be a core contributor in this group helping us to deliver the world-class data platform Twilio needs in order to succeed. You and your team will face some of the most complex challenges in distributed data systems at scale.
About the job:
- Develop low latency, highly available, globally distributed services in the flight path of every Voice Call and SMS message.
- Design and build data pipelines for handling millions of events per second.
- Work in a small, empowered team. Move fast - ship to prod multiple times in a 2 week sprint.
- Own and operate production services in AWS cloud infrastructure using the latest tools, like Datadog and Rollbar.
- Exposure to industry leading open source data technologies (Spark, Kafka, Kudu).
- 12+ years of experience leading development of Data products, services and tools, in Java and Scala.
- Drive quality by writing unit tests, functional tests, and performance tests in a continuous delivery environment.
- Break down requirements, estimate tasks and plan work accurately. Definition of done is Production.
- Support development operations, building, releasing and assisting with team on-call.
- Collaborate with other teams and mentor junior engineers. Work cross-functionally for product launches.
- Lead best practices in the team.
In the Twilio Data Platform group we believe that versatility and complementing proficiencies are the key to forming a better team. We are therefore looking for people with a variety of skills and specializations. You should have at least 3 of the proficiencies below to be considered for the role:
- Data persistency. You are an expert in designing, operating and fine-tuning highly-available data persistency layers. You teach and mentor engineers on how to apply the CAP theorem in everyday operations.
- Data Compliance: You understand and have built HIPAA, GDPR, PCI or other compliant system(s)
- Scalable backend. You understand scalability challenges and performance of server-side code. You can design and develop horizontally-scalable, resilient and efficient systems.
- Java or Scala. You are a Java or Scala enthusiast and professional. There is at least one framework in which you can be called an expert.
- Elasticsearch. You have experience scaling Elasticsearch, designing schemas, optimizing queries and making it highly available.
- Cloud. You are proficient in cloud technologies and are hands-on in at least one cloud platform: GCC, AWS, or Azure. You are able to both design and develop cloud-based systems and operate them in an automated fashion.
- Security. You are able to design secure distributed systems and assure operational processes around security. You understand fitness for purpose of security techniques.
Twilio's mission is to fuel the future of communications. Developers and businesses use Twilio to make communications relevant and contextual by embedding messaging, voice and video capabilities directly into their software applications. Founded in 2008, Twilio has over 650 employees, with headquarters in San Francisco and other offices in Bogotá, Dublin, Hong Kong, London, Madrid, Mountain View, Munich, New York City, Singapore and Tallinn.
Twilio is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal opportunity regardless of race, color, ancestry, religion, gender, gender identity, parental or pregnancy status, national origin, sexual orientation, age, citizenship, marital status, disability, or Veteran status and operate in compliance with the San Francisco Fair Chance Ordinance.