Senior Software Engineer, Runtime at Astronomer

Posted on: 06/23/2022

Location: (REMOTE)

Original Source

Tags: python qa apache nomad kubernetes docker

Astronomer is the commercial developer of Apache Airflow, a community-driven open-source tool that’s leading the market in data orchestration. We’re a globally-distributed and rapidly growing venture-backed team of learners, innovators and collaborators. Our mission is to build an Enterprise-grade product that makes it easy for data teams at Fortune 500’s and startups alike to adopt Apache Airflow. As a member of our team, you will be at the forefront of the industry as we strive to make Apache Airflow the de-facto standard in data orchestration. Your background may be unconventional; as long as you have the essential qualifications, we encourage you to apply. While having "bonus" qualifications makes for a strong candidate, Astronomer values diverse experiences. Many of us at Astronomer haven't followed traditional career paths, and we welcome it if yours hasn't either. **About this role** ------------------- We’re hiring on the Runtime team! Runtime works on the underlying systems and technologies that power Astronomer’s cloud offerings - both working on Airflow itself, making it more cloud-ready and flexible, as well as building our underlying platforms and systems that handle parsing, distribution, data storage, execution, and more. We’re looking for people who are comfortable and happy working on “greenfield” (new) system designs: creating predictable, observable, and reliable systems based on well-understood technologies and patterns. The team’s scope is large, and we’re looking for the kind of engineers who are happy wearing many hats: from figuring out a fresh systems design issue one day, to debugging low-level code issues the next. You’ll be working with a fantastic distributed team with a wide range of engineering specialties and disciplines - we value our ability to take on almost any problem together, and deliver things iteratively, with a focus on quick iteration, security, and reliability. **What you get to do:** ----------------------- * Design and implement cloud platform components, with a focus on security, scalability, and multi-tenancy. * Build out both brand new systems, as well as adapting and refactoring existing ones. * Analyze, debug, and resolve the issues of distributed systems and complex services. * Understand and work with low-level execution, scheduling, and orchestration problems. * Mentor more junior engineers and work with them to grow their skills and abilities. * Adapt to new technologies and languages as needed. * Work cross-functionally with other stakeholders like PM, QA, and other product teams in Cloud, Open-Source, and Services. **What you bring to the role:** ------------------------------- * Systems design knowledge and experience * Backend and/or infrastructure programming experience * High-level knowledge of Docker, Kubernetes or similar * Ability to adapt to unknown problems and work in an ambiguous, “blue sky” environment * Strong written and verbal communication * Strong sense of empathy, and ability to mentor and lead fellow engineers * A love for problem solving and delighting users **Bonus points if you have:** ----------------------------- * Deep familiarity with Docker, Kubernetes, Nomad, cgroups, or similar. * Deep familiarity with process or task scheduling, at any level * Built or maintained large portions of a SaaS offering operating at scale * Familiarity with Airflow or other Data Orchestration software * Expert-level knowledge of Python and/or Go * A history of open source contributions At Astronomer, we value diversity. We are an equal opportunity employer: we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. Astronomer is a remote-first company.