Senior/Staff Software Engineer, Data Engineer Focus at Spreedly

Posted on: 11/17/2021

Location: (REMOTE)

Original Source

Tags: sentry heroku rails consul elixir s3 phoenix datadog redis etl github sql ruby docker postgresql python ml dynamodb aws kafka postgres nomad

Our list of "amazing functionality that customers will happily pay us for if we can just get it implemented..." is growing faster than we can check things off, and we need help from an experienced engineer that can hop into a high-functioning, experienced team and start learning and contributing quickly. Spreedly is seeking a senior/staff-level engineer with a background in data engineering to help us accelerate data related initiatives. We have new data intensive projects in the works and we need an experienced engineer to help lead the way. In this role, you’ll be operating primarily as a software engineer though you have heavy experience designing data architectures (think data pipelines, data warehouses, data modeling, and database design). We will rely on you to provide input and direction on our data strategy and will look for you to demonstrate best practices alongside suggestions for improvements and optimizations. You are excited by and up for the challenge of working on a complex distributed ETL problem from the ground up. Bonus points if you have machine learning experience; there are opportunities to introduce ML at Spreedly and we’d love for you to get us started. What we're looking for in a senior/staff engineer is somebody who's excited by jumping into pretty complex technical problems and making sense of them. We regularly deal with encryption, encoding, and security, all within the context of a distributed system. You don't have to be an expert in any of those aspects, but you should be really open to learning about them. Once you've gotten your feet under you and understand the domain well enough, we'd like you to mentor junior engineers and help them tackle the task at hand using pragmatic software practices. We're looking for people that are good at their job who are also are interested in elevating the people around them. **Requirements** * 7+ years of progressive software engineering experience with a backend and/or data focus * Experience with one or more high-level non-SQL-based data processing language (e.g. Python, Java, Ruby, Elixir) * Direct experience with fault-tolerant distributed databases such as Riak, DynamoDB, and CockroachDB * Demonstrated experience designing data intensive applications * Proficiency with SQL and experience working with high volume datasets in SQL-based warehouses such as Snowflake, BigQuery, Redshift, or others * Deep understanding of data modeling, access, storage, and optimization techniques * Experience collecting, parsing, and aggregating data from multiple sources in disparate formats * A track record of delivering well-crafted software * The ability to operate autonomously, sorting your own immediate priorities out of the ever-shifting needs of a startup environment * Confidence in your ability to learn new tech as necessary **Bonus points! You might have some of the following** * 2+ years experience as a Data Engineer or similar role * Experience building data pipelines using Kafka * Experience with ETL tools such as Fivetran * Exposure to Looker, Tableau, or other analytics tools * Familiarity with AWS S3, Glue, and Athena * Experience with machine learning techniques * Knowledge of batch and streaming data architectures * Proficiency in Ruby or Elixir **Our tech stack** * Spreedly’s environment is a SaaS platform consisting primarily of AWS, Heroku, Ruby, Rails, Elixir, Phoenix, Riak,Kafka, Postgres, Redis, Cockroach DB, Snowflake, Looker, and Linux ... but are always pragmatically evaluating new languages and tools. We regularly deal with encryption, encoding, and security, all within the context of a distributed system. **What we offer** * Competitive salary + Equity * Outstanding Medical and Dental Insurance: Premiums are 100% company paid for employees and families * Note: We offer two PPO health insurance plans: A traditional copay and a high deductible with HSA. Spreedly contributes $1,200/$2,400 per year to the HSA for those choosing the high deductible plan * Life and long-term disability insurance * Optional Vision insurance and various Flexible Spending Accounts (FSA) * Open Paid Time Off policy + 12 weeks paid leave for new parents * Matching 401k plan (5% up to $5,000 yearly) * Monthly digital lifestyle stipend ($150), new Macbook, and $200 accessory reimbursement * $3,000 annual Professional Development stipend and free LinkedIn Learning subscription * Flexible, remote friendly work environment * Quarterly visits to HQ for remote employees **You'll love this job if you** * Enjoy working to improve resiliency and performance of systems on the AWS cloud * Have a keen familiarity with applications written in Ruby on Rails and maybe Elixir * Can find a solution, even when faced with system limitations or fragility * Have a deep understanding of MTBF, MTTR, SLAs, SLIs and SLOs * Enjoy mentoring other engineers and fostering a collaborative environment * Always check power and connections **Our stack** * AWS, CockroachDB, Consul, Datadog, Docker, Fastly, Github, Kafka, Nomad, PostgreSQL, Redis, Riak, Sentry, Sumo Logic, Ubuntu, Vault **What we offer** * Competitive salary + Equity * Outstanding Medical and Dental Insurance: Premiums are 100% company paid for employees and families * Note: We offer two PPO health insurance plans: A traditional copay and a high deductible with HSA. Spreedly contributes $1,200/$2,400 per year to the HSA for those choosing the high deductible plan * Life and long-term disability insurance * Optional Vision insurance and various Flexible Spending Accounts (FSA) * Open Paid Time Off policy + 12 weeks paid leave for new parents * Matching 401k plan (5% up to $5,000 yearly) * Monthly digital lifestyle stipend ($150), new Macbook, and $200 accessory reimbursement * $3,000 annual Professional Development stipend and free LinkedIn Learning subscription * Flexible, remote friendly work environment * Quarterly visits to HQ for remote employees We're constantly striving to have the fairest and most productive hiring process possible. We want to ensure that every candidate is treated equally and our interactions are designed with that goal in mind. If you want to get a sense for what your application process will look like, we'd encourage you to read the following: [Stop Hazing Your Potential Hires](http://engineering.spreedly.com/blog/stop-hazing-your-potential-hires.html) and [Programming Puzzles Are Not the Answer](http://engineering.spreedly.com/blog/programming-puzzles-are-not-the-answer-how-spreedly-does-work-samples.html). *Principals only, no recruiters.* ***You must live in the contiguous US except for CA and NY where we are not able to support remote workers. All applicants must have an existing US work visa.*** *Spreedly is an equal opportunity employer. We are committed to fostering, cultivating and preserving a culture of diversity, equity and inclusion. We actively work to drive out even unintentional discrimination in our hiring processes via practices like blindly graded work samples, structured interviews, and diversity awareness training.* *Due to the sensitive nature of what Spreedly does- handling payment data- candidates must complete a successful background check. If you have concerns along those lines, please discuss with us sooner rather than later- we do not want you to waste time in the hiring process and get disqualified at the end if we can help it.* *We appreciate your interest in our company. Because of the high volume of resume flow, we may only respond to those candidates that we think will be a potential fit.*