Staff Software Engineer, MLOps at AssemblyAI

Posted on: 06/13/2022

Location: (REMOTE)

full time

Original Source

Tags: github aws python nlp ml

**AssemblyAI is an AI company - we build powerful models to transcribe and understand audio data, exposed through simple APIs.** Hundreds of companies, and thousands of developers, use our APIs to both transcribe and understand millions of videos, podcasts, phone calls, and zoom meetings every day. Our APIs power innovative products like conversational intelligence platforms, zoom meeting summarizers, content moderation, and automatic closed captioning. **We’ve been growing at breakneck speed, and are backed by leading investors including Y Combinator’s AI Fund, Patrick and John Collision (Founders of Stripe), Nat Friedman (Former CEO of GitHub), and Daniel Gross (Entrepreneur & Investor in companies including GitHub, Uber, Coinbase, SpaceX, Instacart, Notion, and Cruise Automation).** AssemblyAI’s Speech-to-Text APIs are already trusted by Fortune 500s, startups, and thousands of developers around the world, **with well-known customers including Spotify, Algolia, Dow Jones, The Wall Street Journal, and NBCUniversal.** As part of a huge and emerging market, AssemblyAI is well on its way to becoming the leader in speech recognition and NLP. **Join our world-class, remote team and help us build an iconic deep learning company.** **Our Team** ------------ **We are a fully remote team made up of problem solvers, innovators and top AI researchers with 20+ years of experience in Machine Learning, Speech Recognition, and NLP from places like DeepMind, Google, Meta, Amazon, Apple, and Cisco.** Our culture is super collaborative, low-ego, transparent, and fast-paced. We want to win - and have a flat organization where everyone can openly share ideas (regardless of their title or position) in order to get the best idea. As a remote company, our team members are given a lot of trust and autonomy to work where and how they want. We look for people to join our team who are ambitious, curious, and self-motivated, and we put a lot of trust and autonomy into everyone on our team. **We want to empower everyone to do their best work with whatever tools, structures, or resources they need to perform at their highest potential.** Responsibilities ---------------- * Build ML model CI/CD pipelines for building, registering, testing, and deploying model changes * Oversee the integration and deployment of new models or model upgrades. Ensure accuracy, latency, scalability, reliability, and costs are within tolerance. * Design, implement and deliver new and improved model inference service architectures * Improve observability of inference models in both production and test environments * Identify risks to performance, cost, and reliability in model inference systems and work methodically within a team environment to eliminate these risks. * Own the future of model onboarding, operations, and decommissioning workflows Day in the life --------------- * Work closely with AI researchers on integrating new models into an end to end model delivery pipeline * Design a highly scalable model inference architecture * Upgrade existing production model services * Analyzing test reports for system or business risks * Analyze production model metrics and develop project plans for fixing inefficiencies * Instrument model-driven microservices to improve observability **Requirements** ---------------- * You have real-world experience shipping ML inference models at scale. You’re familiar with the popular ML libraries. You’ve done mini batching at scale and can speak to its importance. * You’re a coder at heart. You have strong programming skills in a major language and Python is one of them. If there’s not a tool, library, or framework out there you need, you can write one. * You’re well-versed in distributed systems, microservices, data pipelines, and streaming architectures. You’ve also scaled these types of systems to process millions to billions of records per day. * You have a strong DevOps skillset. You’ve built CI/CD pipelines that cover the building, testing, and deployments. You’re familiar with infrastructure as code and know AWS very well. * You’ve worked heavily on monitoring and observability problems. You’ve instrumented complex systems with metrics so that you can tell a story with data. You’ve worked in a data-driven culture and can speak to its value. * You’ve successfully served as technical lead of critical projects that included at least 3 to 4 other engineers. You know how to break down, communicate, and delegate complex projects to a team. **Benefits** ------------ * Competitive Salary + OTE * Equity * 100% Remote team * Unlimited PTO * Premium Healthcare (100% Covered for you + dependents) * Vision & Dental Care * $1K budget for your home office setup * New Macbook Pro (or PC if you prefer) * 3-4x/year company paid team retreat