Senior Data Engineer at TargetSmart Communications

Posted on: 12/23/2021

Location: (REMOTE)

Original Source

Tags: ecs s3 etl sql qa pandas python aws

| **Job Title** | **Senior Data Engineer** | Location | Remote | Salary | $105,000 - $130,000 **TARGETSMART SENIOR DATA ENGINEER** A TargetSmart Senior Data Engineer鈥檚 role is to lead and implement data engineering projects, support and maintain data pipelines, and provide expertise and best practices regarding data engineering for staff across the company. Typical data engineering projects focus on improving performance and adding feature to existing data pipelines. As needed, the Senior Data Engineer will design and develop new data engineering pipelines as part of the Data Engineering Team. Further, the Senior Data Engineer will help decide how and implement improvements to pipeline, systems, and infrastructure. Senior Data Engineers are expected to have an in-depth understanding of data engineering best practices as well as expertise with the tools needed to debug and diagnose issues. Senior Data Engineers contribute as a team member to testing, QA, and documentation of data pipelines and systems. The TargetSmart Data Engineering Team is a small agile team of motivated individuals who welcome challenges, adapt quickly, strive to acquire new knowledge, learn new technologies, accept new responsibilities, and work well individually, as a team, and with other teams within the organization. You will work closely with the Data Engineering Lead, product managers, workflow developers and other software engineers to advance projects and meet objectives. We seek an experienced engineer that is interested in pursuing an advanced individual contributor technical career track over a technical management career track. **Senior Data Engineer Expectations:** 路 Maintain in-depth understanding of relevant data engineering best practices 路 Display expertise with tools needed to debug and diagnose issues 路 Given a medium to large understood problem, can design, implement, and deploy a solution 路 Show initiative and help when needed without being asked 路 Deliver feedback in a constructive manner 路 Provide guidance to other engineers and workflow developers 路 Work well with technical leads, incorporating feedback as needed 路 Support TargetSmart鈥檚 culture and mission as a leading Democratic & Progressive political data and data services firm. **REQUIRED SKILLS:** 路 AWS: S3 Data Lake, Athena, Redshift, EMR, Glue, ECS 路 Proficiency with Python in a data engineering context. Ex: Pandas, PySpark, Petl 路 Source control using Git 路 Proficiency with SQL 路 Proficiency with workflow orchestration concepts 路 Adaptable to Windows, Linux, and container-based deployment environments 路 Workflow performance, scaling, and optimization. Big Data solutions in some cases. 路 Security & privacy principals **Desired Skills & Qualifications** 路 Domain knowledge related to United States electoral data and consumer data 路 Workflow orchestration platforms: Prefect (<https://www.prefect.io/>) 路 ETL productivity tools: Alteryx (<https://www.alteryx.com/>)