Cloud Native Data Engineer at [redacted]

Posted on: 10/28/2021

Location: (REMOTE)

Original Source

Tags: ancestry lambda nosql sql s3 spark serverless etl dynamodb kafka sns aws elasticsearch

**About Us:** [redacted]’s cybersecurity capabilities hail from commercial & cyber security industries and government intelligence & defense agencies. Our staff has defended Global Fortune 50 companies, start ups and critical government systems alike. We combine our experience, expertise and unique training to ensure our clients are able to operate securely and can respond accordingly to ensure business continuity with minimal impact to their operations, staff, partners or clients. We recognize that in cybersecurity one solution does not fit all. We collaborate with our clients to prioritize business needs and ensure success with the most relevant security controls. Doing the right thing is not optional. Extending our ingenuity to empower our clients is in our DNA. **General Position Overview:** [redacted] Engineering is seeking a Cloud Native Data Engineer to help in the development of our platform. We use cloud native tools and modern languages and design patterns to create informative and useful software to secure our clients and aid our internal teams. The Cloud Native Data Engineer will need to use infrastructure as code to deploy data stores in AWS and ETL for ingest, analysis, and discovery. **Responsibilities:** * Keeping up to date and sharing with relevant internal stakeholders data privacy compliance and regulatory requirements as they related to data use. * Managing and shepherding data storage and analysis. * Providing access, ingest, ETL, and help with analysis in multiple cloud environments (primarily AWS). * Owning responsibility for the design, development, and maintenance of datasets. * Participating in strategic & tactical planning discussions. * Adopting and committing to best practices in reporting and analysis with respect to data integrity, test design, analysis, availability, validation, and documentation. * Continually improving and supporting ongoing reporting and analysis processes. * Working in collaboration with business owners and other engineers to explore new data sources and deliver the data. * Modeling data and metadata for ad hoc and pre-built reporting. **Requirements:** * 2+ years of experience as a Data Engineer or in a similar role. * 3+ years of relevant experience in one of the following areas: data engineering, database engineering, business intelligence, or business analytics. * 3+ years of hands-on experience in writing complex, highly-optimized queries across large data sets. * Experience with data modeling, data warehousing, and building ETL pipelines. * Experience in SQL. * Experience with data modeling and data warehousing. * Experience with Elasticsearch ingest and query optimization. * Experience with AWS solutions such as OpenSearch, EC2, DynamoDB, S3, Redshift and other serverless services. * Experience dealing with APIs using various methods (webhooks, polling, pub/sub). * Experience designing and implementing complex ETL pipelines and other BI solutions using native AWS services and serverless technologies that leverage deep knowledge in the use of services such as EventBridge, Lambda, SNS, SQS, Kinesis, Kafka, Spark, EMR, Glue, Athena, and NoSQL technologies. * Strong interpersonal skills and attention to detail * Bachelor's degree or higher in a quantitative/technical field (e.g. Computer Science, Statistics, Engineering). **Perks:** We’re focused on creating the best experience for you through a holistic approach to benefits and perks. We work hard to make sure you have the best care and resources to thrive at all stages of your life, both inside and outside of Redacted. Here’s a snapshot of some of the benefits we offer: * Medical, dental, and vision insurance to keep you and your family healthy. * Generous home office and monthly internet reimbursements. * Pre-tax savings plans for health care, public transportation, and parking expenses. * Short-term and long-term disability benefits and life insurance. * Wellness program that provides monthly points that can be used for mind, body, and soul activities, discounts, and gift certificates. Redacted is proud to be an equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. Redacted will consider qualified applicants with arrest and conviction records for employment in a manner consistent with applicable laws. Salary range for CO-based applicants: $36-200k, depending on experience level.