Data Engineer at Webinterpret Poland Sp. z o.o.

Posted on: 10/20/2021

Location: (REMOTE)

Original Source

Tags: apache nosql numpy sql s3 spark etl kafka pandas kubernetes docker aws python

**Data Engineer****Location:** 100% Remote or Warsaw, Poland (city center)**Experience:** Mid-Senior **Technology stack:** * Data Lake (AWS S3, EMR, Glue, Athena, Kinesis, Apache Hudi, Delta Lake) * Data Warehouse (AWS Redshift) * ETL (Airflow, Python, Spark) * Infrastructure (Kubernetes, Docker, CI/CD) * Python (pandas, numpy, boto3) * 3rd party APIs (Salesforce, Marketo, Zendesk, Zuora) **What do we do?** * Building the Data Lake in AWS where we process 500M+ records daily * Maintaining Data Warehouse (AWS Redshift) * Constructing ETL data pipelines in Airflow, Python and Spark * Standardizing and cleaning the data from many different sources (SQL, NoSQL DBs, APIs, queues) for internal reporting * Architecting scalable Data Streaming is our next big milestone **What expertise we are looking for?** * Data Streaming (Kafka, Kinesis, Spark) * ETL pipelines in Python * Docker and Kubernetes * Advanced SQL and performance tuning * Git version control system **How do we work?** * We believe in teamwork and self-organization * We follow Agile principles (Scrum and Kanban) * We are highly autonomous - we choose tools that make our work more efficient * We are closely cooperating with the business stakeholders, product developers and data scientists **What do we offer?** * English is our working language and our colleagues at Webinterpret come from every corner of the globe, working in a diverse, passionate and international team. For most opportunities, we also offer visa and relocation support. * We take care of our employees and offer flexible working hours, while giving them the opportunity to work remotely * Enjoy our brand new chillout zone anytime you need to take a break * Take care of your physical and mental self with our free Multisport membership * Benefit from our private medical care package * Develop your language skills with free courses in French, German, English and Polish * Access our e-learning platform and participate in various in-house trainings * Join our legendary company parties, team integrations, and sport events * Our office lounges are filled with healthy fruits and occasional live cooking * When it comes to dress code - there is no dress code at Webinterpret! We offer a fun, come as you are vibe.