Data Engineer
Location: 100% Remote or Warsaw, Poland (city center)
Experience: Mid-Senior
Technology stack:
- Data Lake (AWS S3, EMR, Glue, Athena, Kinesis, Apache Hudi, Delta Lake)
- Data Warehouse (AWS Redshift)
- ETL (Airflow, Python, Spark)
- Infrastructure (Kubernetes, Docker, CI/CD)
- Python (pandas, numpy, boto3)
- 3rd party APIs (Salesforce, Marketo, Zendesk, Zuora)
What do we do?
- Building the Data Lake in AWS where we process 500M+ records daily
- Maintaining Data Warehouse (AWS Redshift)
- Constructing ETL data pipelines in Airflow, Python and Spark
- Standardizing and cleaning the data from many different sources (SQL, NoSQL DBs, APIs, queues) for internal reporting
- Architecting scalable Data Streaming is our next big milestone
What expertise we are looking for?
- Data Streaming (Kafka, Kinesis, Spark)
- ETL pipelines in Python
- Docker and Kubernetes
- Advanced SQL and performance tuning
- Git version control system
How do we work?
- We believe in teamwork and self-organization
- We follow Agile principles (Scrum and Kanban)
- We are highly autonomous - we choose tools that make our work more efficient
- We are closely cooperating with the business stakeholders, product developers and data scientists
What do we offer?
- English is our working language and our colleagues at Webinterpret come from every corner of the globe, working in a diverse, passionate and international team. For most opportunities, we also offer visa and relocation support.
- We take care of our employees and offer flexible working hours, while giving them the opportunity to work remotely
- Enjoy our brand new chillout zone anytime you need to take a break
- Take care of your physical and mental self with our free Multisport membership
- Benefit from our private medical care package
- Develop your language skills with free courses in French, German, English and Polish
- Access our e-learning platform and participate in various in-house trainings
- Join our legendary company parties, team integrations, and sport events
- Our office lounges are filled with healthy fruits and occasional live cooking
- When it comes to dress code - there is no dress code at Webinterpret! We offer a fun, come as you are vibe.