We are looking for a Senior DevOps Engineer. In this role, you will be managing large-scale, highly-available big data pipelines. You will be a key part of the design, architecture, instrumentation, and delivery of a massive data pipeline. As a member of a cross-functional team, you'll have the opportunity to solve challenging operational problems.
Key Responsibilities
- Building infrastructure for data processing (using technologies: Clickhouse, HDFS/Minio, Apache Airflow, Apache Zookeeper, Apache Zeppelin, K8S, Redis, RabbitMQ...)
- Supporting and monitoring infrastructure needed for data processing
- Coordinate System Administrators team with operational related things
- A person who will be responsible for driving CI/CD processes
- Help with digital transformation to the service model
- Became a Delivery Service Owner
- Knowledge sharing
- Coordinate Teams in daily activities
Ideal Experience
- BigData, Apache Zookeeper, Apache Kafka, Clickhouse, Apache Airflow, Apache Zeppelin, RabbitMQ, Redis
- Experience with distributed files system or object stores
- Ansible, chef, puppet experience would be a plus
- Understanding of CI/CD and practical experience with it
- Infrastructure as code: Terraform, Helm, Ansible
- Automation tools: Jenkins, Gradle
- Experience with Docker and/or container orchestration (Docker, Kubernetes, Mesos, or similar)
- Experience in Google Cloud Platform is a plus
- Natural influencer, and team player, willing to help your team achieve great things
- Excellent problem-solving skills
- Provide hardware architectural guidance, planning, estimating cluster capacity, and creating roadmaps
- Analytical, result-oriented mindset
Additional nice to have experience
- ITIL
- Good understanding of monolith and microservices
- Good understanding of networking
- Costs Optimization (Hardware, GCP, AWS)
- Information Security understanding
- Team player, easy in contact and positive attitude
- DevOps experience >= 3 years
- Shell scripting
- Good understanding of containerization and virtualization, their advantages, and minuses
- Git, bitbucket, gitlab, github
Stack Overflow