At Railroad19, we develop customized software solutions and provide software development services. We are currently seeking an (EMR)AWS DevOps Cloud Engineer that is familiar with Apache Spark using Scala on Amazon Web Services.
Core Responsibilities:
- Understand our client's fast-moving business requirements.
- Negotiate appropriate solutions with multiple stakeholders.
- Write and maintain scalable enterprise quality software.
- Develop new applications and production application support.
- Manage the complete software development life cycle.
- Writing functional and unit tests to maintain code quality.
- Develop an understanding of client business processes, objectives, and solution requirements.
- Participate in project meetings with subject matter experts and stakeholders to understand data-specific needs.
- Collaborate with other teams to deliver a high-performance application that contains little or no defects.
- Identify new opportunities, tools, and services to enhance the custom software platform.
- Support and troubleshoot issues (process &system), identify root causes, and proactively recommend sustainable corrective actions.
Skills &Experienced Required:
- Familiarity with Apache Spark 2.4 (Scala 2.11+)
- Hands-on experience using and configuring SBTfor building software solutions.
- Hands-on experience with database queries (SQL) and Spark SQL
- Experience with monitoring tools such as AWS CloudWatch, Prometheus and Grafana
- Hands-on experience with AWS offerings: S3, EMR, CloudWatch, Lambda Functions, Step Functions
- Familiarity with GitLab CI/CD
- Ability to automate the building and deployment of Spark Jobs and its infrastructure.
- Ability to write/run notebooks (Zeppelin/Jupyter)
- Bachelor’s degree in Computer Science or related field
- Self-directed, ability to multi-task, sharp analytical abilities
- Effective communication skills
- At Railroad19, you are part of a company that values your work and gives you the tools you need to succeed. We are headquartered in Saratoga Springs, New York, but we are a distributed team of remote developers across the US.
- This is a full-time role(forever) with paid vacation and holidays, competitive benefits, and 401k. Railroad19 provides competitive compensation with excellent benefits and collaborative corporate culture.