Senior Site Reliability Engineer - remote

Unanet, Inc.
Posted 4 years ago  • Sterling, VA
Stack Overflow

As a member of our Cloud Support group, you will help continue to define our transformation towards an enterprise SaaS solution, hosting numerous top-tier customers. With a quickly growing customer base, we need creative engineers to help architect innovative solutions to ensure the best possible experience for our customers. You will join a team of highly talented, rapidly moving developers and administrators involved in nearly every aspect of the SaaS delivery and customer experience lifecycle. We are looking for an engineer with a strong software development background who has experience building services to ensure that Cloud Support is lean, proactive, and efficient. To be successful you will need to apply a Software Engineer’s mentality to the functions of Operations, with a firm grasp of automation, cloud architectures, event monitoring, health checks, and metrics gathering. You should also be passionate about solving problems and developing creative solutions leveraging automation.

Your First 90 Days

In your first 30 Days, as your familiarity with the product and pipeline grows, your responsibilities and influence will grow as well. You will become immersed in all facets of the daily operation of the production cloud environment including provisioning new customers, deploying software builds, reviewing metrics and alerts, troubleshooting, and blameless incident postmortems. Further, you will collaborate with members of both the Product Development and Cloud Development teams to ensure that operations can support new functionality.

Within your first 60 Days, you will collaborate with the Director of Cloud Support to define the transition of Cloud Support to a true SRE practice. Working with the rest of the Cloud Support team, you will be responsible for identifying procedures currently handled manually or that are not fully automated which you will begin automating. Working with the Cloud Development team, you will identify and implement out the gaps between lower and upper delivery environments leading to a truly scalable product offering. You, along with the rest of the Cloud Support team, will be responsible for supporting production environments.

Within your first 90 Days, you will help drive changes to the operational and development roadmap as we continue onboarding new and existing customers into our hosted production environments. You will work with the Director of Cloud Support to identify a training plan to address skills gaps within the Cloud Support team to support the transition to an SRE practice. You will also begin gathering and refining requirements for a new Cloud Control system expanding and integrating with our existing Cloud API. This system will incorporate functions and automations related to the daily operation of our production cloud environment.

What You’ll Do

Provision, configure, and maintain the production environment to handle running several application stacks in the cloud that can scale to the thousands of customers using our products as well as our internal Product Team.

  • Automate the deployment and maintenance of cloud platform technologies in the upper environments ensuring that changes are also reflected in the lower environments
  • Aid in improving the overall product through development of management automation and metrics analysis in the upper environment
    • Integrate current scripts, automations, and functions spread across multiple tools into a coherent Cloud Control system
    • Collaborate with Cloud Development on database deployment capability to release pipeline (automate schema changes across all databases)
    • Evaluate metrics as customers are moved to new production environment
    • Create a metrics-based performance dashboard for production that includes predictive warnings which can be addressed prior to an incident occurring
    • Prepare for multi-tenant product solutions in coordination with cloud development
  • Implement and oversee log management, data warehouse, and database operations, including management of Logging/Audit services
  • Ensure all monitoring systems (infrastructure- and application-level) are in place, report on availability and system health
  • Collect and distill existing management and monitoring tools, scripts, and functions into a single coherent package for easy consumption but with the ability to drill down to details
  • Implement strategies around disaster recovery and security for all sub-systems in infrastructure (g., web servers, database, queues, storage, network)
  • Build strategic and tactical plans for continued improvement of cloud architecture and operations
  • Perform capacity management, load and scalability planning
  • Help drive process improvements for service management, including outage/incident management, rollbacks, health checks and reporting
  • Assist management in development and optimization of operational cost models
  • Assist in the establishment of 24x7 performance monitoring, reporting and response protocols 
  • With the help of Cloud Development, and Product Development, you will provide on-call support outside of normal work hours/days

About You

  • 2+ years of hands-on experience as a production SRE managing an environment of 500+ containers over 50+ namespaces
  • 4+ years of hands-on development experience with applications and RESTful API’s architected for cloud
  • Performance optimization experience, including troubleshooting and resolving network and server latency issues, performing hardware evaluation/selection tasks, performance vs. cost vs. time analysis 
  • 1-3 years of experience with Kubernetes
  • 1-3 years of experience with Terraform
  • 1+ year(s) of experience with automation or scripting tools (e.g., GO, Python, Shell) 
  • Basic DB skills to be able to automate processes into the pipeline.
  • You are devoted to automation
  • Driven, humble, and autonomous
  • A quick study, strong communicator, and you can adapt to fast-paced environments
  • Working knowledge of Agile Development practices (g., SCRUM, TDD)
  • Detail-oriented, with excellent documentation skills, and able to successfully manage multiple priorities
  • Troubleshooting skills that range from diagnosing hardware/software issues to large scale failures within a complex infrastructure 

Your Differentiators

  • Bachelor’s Degree in Computer Science
  • Experience implementing production Docker/Kubernetes environments
  • Hands-on experience with building and maintaining a continuous integration and delivery pipeline
  • Experience with Relational Databases such as Oracle, Aurora or Postgres
  • Experience with Splunk (or other log aggregation tools), Grafana, and Prometheus
  • Experience presenting complex information directly to customers, considering their technical experience level

Our Team 

You will be an integral member of what will ultimately be a five-person team of Cloud Support personnel including associates, admins and engineers. You will report to our Director of Cloud Support but will collaborate extensively with Cloud Development and the Product Development team.

We have an open and collaborative environment where everyone works together to deliver what is needed, from product features to operational needs (e.g., health checks). We value open and direct communication, taking calculated risks that will push us forward, and investing in our people. 

Our Stack 

  • Production and Continuous Integration footprints in Azure and AWS
  • Front-end applications leverage .Net, Vue.js, React, Java
  • APIs comprise of .NET, Java, Golang
  • Backend comprises of MS SQL Server, Oracle, AWS Aurora
  • Developing CI/CD Pipeline leveraging Kubernetes (EKS), Golang, Postgres, Terraform

Our Values

  • We are a Team. Employees, customers, and partners working together.
  • We are Customer-Focused. Customers are the heart of everything we do.
  • We are Driven. Seeking exceptional outcomes.
  • We Own our Success. Every employee has a stake in our company.
  • We do the right thing and have fun in the process.

Unanet is proud to be an Equal Opportunity Employer. Applicants will be considered for positions without regard to race, religion, sex, national origin, age, disability, veteran status or any other consideration made unlawful by applicable federal, state or local laws.