Description:
The Senior Data Engineer is someone who develops, constructs, tests and maintains architectures, such as databases and large-scale processing systems. This candidate will ensure that the system architecture supports the requirements of the data scientists, analysts, and business. They are responsible for setting up development environments in Bushel’s platform and are encouraged to adhere to the highest standards of quality software practices with clients and Bushel’s Web team. You will perform code reviews, identify and fix bugs, and oversee releases.
Data Software Engineer Job Responsibilities:
- Maintaining ETL program and DB/DW
- Adding new tables/indices
- Experience in Airflow preferred
- Monitoring for CVEs
- Updating and troubleshooting existing code
- Applying Dimensional Modeling principals to integrate various data sources with existing data (APIs, flat files, databases, etc)
- Data warehousing techniques that ensure the architecture will support the requirements of the business
- Building data pipelines (Testing, deploying, and validating code)
- In-depth knowledge of database design principles (SQL and NoSQL)
- Basic knowledge of analyst and ML principles is required
- Ability to recommend and implement ways to improve data reliability, efficiency and quality
- Lead development and software engineering efforts of web applications
- Coordinating with developers on data projects
- Coordinate and assist in deployment of ML models
- Attend design/architecture meetings and assist in project projections and hours
- Communicate improvement ideas, needs, and/or concerns
- Update projects daily on project management software
- Update hours for projects daily or hourly on time tracking software
- Update progress and project percentage completion
- Complete projects on time and within time budgets
- Other duties as assigned
Data Software Engineer Skills:
- Python/SQL (2+ Years of experience)
- Multithreading/parallel processing (experience preferred)
- Airflow or other ETL tools (experience required)
- Docker (experience required)
- Developer tools (Git, SDLC, OOP, etc) (experience required)
**This position can be on-site or remote
**This is not a contract position