We are on the lookout for a talented Senior Data Engineer to contribute significantly to our advanced data collection, processing, and analysis system which is based on a Python/Django/Postgres stack.
This role involves close collaboration with the Lead Data Architect, focusing on the implementation and optimization of data pipelines, processing components, and interfaces for reviewing vulnerabilities across Python, Java and JavaScript ecosystems.
Responsibilities:
- Work in tandem with the Lead Data Architect to develop robust data ingestion, processing, and vulnerability review components, with an emphasis on AWS or GCP-based event-driven, and modular architectures.
- Engineer and enhance data pipelines, ETL processes, and data cleaning mechanisms to support a comprehensive cybersecurity data analysis system.
- Aid in the development of components for LLM analysis, experimenting with innovative approaches to detect vulnerabilities in open-source packages.
- Ensure that all components align with the overarching system architecture, focusin on performance, scalability, and maintainability.
- Contribute to code reviews, the establishment of coding standards, and the cultivation of best practices within the team.
- Address and resolve technical challenges, maintaining a commitment to delivering high-quality solutions.
- Embrace a fast-paced, iterative development approach, quickly delivering working solutions and continuously improving them based on feedback
Team Dynamics:
You will be an integral part of a team of 2 or 3, including yourself, working closely with the Lead Data Architect. This collaboration will see you contributing as a key individual contributor within this specialized team.
After the strategic planning stages, you will focus on hands-on development, leveraging your expertise to bring the system to fruition alongside your team members. This structure offers a unique blend of collaborative input and individual responsibility, fostering an environment where innovation and efficiency thrive.
Impact:
As a Senior Data Engineer at Safety, your contributions will be pivotal in constructing a state-of-the-art data processing system that sets new standards in cybersecurity for software supply chains.
Your efforts will directly influence the security of Python, Java, and JavaScript ecosystems, making a significant mark on the global cybersecurity landscape. You’ll be part of a team that is at the forefront of innovation, leveraging AI technologies to revolutionize the way we approach cybersecurity.
Requirements
- 10+ years of technical experience, with at least 5 years dedicated to data engineering and processing roles.
- Proficient in data manipulation, transformation, and analysis, with experience in Python, Java, SQL, or similar languages and technologies.
- Knowledgeable in big data technologies and cloud platforms, particularly AWS or Google Cloud, with a strong understanding of event-driven architectures and data pipeline designs.
- Exceptional problem-solving abilities and communication skills, capable of working closely with the Lead System Architect and other team members in a collaborative setting.
- Passionate about leveraging AI systems like GPT, Claude and Copilot to drive innovation and efficiency in your daily work
- Adaptability to a fast-paced startup environment, with a willingness to iterate rapidly and adjust to evolving project requirements.
- Excellent problem-solving and communication skills
Join our dynamic and fast-paced startup to work with exiting technologies, shape the future of supply chain security, and deliver impactful solutions in a collaborative, innovative environment. If you are passionate about making a significant difference in the cybersecurity domain and are ready to tackle complex challenges with cutting-edge solutions, we want to hear from you!
Benefits
Salary of $140,000 to $160,000 CAD / year, depending on experience
Healthcare plan
Generous equity stock options plan
Remote worker friendly
Data source
We Work Remotely