About The Role:
The programmatic team at TMP is seeking a Data Pipeline Engineer to support building new data products and services.
The Team:
- TMP Programmatic works on data services across the programmatic platform within TMP and supports building customer-facing data visualization products
- The team has extensive experience in ETL development and works with large scale data in real-time
About the Job:
- Providing technical support for all data pipeline environments
- Set up, configure, maintain and enhance proper infrastructure to support a large scale data analytics environment
- Evaluate the technical tradeoffs of every decision
- Build and maintain ETL pipelines utilizing Python
- Work with Cloud Computing Platforms (AWS), Kafka and other open-source technologies
- Conduct data modeling, schema design, and SQL development
- Ingest and aggregate data from both internal and external data sources
- Collaborate with Product Owner and domain experts to recognize and help adopt best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentation
- Assist with the development and review of technical and end user documentation including ETL workflows, research, and data analysis
- Work with Product team to define data collection and engineering frameworks
- Responsible for daily integrity checks, performing deployments and releases
- Own meaningful parts of our service, have an impact, grow with the company
Desired Technical Qualifications
- Excellent and proven knowledge of Python
- Excellent and proven knowledge of SQL
- Excellent and proven knowledge of streaming technologies, such as Kafka or Kinesis
- Excellent and proven knowledge of queue based infrastructures such as AWS SQS, SNS, etc.
- Good knowledge of the following technologies is a bonus:
- Postgres on Amazon RDS
- Amazon Redshift
- Docker
- Proficiency in Git, JIRA and Teamcity are a plus
- 2+ years in a production environment a plus
Flexible Location:
Remote within the USA, EU, CA, UK
We are an equal opportunity employer and welcome all qualified applicants regardless of race, ethnicity, religion, gender, sexual orientation, disability status, protected veteran status, or any other characteristic protected by law. We actively work to create an inclusive environment where all of our employees can thrive.