Data Engineer
AI summary of the role
Trafigura seeks a Data Engineer to build and maintain time-critical data integration pipelines for its North American Gas and Power trading desk.
What you’ll do
- Design, build, and maintain time-critical data integration pipelines (ETL/ELT) across internal and external data sources.
- Develop and maintain data models appropriate to the variety of datasets flowing through the integration layer.
- Implement and manage cloud-based data integration solutions on AWS, leveraging S3, Glue, Lambda, and Redshift.
- Monitor, troubleshoot, and optimise existing pipelines to ensure reliability, performance, and data quality.
What you’ll bring
- Minimum 3 years' experience in Python and SQL with a focus on data integration or pipeline development.
- Hands-on experience with cloud data services (AWS, Azure, or GCP), containerisation (Docker, Kubernetes), and Infrastructure as Code (Terraform, CloudFormation).
- Experience monitoring and debugging data pipelines using logging, alerting, and observability tooling (e.g. CloudWatch, Grafana).
- Proficient in using AI assistant tools to accelerate development workflows (e.g. GitHub Copilot, Claude).
Technologies
Python · SQL · AWS · S3 · Glue · Lambda · Redshift · Docker · Kubernetes · Terraform · CloudFormation · CloudWatch
Source and classification
Internal deployment & tooling · Evidence for this classification:
fuel storage and distribution company Puma Energy; and joint ventures Impala Terminals, a port and logistics provider, and Nala Renewables, investing in wind, solar and battery storage projects. Main purpose The Data Engineer will be responsible for building and maintaining the data integration infrastructure that underpins Trafigura's North American Gas and Power trading desk. Working within the Data Science and Engineering team, this role ensures that critical data flows reliably and on time across internal and external systems, directly enabling commercial decision-making and process automation. Key responsibilities Design, build, and maintain time-critical data integration pipelines (ETL/ELT) across a range of internal and external data sources. Develop and maintain data models appropriate to the variety of datasets flowing through the integration layer. Implement and manage
More from the job description
At the heart of global supply, Trafigura connects vital resources to power and build the world. Through our Oil & Petroleum Products, Gas and Power, and Metals and Minerals, commercial divisions, we use infrastructure, logistics and financing to connect producers and consumers, using our deep understanding of the markets we serve to make supply more efficient, secure and sustainable. We are committed to responsible business practices and believe that the supply of energy and raw materials is essential for growth, development and prosperity. We are accelerating our investments in renewable energy, including hydrogen, ammonia and other low-carbon energy technologies required for the transition to a low carbon future. And we work with our stakeholders to improve environmental and social standards, bringing greater trust and transparency to global supply chains. A career at Trafigura offers a gateway to working on some of the most exciting challenges of a rapidly changing world – from helping to optimise supply chains to developing infrastructure and new markets. In a culture that is founded on openness and energy, our people work as part of a multinational, globally connected team and thrive in a fast-paced environment where they can nurture and commercialise bold ideas. Everyone has a voice and is empowered to collaborate across geographies and disciplines to help shape our bus [... source excerpt omitted ...] am, this role ensures that critical data flows reliably and on time across internal and external systems, directly enabling commercial decision-making and process automation. Key responsibilities Design, build, and maintain time-critical data integration pipelines (ETL/ELT) across a range of internal and external data sources. Develop and maintain data models appropriate to the variety of datasets flowing through the integration layer. Implement and manage cloud-based data integration solutions on AWS, leveraging services such as S3, Glue, Lambda, and Redshift. Monitor, troubleshoot, and optimise existing pipelines to ensure reliability, performance, and data quality. Contribute [... source excerpt omitted ...] the automation of data workflows on the trading desk, reducing manual intervention and operational risk. Develop a solid understanding of the desk's data landscape and commercial requirements in order to deliver integration solutions that meet business needs. Required qualifications Minimum 3 years' experience in Python and SQL, with a focus on data integration or pipeline development, including experience with relational databases and data modelling. Hands-on experience with cloud data services (e.g. AWS, Azure, or GCP), containerisation (e.g. Docker, Kubernetes), and Infrastructure as Code (e.g. Terraform, CloudFormation). Experience monitoring, observing, and debugging data p
Employer postings · Data from · Sources