Who are we?
Quanteam, founding entity of RAINBOW PARTNERS, is a consulting firm specialized in Banking and Financial Services. With more than 1200 consultants across 10 countries, we combine business and IT expertise to support leading institutions in transformation projects.
Our core areas:
➡ Quantitative Finance
➡ Risk & Compliance
➡ Operations & Finance
➡ Transformation & Organization
➡ Information Systems
We are looking for a Data Engineer
CONTEXT
In this role, you will be responsible for designing, building, and optimizing scalable data pipelines and data models within a cloud-based environment.
You will work with modern big data technologies to collect, transform, and process large volumes of data, ensuring that data solutions are reliable, efficient, and aligned with business and technical requirements.
This is an excellent opportunity for an experienced Data Engineer who is looking to work on challenging data projects, strengthen their expertise in Azure and Databricks, and contribute to the development of modern and scalable data platforms.
MAIN MISSION
To design, develop, and optimize robust data pipelines and data models using modern cloud and big data technologies, ensuring the availability, quality, scalability, and performance of data solutions.
MAIN RESPONSIBILITIES
- Design, develop, and maintain scalable data pipelines and ETL processes.
- Build and optimize data transformation workflows using PySpark and Databricks.
- Develop and maintain data models according to business and technical requirements.
- Work with Microsoft Azure services to implement cloud-based data solutions.
- Extract, transform, and load data from multiple structured and unstructured sources.
- Write, optimize, and maintain complex SQL queries.
- Monitor data pipeline performance and identify opportunities for optimization.
- Ensure data quality, consistency, integrity, and availability across different platforms.
- Troubleshoot and resolve data processing, integration, and performance issues.
- Collaborate with Data Engineers, Data Analysts, Data Scientists, Architects, and other stakeholders.
- Support the implementation of data governance, security, and development best practices.
- Produce and maintain technical documentation related to data pipelines, models, and processes.
- Contribute to the continuous improvement of data architecture and engineering practices.
PROFILE & SKILLS
- Degree in Computer Science, Information Systems, Data Engineering, Software Engineering, or a related field.
- At least 3 years of professional experience in Data Engineering or a similar role.
- Strong experience designing, developing, and optimizing data pipelines.
- Solid knowledge of ETL processes and data integration principles.
- Experience with data modelling and the design of scalable data structures.
- Strong analytical and problem-solving skills.
- Ability to work independently while collaborating effectively as part of a multidisciplinary team.
- Organised, proactive, and detail-oriented working approach.
- Strong communication and interpersonal skills.
- Ability to understand and translate business requirements into technical data solutions.
- Fluent Portuguese and English.
TECHNICAL SKILLS
- SQL
- PySpark
- Databricks
- Microsoft Azure
- ETL Processes
- Data Modelling
- Data Pipelines
- Big Data Technologies
- Cloud Data Solutions
- Data Integration
- Data Quality
- Pipeline Performance Optimization
WHAT WE OFFER
- Gross annual salary aligned with your experience and seniority.
- Permanent contract (CTI).
- Meal allowance.
- Health Insurance.
- Extra holiday: Christmas Eve or New Year's Eve.
- Access to Quanteam Academy for continuous learning and certifications.
- Elevate Program to support professional development and career growth.
- Career progression plan.
- Ongoing follow-up and technical support provided by a Consultant Expert.
Pagamento: 24 500,00€ - 47 500,00€ por ano
Localização do trabalho: Trabalho remoto híbrido em Porto
