Key skills: Strong hands-on data engineering experience with Python and SQL, building and maintaining data pipelines, ETL/ELT and working with cloud-based data platforms. Candidates should be comfortable with data modelling, transformation, data quality and working within multidisciplinary delivery teams. We need solid hands-on engineers at SFIA 4 who can work independently and take responsibility for delivering defined pieces of work. * Experience translating business questions into data or analytical requirements, with guidance where needed. * Good SQL and Python skills for data modelling, transformation, automation and analysis. * Experience working with data models in data warehouses, lakehouse environments or analytics tools such as Power BI. * Familiarity with modern data engineering frameworks and tools (e.g. Spark / PySpark, Pandas, orchestration tools). * Experience working with cloud data platforms on AWS or Azure (e.g. Databricks, Redshift, Microsoft Fabric). * Understanding of software engineering fundamentals, including Git, testing, CI/CD and modular design. * Basic analytics and statistical understanding, including metrics and simple experimentation. * Awareness of AI/ML concepts, such as using model APIs or prompts, with a desire to build experience in this area. * Understanding of data governance, security and quality concepts, including access control and GDPR considerations. * Experience communicating insights through data visualisation using tools like Power BI, Tableau or Python charts. Due to the nature and urgency of this post, candidates holding or who have held high level security clearance in the past are most welcome to apply. Please note successful applicants will be required to be security cleared prior to appointment which can take a minimum 10 weeks. LA International is an award-winning partner of choice for many of the world's most influential companies and government organisations. Holding Enhanced Government Security Accreditation, we are recognised as the European market leader in the delivery of Security Cleared talent to organisations that demand the very highest levels of security, compliance and assurance. An award-winning organisation, having secured the prestigious Queens Award for Enterprise: International Trade over multiple years. We are committed to fostering an inclusive, equitable and accessible workplace where everyone feels valued and supported. We welcome applications from all individuals, regardless of background or identity, and we encourage candidates who may not meet every listed requirement to still apply. If you require any adjustments or support during the recruitment process, please let us know and we will work with you to ensure a fair and accessible experience. Please Note: If a high volume of applications is received, only candidates shortlisted will be contacted.
Tâches : - Qlik Replicate: - Replication tasks (Source: SAP, Destination: Snowflake) - Snowflake: - Medallion structure (Bronze: Raw, Silver: Core, Gold: Published) - Matillion: - Data transformation tasks between Snowflake layers - Other data tools (Alteryx, Tableau, SAP Business Objects): - Alteryx flows reading snowflake to publish Alteryx yxdb and Tableau data sets - SAP Business Objects / BW reports distributed directly to end users via email. Répartition estimée des tâches : - Snowflake: 50% - Qlik Replicate: 15% - Matillion: 25% - Other data tools: 10% Mandatory skills - Qlik, Snowflake,Matillion Desired - SAP BO Bonus - Alteryx, Tableau Outils à connaître : - Qlik Replicate o Configure, optimise and monitor data replication pipelines o CDC Management o Endpoints Source: SAP, Target: Snowflake - Snowflake o Warehouse design – architect, build and optimise data warehouses within Snowflake o Integration with Qlik and/Matillion - Matillion o Build and maintain transformation pipelines using Matillion ETL - SAP Business Objects o Universe Development – design, build and maintain Information Design Tool (IDT) and Universe Design Tool (UDT) layers o Report Creation – develop reports and dashboards using Web Intelligence (WebI) - Alteryx o Knowledge of design, build and maintenance of ETL workflows with Alteryx Designer - Tableau o Knowledge of data preparation for tableau datasets
Au sein d'une Direction des Services Socles et Poste de Travail, vous intervenez sur une plateforme Data centralisant de multiples sources d'information liées à la gestion des actifs informatiques, aux identités numériques, aux référentiels d'entreprise et aux données de gestion. Ces données sont consolidées au sein d'un Data Warehouse Cloud Azure afin de produire des indicateurs décisionnels, des tableaux de bord Power BI et des reportings destinés aux différentes directions métiers. Les principaux usages concernent notamment : Le pilotage des services internes ; Le suivi de la consommation et de la facturation des offres de services ; L'aide à la décision ; Le suivi des projets et déploiements ; L'historisation des données ; L'amélioration de la gouvernance des actifs IT. Missions principalesDans le cadre de l'évolution et de l'industrialisation de la plateforme Data, vous intervenez en tant qu'Ingénieur Data avec une forte dimension DevOps. Data Engineering & SupervisionConcevoir, développer et maintenir des pipelines de traitement de données sur Azure Databricks. Développer des notebooks PySpark permettant l'alimentation des couches Bronze, Silver et Gold selon l'architecture Médaillon. Exploiter et optimiser les formats de données Parquet, Delta Lake et CSV. Garantir la qualité, la performance et la fiabilité des traitements. Optimiser les jobs existants afin de réduire les temps d'exécution et les coûts d'exploitation. Mettre en place et maintenir les dispositifs de supervision et de monitoring des flux de données. Assurer le suivi de la qualité des données et la gestion des alertes. Participer à la résolution d'incidents et à l'amélioration continue de la plateforme. Collaborer avec les équipes métiers et techniques afin de comprendre les besoins et proposer des solutions adaptées. DevOps & Infrastructure CloudParticiper à l'administration et à l'évolution de l'infrastructure cloud Azure. Maintenir et faire évoluer les infrastructures as code via Terraform. Développer et maintenir les pipelines de déploiement sous Jenkins. Contribuer aux processus CI/CD et aux bonnes pratiques d'industrialisation. Réaliser des revues de code et participer à la gestion des dépôts GitHub. Contribuer à l'automatisation des déploiements et à l'amélioration des standards techniques.
