Data Platform Engineer (102-08SENG-01)
Contrat, télétravail, salaire, région : indique tes envies pour voir si cette offre les respecte.
Description du poste
This role converts a large Azure Data Factory estate into Databricks workflows on AWS. The scope for year one: 2,094 ADF pipelines to migrate — built as reusable templates rather than one-by-one — 9,859 pipeline activities to translate (some map directly, others need rewriting as Lambda or Step Functions), 471 Spark dataflows to move onto Databricks on AWS, and 4 Databricks workspaces (Dev, QA, Pre-prod, Prod) to rehost, including notebook paths and Unity Catalog rewiring. This is a regulated environment, so reconciling migrated data against source systems is part of the definition of done, not an afterthought. Requirements What you will do Convert Azure Data Factory pipelines into…
Lire l'annonce complète sur Himalayas →