Website STAFIDE
As a Data Access Layer Engineer, you will:
- Create and maintain the Data Access Layer (DAL) application, ensuring it is effectively built around Unity Catalog.
- Support legacy access stores and ensure smooth integration with the existing infrastructure.
- Manage the Unity Catalog metastore through Azure pipelines (YAML), ensuring a seamless deployment process.
- Collaborate with cross-functional teams to ensure the scalability, reliability, and performance of the DAL system.
- Provide support in the administration of Databricks, leveraging your expertise in both Unity Catalog and Databricks as a user.
What You Bring to the Table:
- 8-10 years of experience in developing, maintaining, and optimizing Data Access Layer applications.
- Proficiency in Azure (Intermediate level), including Azure Architecture and managing Azure DevOps Pipelines using YAML (Advanced level).
- Strong skills in Terraform (Intermediate), enabling you to manage and provision infrastructure as code.
- Extensive experience with Python Programming (Intermediate) and Python Testing with pytest (Intermediate).
- Adept in Bash Scripting (Intermediate) to automate tasks and streamline operations.
- Solid knowledge of Databricks (Intermediate) with expertise in Unity Catalog, Databricks Administration, and hands-on experience as a user (Beginner to Intermediate).
You should possess the ability to:
- Design, implement, and maintain scalable data access solutions using Unity Catalog.
- Work efficiently with Azure DevOps Pipelines to manage deployment workflows.
- Troubleshoot and optimize code and infrastructure to improve performance and reliability.
- Collaborate effectively with both technical and non-technical teams to ensure requirements are met.
- Work with legacy systems and modern technologies, ensuring smooth transitions and integrations.
What We Bring to the Table:
- A challenging and rewarding role that allows you to contribute to the modernization of data access architecture.
- A dynamic and collaborative environment where your skills and expertise will be highly valued.
- The opportunity to work with cutting-edge technologies, including Azure, Terraform, Python, Databricks, and Unity Catalog.
To apply for this job please visit jobs.stafide.nl.