DATABRICKS DEVELOPER @ DIGITAL TRANSFORMERS
Digital Transformers is seeking a highly skilled Databricks Developer to join our growing team for an international client project. This 100% remote position is ideal for candidates who can work a UK shift and have a deep professional background in large-scale enterprise data environments. The role offers the opportunity to work in a dynamic international setting, ensuring high-quality delivery for complex data-driven business needs. Candidates from India and Europe are encouraged to apply for this contractual or permanent position, bringing their expertise to a forward-thinking tech team.\n\nThe core responsibilities of this role involve designing and managing data engineering and ETL processes within the Azure Databricks platform. You will be expected to utilize Databricks Lakehouse, Unity Catalog, and advanced features such as Delta Sharing, Auto Loader, and Delta Live Tables. The role also requires proficiency in Python, PySpark, and SQL, along with experience handling ERP data from systems like SAP and JD Edwards. You will also be responsible for managing Azure Data Factory, Azure Data Lake, and Azure SQL while maintaining strict governance and security protocols across the cloud architecture.
Key Requirements
Minimum of 8 years of professional experience in data engineering and ETL processes.
Expert-level proficiency in Azure Databricks and the Databricks Lakehouse platform.
Strong experience implementing and managing Databricks Unity Catalog.
Advanced programming skills in Python, PySpark, and SQL for data transformation.
Proven track record in designing robust Data Warehousing and Data Architectures.
Hands-on experience with Databricks Workflow and Delta Sharing technologies.
Technical expertise in utilizing Auto Loader and Delta Live Tables for data ingestion.
Demonstrated experience handling and processing ERP data from SAP or JD Edwards.
Proficiency with Azure cloud services including Azure Data Factory and Data Lake.
Deep understanding of cloud governance, security standards, and architecture.
Strong problem-solving skills and ability to work in large-scale enterprise environments.
Excellent communication skills for stakeholder management and collaboration.