DATABRICKS DEVELOPER @ ASHU DIVIDEND
As a Databricks Developer at Ashu Dividend, you will be a key member of our data engineering team, responsible for designing, building, and maintaining robust and scalable data pipelines. This role focuses on leveraging Azure Databricks and PySpark to drive large-scale data projects, ensuring that our data infrastructure is efficient and reliable. You will work closely with cross-functional teams to translate business requirements into technical solutions that meet the high standards of performance and integrity required for our data assets. Possible work locations for this role include Bangalore and Mysore. Your day-to-day activities will involve optimizing data workflows using Delta Lake and managing the full ETL lifecycle. You will be expected to utilize Azure DevOps and CI/CD practices to automate deployments, ensuring a streamlined and error-free development process. We are looking for immediate joiners who can hit the ground running and contribute to our ongoing success in the data engineering space.
Key Requirements
Minimum of 6 years of experience in Data Engineering or a similar role.
Strong hands-on experience with Azure Databricks.
Proficient in PySpark and Apache Spark for large-scale data processing.
Advanced programming skills in Python and SQL.
Experience building and maintaining scalable data pipelines and ETL processes.
Familiarity with Delta Lake for optimizing data workflows.
Deep understanding of Data Warehousing concepts and architectures.
Proven ability in performance tuning and optimization of data workflows.
Experience with Azure DevOps and CI/CD for automated deployments.
Commitment to ensuring data quality, integrity, and high performance.