Job Title
Azure Databricks Developer
Role Overview
The Azure Databricks Developer will work on agile development projects using Azure Databricks, Python, PySpark, and Delta Lake to build, optimize, and maintain cloud‑based data solutions. This role is ideal for fresh graduates who are passionate about data engineering, cloud technologies, and analytics, and who enjoy problem‑solving in a collaborative environment.
Key Responsibilities
- Develop and implement data integration solutions on Microsoft Azure
- Build and maintain PySpark notebooks using Azure Databricks
- Develop and manage Delta Lake tables and workflows
- Perform data analysis to troubleshoot data‑related issues and support resolution
- Write and optimize queries, including joins, duplicate record identification, and data validation
- Support cloud data migration initiatives from legacy systems
- Maintain and monitor data pipelines to ensure reliability and performance
- Optimize Spark and Databricks workloads for performance and scalability
- Work in agile development environments, contributing to sprint planning and delivery
- Act as an individual contributor with strong ownership and problem‑solving skills
Qualifications & Specialization
Educational Qualification
- Bachelor’s or Master’s degree (preferred) in Engineering, Computer Science, Data Science, AI, or a related discipline
Technical Skills & Knowledge
- Programming languages: Python, PySpark
- Strong understanding of databases and data querying
- Ability to write efficient queries (joins, duplicate identification, aggregations, etc.)
- Experience or academic exposure to agile development and sprint‑based delivery
- Familiarity with:
- Azure Databricks
- Azure Data Factory (ADF)
- Delta Lake
- Strong communication, analytical, and problem‑solving skills
Unique Experience Offered by This Role
- Hands‑on development of PySpark notebooks
- Building and managing Delta tables and end‑to‑end workflows
- Performance tuning and optimization of data pipelines
- Exposure to cloud‑based data migration projects
- Experience maintaining scalable, production‑grade data pipelines on Azure
Learning & Growth Outcomes
In this role, the Azure Databricks Developer will:
- Learn to develop Databricks notebooks and build Delta Lake tables and workflows
- Gain hands‑on experience creating data pipelines using Azure Data Factory (ADF)
- Learn to ingest data from multiple sources using Azure services
- Gain experience transforming data using Azure Databricks and Delta Lake
- Become familiar with Azure DevOps CI/CD, including story tracking, bug handling, and issue management
- Learn and apply performance optimization techniques in cloud data platforms
- Strengthen data analysis and insight generation skills
- Build foundational consulting skills such as requirement analysis, documentation, and stakeholder communication
- Gain exposure to data and application (process) migration from legacy systems to cloud environments
- Prepare for career growth into roles such as:
- Senior Azure Databricks Developer
- Cloud Data Engineer
- Advanced Analytics / AI‑enabled Data Roles