Senior Azure Databricks Engineer
Design and maintain scalable data processing solutions using Azure Databricks, Python, and PySpark. Build and manage batch and streaming pipelines while ensuring reliability and performance in an Agile environment. Requires 8-10 years of experience with strong expertise in Databricks, SQL, and Azure cloud services.
Key Highlights
Key Responsibilities
Technical Skills Required
Benefits & Perks
Nice to Have
Job Description
Contract: 12 months (subject to extension).
Location: Amsterdam, Netherlands.
Salary: Not a constraint for the right candidate!
Experience: 8-10 years.
Hybrid: 2 days Work from Home 3 days Work from Office
Your Profile & DNA:
We are looking for an experienced Azure Databricks / Python-PySpark Engineer to join our team in Amsterdam.
This role is ideal for a hands-on engineer with deep practical expertise in Azure Databricks, Python, and PySpark, who enjoys building reliable, scalable, and maintainable data processing solutions.
Roles & Responsibilities
- Design, develop, and maintain robust data processing solutions using Azure Databricks, Python, PySpark, and SQL.
- Build and manage both batch and streaming data processing pipelines within Databricks.
- Design appropriate and scalable data models for processing and consumption within the Databricks environment.
- Manage multiple parallel data processing workloads operating on shared source data.
- Ensure data processing solutions are reliable, performant, maintainable, and scalable.
- Analyze technical challenges and implement pragmatic solutions based on business and technical requirements.
- Monitor, troubleshoot, and optimize Databricks workloads and data processing processes.
- Contribute to improving the overall stability, quality, and maintainability of the data platform.
- Work with Azure cloud services and implement deployment processes using YAML-based CI/CD pipelines.
- Contribute to Infrastructure as Code (IaC) using ARM/Bicep.
- Identify and address technical debt proactively.
- Collaborate closely with other engineers, architects, and stakeholders in an Agile environment.
- Continuously improve development practices, processes, performance, and solution quality.
Searching for Devops roles that provide visa sponsorship? Connect with international employers through Devops Jobs with Visa Sponsorship opportunities actively seeking talented professionals.
Qualification & Experience
- A Bachelor's or Master's Degree or equivalent.
- Strong hands-on experience with Azure Databricks
- Deep expertise in Python, PySpark, and SQL
- Proven experience with batch and streaming data processing
- Experience designing and managing data processing solutions in Databricks
- Experience managing multiple parallel processes using shared source data
- Strong Azure experience
- Experience with YAML-based CI/CD pipelines
- Experience with Infrastructure as Code (ARM/Bicep)
- Experience working in an Agile environment
Explore our comprehensive directory of visa sponsorship jobs from employers worldwide who are ready to sponsor talented international professionals.
Nice to Have
- Broader understanding of end-to-end data solutions
- Experience with complex data architectures
- Data processing performance optimization
Interested in opportunities specifically in Netherlands? Discover our dedicated Visa Sponsorship Jobs in Netherlands page featuring roles from top employers in this location.
What do we offer?
If your profile matches the job requirement and you are interested to be presented to our clients, then please apply and don’t forget to attach your updated CV in line with the JD!
This position is for 1 year with possibility of extension. We offer competitive Gross Salary in line with the market standard.
Besides that, we offer following benefits, such as:
- 20 days of holiday per year
- Encourage Personal Development - Certification (Certification Charges reimbursed)
- Income Tax Return Filing
- We provide Visa Sponsorship for Candidate & Dependants
- Possibility of bonus
Who we are:
A2G Consulting also known as "A2G Technologies" is one of the fastest growing staffing companies in North Brabant region, Netherlands. We cater to Asia and Europe market focusing on high tech & non-high-tech clientele; headquartered in Eindhoven, Netherlands with a branch office in India (Bangalore & Pune) & Dubai. We successfully find a candidate and ensure that they get opportunities in line with their aspirations. We offer visa sponsorship for local & international candidates for career-enhancing opportunities. We strongly believe in equal opportunities and hence have a pool of resources with diversified ethnicity.
You will be deployed and work at one of our client sites.
Similar Jobs
Explore other opportunities that match your interests