Sr. Databricks Engineer with Azure, AWS, Python
W3Global
Contract
Human Resources
Canada
Hiring from: Canada
Must have Databricks, Azure, AWS, python
Job Description
Design and develop data processing pipelines and analytics solutions using Databricks.
Architect scalable and efficient data models and storage solutions on the Databricks platform.
Collaborate with architects and other teams to migrate current solution to use Databricks.
Optimize performance and reliability of Databricks clusters and jobs to meet SLAs and business requirements.
Use best practices for data governance, security, and compliance on the Databricks platform.
Mentor junior engineers and provide technical guidance.
Stay current with emerging technologies and trends in data engineering and analytics to drive continuous improvement.
9+ years of overall experience and 4+ years of experience designing and implementing data solutions on the Databricks platform.
Proficiency in programming languages such as Python, Scala, or SQL.
Strong understanding of distributed computing principles and experience with big data technologies such as Apache Spark.
Experience with cloud platforms such as AWS, Azure, or GCP, and their associated data services.
Proven track record of delivering scalable and reliable data solutions in a fast-paced environment.
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills with the ability to work effectively in cross-functional teams.
Good to have experience with containerization technologies such as Docker and Kubernetes.
Knowledge of DevOps practices for automated deployment and monitoring
Job Description
Design and develop data processing pipelines and analytics solutions using Databricks.
Architect scalable and efficient data models and storage solutions on the Databricks platform.
Collaborate with architects and other teams to migrate current solution to use Databricks.
Optimize performance and reliability of Databricks clusters and jobs to meet SLAs and business requirements.
Use best practices for data governance, security, and compliance on the Databricks platform.
Mentor junior engineers and provide technical guidance.
Stay current with emerging technologies and trends in data engineering and analytics to drive continuous improvement.
9+ years of overall experience and 4+ years of experience designing and implementing data solutions on the Databricks platform.
Proficiency in programming languages such as Python, Scala, or SQL.
Strong understanding of distributed computing principles and experience with big data technologies such as Apache Spark.
Experience with cloud platforms such as AWS, Azure, or GCP, and their associated data services.
Proven track record of delivering scalable and reliable data solutions in a fast-paced environment.
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills with the ability to work effectively in cross-functional teams.
Good to have experience with containerization technologies such as Docker and Kubernetes.
Knowledge of DevOps practices for automated deployment and monitoring
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Our client is a leading provider in Payment Gateways and solutions. They are looking to hire a Backend Developer for their Canadian team to help with their expanding business opportunities and growth. Required Skills & Experience 8+ years of experience...
Human Resources
Canada
Hiring from: Canada
CRM Assistant — Remote (Full-Time) About The Role Are you obsessed with clean data, organized systems, and making a real impact behind the scenes? We’re looking for a highly motivated and detail-obsessed CRM Assistant to help us maintain and enhance...
Human Resources
United States
Hiring from: United States
Why We're Here At Brave Health, we are driven by a deep commitment to transform lives by expanding access to compassionate, high-quality mental health care. By harnessing the power of technology, we break down barriers and bring mental health treatment...
Human Resources
United States
Hiring from: United States