Data Platform Engineer - Python & Spark

NEARSOURCE TECHNOLOGIES
Full time
Software Development
Canada
Hiring from: Canada
Hybrid (3 days remote), Toronto, Ontario, Canada

Experience: 5+ Years

Role Summary: NearSource is looking for a Data Platform Engineer with expertise in Python, Spark, and Snowflake to join our engineering team in Toronto. The selected candidate will architect and scale data pipelines, enable analytics, and support critical business insights for a Fortune 500 client.

Key Responsibilities

  • Design, build, and scale modern data platforms capable of handling both real-time and batch processing at enterprise scale.
  • Translate complex business and technical challenges into actionable solutions through detailed documentation and iterative delivery.
  • Automate deployment, monitoring, and management of cloud-based data infrastructure for high availability and reliability.
  • Implement and maintain CI/CD pipelines with a strong focus on automated testing and continuous improvement.
  • Collaborate closely with data engineers, data scientists, and product stakeholders to gather requirements and drive data best practices.
  • Develop and optimize SQL queries and data models to enable efficient analytics and reporting.
  • Create intuitive dashboards, reports, and analytical tools that provide actionable insights to business leaders.
  • Contribute to analytics initiatives such as performance tracking, segmentation, and revenue optimization.
  • Communicate findings effectively by presenting data-driven insights in a clear and strategic manner.


Required Skills & Experience

  • 5+ years of hands-on experience working with large-scale data systems, processing pipelines, and relational databases.
  • Strong expertise with Spark (DataFrames, Spark SQL, PySpark).
  • Advanced programming skills in Python and SQL, with a focus on clean, modular code.
  • Solid foundation in SQL concepts, dimensional data modeling, and data warehouses such as Hive or Snowflake.
  • Experience with workflow orchestration tools like Airflow.
  • Proficiency with BI tools such as Tableau, Power BI, or Qlik.
  • Knowledge of CI/CD practices and version control systems (Git, Jenkins).
  • Hands-on experience with interactive notebook environments (Jupyter, EMR, or Zeppelin).


Preferred Skills

  • Familiarity with Presto and AWS services.
  • Experience working with Looker for BI development.
  • Understanding of distributed system design with a focus on reliability and resilience.
  • Exposure to monitoring and observability tools.


Certifications / Education:

Bachelor's degree in Computer Science, Engineering, or related field (or equivalent training and experience)

Apply now, or share your resume with salary expectations at [email protected]. Thank you for considering a career with us! Once you submit your application, our Talent Acquisition team will review your resume thoroughly. If there's a strong match, we'll reach out to discuss your experience, role details, benefits, compensation, and next steps. While we strive for transparency, we may not be able to respond to every applicant due to high volume, but we genuinely appreciate your time and interest.

About NearSource: NearSource Technologies is a trusted partner for future-ready software consulting, enabling Fortune 500 enterprises to accelerate digital transformation. Our global engineering teams build and deploy impactful technology for some of the world's most admired brands, working directly on long-term client initiatives.

Equal Opportunity Statement: NearSource is an equal opportunity employer committed to fostering an inclusive and respectful environment. We celebrate diversity and do not discriminate based on race, gender, religion, sexual orientation, age, disability, or background. Innovation thrives when everyone feels empowered to contribute.

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, we surpassed $2B in revenue in our last fiscal year with...
Software Development
Canada
Hiring from: Canada
Ritchie Bros.
Full time
Job Description About the Role: We are looking for an enthusiastic and motivated software engineer to join our growing Developer Experience team. This is an excellent opportunity for someone early in their career who is eager to learn and contribute...
Software Development
United States
Hiring from: United States
Reddit is a community of communities. It’s built on shared interests, passion, and trust and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care...
Software Development
Canada
Hiring from: Canada