Databricks Technical Lead

Location: Pune Employment Type: full-time Designation: Databricks Technical Lead

Job Details

Key Responsibilities & Skills

  • Strong hands-on experience in Azure Databricks, Apache Spark, PySpark and SQL. 
  • Strong understanding of Delta Lake, Medallion Architecture, ETL/ELT pipelines and modern data engineering practices. 
  • Experience in designing, developing and supporting scalable data pipelines and data processing workloads on Databricks. 
  • Strong experience in performance tuning, optimization and troubleshooting of Spark jobs, clusters and data pipelines. 
  • Experience in handling production support, complex incidents, root cause analysis and problem management in Databricks/Data Platform environments. 
  • Ability to provide technical leadership and architectural guidance for the Databricks and overall Data Platform landscape. 
  • Strong knowledge of Azure Data Factory, Azure Data Lake Storage and related Azure Data Services. 
  • Experience in integrating Databricks with enterprise data warehouses, databases and upstream/downstream applications. 
  • Good understanding of data warehousing, dimensional modeling and enterprise data integration concepts. 
  • Experience in code review, release management, deployment and production readiness activities. 
  • Ability to support minor enhancements, continuous improvements and ongoing platform modernization initiatives. 
  • Experience in leading technical discussions, mentoring engineers and guiding teams on complex technical issues. 
  • Ability to work directly with client stakeholders and technical teams on priorities, issues and technical decisions. 
  • Strong communication and stakeholder management skills, with the ability to work independently in a client-facing environment. 
  • Willingness to provide support during US business hours, including availability for critical production issues as required. 
  • Experience in retail or a similar data-intensive enterprise environment. 
  • Experience with legacy EDW/SQL Server environments is an added advantage.


Powered by Systems Plus

Systems Plus offers GCC capabilities to help organizations enhance their agility, access specialized talent, and optimize costs while driving innovation. With over 20 delivered GCCs and more than three decades of experience in providing disruptive solutions, Systems Plus helps your organization become a global value organization. At Systems Plus, we provide access to a global talent pool, standardize processes, and enhance collaboration by providing a central hub for shared services and support.

Didn't find your job ?

Subscribe to our job alerts

You will receive email notifications
when a position becomes available
that matches your job alert choices.

    filetype: doc/docx/pdf and max-file size: 20MB

    Ready to transform and unlock your full IT potential? Connect with us today to learn more about our comprehensive digital solutions.

     

    Schedule a consultation

    schedule-consultation

    Resources