Senior Data Engineer - Databricks Experience

About the role

SunnyData helps its customers turn data into business value through scalable architectures, robust data pipelines and accurate ML and AI applications. As a Senior Data Engineer with Databricks experience, you will work directly with internal teams and customers to design, build and deploy data solutions that capture, explore, transform and use data for AI, machine learning and business intelligence.

Key responsibilities

• Support new and existing customers on their data engineering needs and guide them toward the right technical decisions.
• Work across multiple customer accounts, tracking and reporting progress.
• Design, build and operationalize complex data solutions, fix issues, apply transformations and recommend data cleansing and quality solutions.
• Analyse data sources, assess their value and recommend including them in analytical processes.
• Incorporate data governance, data security and data quality.
• Collaborate across teams, support delivery and educate end users on data products and analytic environments.
• Resolve defects and incidents of moderate complexity, and test data movement, transformation code and data components.

Required profile

• 7+ years of related experience in data engineering and data product development.
• 3+ years of experience in a consulting environment.
• Bachelor's degree in Computer Science or a related engineering field.
• Experience delivering 5+ projects using Databricks; hands-on experience with Databricks Asset Bundles, clustering and performance optimization.
• Experience with legacy-to-Databricks migration projects.

Required skills

• Strong knowledge of the Databricks platform.
• Strong SQL and PySpark skills.
• Experience with Azure, AWS or GCP, as well as CI/CD and GenAI.
• Familiarity with other data platforms and technologies.
• Databricks Genie and Databricks Apps experience is a strong plus.

What we offer

• Work with cutting-edge technologies and industry leaders in data engineering and AI.
• Opportunities for professional development and career advancement.
• A collaborative culture that values knowledge sharing.