Job Description
Databricks is hiring a Senior Software Engineer (Data Platform) in Bengaluru to build and scale its Data Intelligence Platform. The position requires professionals to design metrics stores and build ETL systems while they oversee operations of extensive data pipelines and use automated systems to make business decisions. They will work with product teams and data science teams and AI teams to develop advanced data infrastructure solutions.
Qualification: Bachelor’s Degree or equivalent
Experience: 6+ years required
Apply: Apply Now
Main Duties:
- Design and manage the Databricks metrics store to enable data sharing, aggregation, and high-performance querying across teams.
- Develop and operate the company-wide Data Intelligence Platform with a balance of data security and accessibility.
- Build and maintain scalable data pipelines, ETL frameworks, and infrastructure for multi-cloud deployments.
- Create tools for orchestration, logging, data transformation, governance, and data consumption layers.
- Collaborate with cross-functional teams to define product vision and improve data infrastructure systems.
Essential Qualifications:
- Require applicants to have at least 6+ years of industry experience in data engineering or related roles.
- Demonstrate advanced proficiency in ETL frameworks together with data pipelines and large-scale infrastructure systems.
- Expertise in developing and maintaining data platforms which operate across multiple geographical locations and handle large amounts of data.
- Practical experience with orchestration tools which include Airflow and DBT and similar technologies.
- Demonstrate their ability to work with other teams through effective communication skills and leadership abilities.
Preferred Skills:
- Professional experience with Kafka and RabbitMQ and other comparable messaging systems.
- Advanced knowledge of infrastructure-as-code and CI/CD pipelines and data quality frameworks.
- Demonstrates expertise in data governance and security and metrics platform development.
- Capability to create application programming interfaces which handle telemetry and logging and audit data systems.
- Strong interest in emerging data and artificial intelligence technologies while developing scalable infrastructure.