Sr. Software Engineer_Cloud_Devops

Key responsibilities:

• Ensure the stability, scalability, and performance of the data pipelines solution.

• Monitor and maintain batch data pipelines in a cloud-based environment.

• Improve operational processes including incident handling, performance monitoring, and issue resolution.

• Optimize Databricks workloads to improve efficiency and reduce costs.

·        Analyze and fine-tune the cloud infrastructure for better cost optimization.

Technical Skills:

• Solid understanding of common issues in cloud-based data pipelines and analytics solutions

• Working knowledge of Databricks and Lakehouse architecture in a cloud environment.

• Working with Batch accounts, IAC, GitHub, IAM, and CI/CD pipelines

• Experience with command-line scripting (e.g., PowerShell).

• Experience with data pipeline orchestration tools (e.g. Azure Data Factory)

• Understanding of monitoring and logging tools is a plus.

Soft Skills:

• Excellent problem-solving and critical thinking skills, with a proactive approach to incident management and root cause analysis.

• Strong communication and coordination abilities, capable of working effectively across cross-functional and international teams.

• High level of ownership, with a strong drive for operational excellence, efficiency, and continuous improvement.

Education:

• Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field.

Professional Experience:

• Experience in operating and maintaining large-scale cloud data solutions in production environments.

• Proven experience as a Data Engineer, with a strong focus on Azure Data factory and Databricks.

• Experience working in an automotive domain is a plus.

Languages:

• Fluent in English (written and spoken); additional languages are a plus.

3-5 years Experience in cloud infra and Devops