Data Engineer / Senior Data Engineer

Our client is an international European MNC that has a strong global presence and a market leader in engineering innovation and digitalization. 

Responsibilities:

• In this role, you will dive deep into the realm of IoT data, striving not only to predict equipment failures but also to gain a comprehensive understanding of the maintenance processes currently implemented across the 60+ countries where operates. 
• Your expertise will be instrumental in delivering actionable insights and innovative ideas aimed at extracting even greater value from our data for the benefit of our customers.
• All decisions and recommendations should be backed by data. 
• While doing this, you get to solve challenging problems, experiment with generative AI and predictive analytics, and work with cutting-edge tools offered to us . 
• Responsible for delivering thousands of valuable insights each day to enhance the customer experience, underscoring the significance of your role in handling production workloads in the AWS cloud environment.
• Design, build, and maintain scalable data pipelines to collect, process, and store data from various sources
• Create and manage data models to ensure data integrity and accessibility for analytics and reporting.Optimize and maintain databases (SQL, NoSQL) to ensure high performance and availability.
• Implement data validation and monitoring processes to ensure data accuracy and reliability.

Requirements:

• Degree in Software side - IT, CSC, BTech, MTech, MCA, Specialization in Data Science, Data engineering. Avoid candidates with Educational background in mechanical, civil and electrical engineering. 
• 4+ years of data engineering experience.
• Should be able to explain relevant experience in products or services worked for. Need candidates from service or product industry - data management / data analysis. 
• Proficiency with AWS, GitLab CI/CD, Databricks, Python, SQL, PySpark, and DBT
• Experience with AWS Components
• Experience in developing and maintaining data pipelines on AWS and Databricks
• Coding proficiency with Python and SQL
• Should have experience in generating reports from Dashboards like power BI, Tableau Qlik sense
• Experience with software testing practices and DevOps practices
• Understanding of cybersecurity guidelines, data privacy and compliancy regulations
• Experience in working with IoT telemetry data, enterprise data landscapes and data structures
• Experience in data engineering methods and practice
• Experience in data engineering process improvements
• Experience with industry best practices and technical design principles
• In-depth process and data knowledge for the business domain
• Additional responsibilities such as leading task forces and defect triages.