DevOps Engineer

Machine Learning Engineer

Data Engineer / Senior / Supervisor

Responsibilities: <ul><li>To provide operational support for the overall Agile DevOps Platform, which includes:&nbsp;</li><li>Drive thought leadership in DevOps practices.</li><li>Work closely with Machine Learning Engineers to automate model training, testing and deployment into production using Continuous Integration/Continuous Delivery (CI/CD)&nbsp;</li><li>Hands on implementation and maintenance of CI/CD pipelines&nbsp;</li><li>Work closely with Security Architect to integrate security best practice into the pipeline&nbsp;</li><li>Identify and resolve problems in a timely fashion&nbsp;</li><li>Maintenance and upgrading of platform tools&nbsp;</li><li>Continuous monitoring of health of Agile products</li></ul> Requirements: <ul><li>Bachelor Degree in Computer Science</li><li>5+ Years experience in AWS Services, EKS, Kibana&nbsp;</li><li>Well-versed in agile ways of working and familiar with common tools including JIRA and Confluence&nbsp;</li><li>Experience in working in cross-functional Agile teams&nbsp;</li><li>A strong technical foundation in the following:&nbsp;</li><li>Good working experience with cloud-based technologies and architectures (AWS, Azure or&nbsp;&nbsp;&nbsp;GCP). AWS know-how is preferred&nbsp;</li><li>Experience with CI/CD practices and systems (e.g. git, git flow, trunk-based development).&nbsp;</li><li>Experience and good knowledge of Containerization (docker etc.)&nbsp;</li><li>Container orchestration using Kubernetes</li><li>Scripting language (shell, ruby/jruby, perl, python, powershell etc.)&nbsp;</li><li>Monitoring and data collection tools (nagios, splunk, and etc.)&nbsp;</li><li>SCM tools (git, bitbucket)&nbsp;</li><li>Build tools (ant, nant, rake, etc.)&nbsp;</li><li>Packet management (rpm, npm and etc.)&nbsp;</li><li>Configuration management tools (Ansible, chef, Terraform, puppet etc.)&nbsp;</li><li>Microservices architecture&nbsp;&nbsp;</li></ul>

Responsibilities:&nbsp;<ul><li>Ensure machine learning models and data pipelines are deployed successfully&nbsp;</li><li>Develop and maintain backend services for data and machine learning&nbsp;</li><li>Optimise and manage databases&nbsp;</li><li>Deploy applications to AWS cloud, leveraging on the full spectrum of AWS cloud services&nbsp;</li><li>Automate model training, testing and deployment using CI/CD&nbsp;</li><li>Understand and implement metrics to verify effectiveness and soundness of the machine learning model&nbsp;</li></ul> Requirements:&nbsp;<ul><li>Comfortable to commit to a one-year contract&nbsp;</li><li>Degree holder&nbsp;</li><li>At least 3 to 5 years’ experience&nbsp;</li><li>Hands-on working knowledge in:&nbsp;</li><li>Python (Pandas, Pytorch)&nbsp;</li><li>AWS, CI/CD, Dockers Databases&nbsp;</li></ul> Preferred Requirements: <ul><li>Previous work experience in Investment Banking companies&nbsp;</li><li>Hands-on knowledge in AWS Machine Learning, Dogster, Airflow&nbsp;</li></ul>

Role Description:The Data Engineering Senior Supervisor will lead a small team of data engineering professionals to design, build and operate high performance data centric products or solutions through the use of modern engineering practices and technologies.In this role, you will provide guidance to ensure the delivered data centric products or solutions are scalable, sustainable and robust.You will also lead team development and cross team relationships and delivery to advance the company's engineering delivery.Responsibilities:Lead a local or regional team of engineering professionals that design, develop, deploy and enhance new and existing data centric products or solutions through the use of modern platforms and technologies.Provide routine inputs and guidance to the data engineering team on business requirements analysis, technical specification's preparation, product delivery, testing and operation to support businesses strategic direction.Coach engineers, share relevant technical approaches, identify new trends, modern skills and present new methodologies within the data engineering community.Lead and develop a team, coach and make decisions related to talent management, hiring, performance, and disciplinary actions.Other duties as assignedRequirements:Minimum QualificationsBachelor's degree in a related field or equivalent experience.Minimum of four years of related work experience.Minimum of two years leading a team of Data Engineers.Preferred QualificationsConfirmed data engineering experience with data storage and management of large, heterogenous datasets, including formats, structures, and cataloging with such tools as Iceberg, Parquet, Avro, ORC, S3, HFDS, HIVE, Kudu or others.Experience leading Big Data engineering teams working in environments such as Hadoop and SparkExperience leading technology strategies with cloud Platforms including AWS, GCP or AzureExperience leading engineering teams working in streaming and stream integration or middleware platforms, tools, and architectures such as Kafka, Flink, JMS, or Kinesis.Confirmed knowledge of best practice patterns and how to apply them to modern data architectures, including data warehouses, data lakes, data mesh, hubs and associated capabilities including ingestion, governance, modeling, observability and more.Experience leveraging transformation and modeling tools, including SQL based transformation frameworks, orchestration and quality frameworks including dbt, Apache Nifi, Talend, AWS Glue, Airflow, Dagster, Great Expectations, Oozie and others.Strong programming knowledge of SQL, Python, R, Java, Scala or equivalent.Proficiency in engineering tooling including docker, git, and container orchestration services.Strong experience leading devops teams with demonstratable understanding of associated best practices for code management, continuous integration, and deployment strategies.Experience and knowledge of data governance considerations including quality, privacy, security associated implications for data product development and consumption.A passion for quality and continuous improvement with an owners mindset.Ability to work effectively as part of a team, group and cultureAbility to navigate ambiguity and work in agile ways.

Skills

Industry

Location

Jobtitle

3 docker Jobs found

DevOps Engineer

Machine Learning Engineer

Data Engineer / Senior / Supervisor

WhiteCrow
WhiteCrow is on a mission to connect companies with the best talent across the globe.

EMPLOYER

TALENT

COMPANY

Contact Us

JOBS BY SKILLS

JOBS BY FUNCTION

JOBS BY INDUSTRY

JOBS BY LOCATIONS

MODEL JOBS

JOBS BY CITY

Skills

Industry

Location

Jobtitle

3 docker Jobs found

DevOps Engineer

Machine Learning Engineer

Data Engineer / Senior / Supervisor

WhiteCrow WhiteCrow is on a mission to connect companies with the best talent across the globe.

EMPLOYER

TALENT

COMPANY

Contact Us

JOBS BY SKILLS

JOBS BY FUNCTION

JOBS BY INDUSTRY

JOBS BY LOCATIONS

MODEL JOBS

JOBS BY CITY

WhiteCrow
WhiteCrow is on a mission to connect companies with the best talent across the globe.