Data Engineer Lead - Python and PySpark

Java Tech Lead

Cloud Operations Engineer

Senior/Software Engineer 2 - Threat Reporting & Response

Infrastructure & DevOps Tech Lead

Software Engineer - Quality

Applications Developer

Responsibilities:Data Ingestion and Extraction:Develop and optimize data ingestion pipelines to efficiently extract data from various sources e.g. databases, APIs, files etc.Ensure data quality and integrity through robust validation and cleansing processesData Transformation and Processing:Design and implement data transformation logic using Python and PySpark to convert raw data into a suitable format for analysisOptimise data processing pipelines for performance and scalabilityData Storage and Management:Select and implement appropriate data storage solutions (cloud-based data warehouses, data lakes, etc.) based on data volume and complexityDevelop strategies for data retention, backup, and recoveryETL/ELT Development:Build and maintain efficient ETL/ELT processes to move data between different systems and platformsOptimize ETL/ELT pipelines for performance and cost-effectivenessCloud Infrastructure:Leverage cloud-based data engineering services (AWS, GCP, Azure) to build scalable and cost-efficient data solutionsManage and maintain cloud-based data infrastructureData Modeling and Optimization:Design and implement data models to support business intelligence and analyticsOptimize data structures and indexes for query performanceCollaboration and Communication:Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and deliver actionable insightsEffectively communicate complex technical concepts to both technical and non-technical audiencesData Governance and Security:Implement data governance policies and procedures to ensure data quality, security, and complianceProtect sensitive data through appropriate security measuresRequirements:At least a bachelor’s degree in computer engineering, or equivalentAt least 10 years in Microservices, with at least 4 years of experience in data engineering and architecturePrevious work experiences in using major cloud platforms (AWS, Azure, GCP) and containerisation technologies (Docker, Kubernetes)Proficient in Python and PysparkProficient in SQL and database designKnowledge and understanding of data warehousing, data lakes and big data technologiesKnowledge of data modeling and ETL/ELT processesKnowledge of PostgreSQL and OracleStrong problem-solving and analytical skillsAble to work independently and as part of a teamLead and manage the development team including assigning tasks and monitoring progressPreferred Requirements:Experience in using data visualization tools e.g. Tableau, PowerBI

Responsibilities:Lead and manage the development team, including assigning tasks and monitoring progressDevelopment team to analyze, design, and implement enterprise-wide Java based systemsHands on expertise in Microservices.Planning, analyzing and defining solutions through business, functional and technical expertiseWork with product managers on issues or questions related to system requirementsResponding to inquiries concerning application development and support.Requirements:Bachelor’s or Masters Degree in Computer Engineering or a closely related field;10+ Years experience in Microservices,Minimum of 4+ years of experience in cloud computing and architecture.Proven experience with major cloud platforms (AWS, Azure, GCP, etc.).Good Knowledge of DevOps methodologies and tools.Experience with containerization technologies (Docker, Kubernetes).Good knowledge of PostgreSQL knowledgeProven work experience as a Java Technical Lead or similar roleStrong experience with Java and Java frameworksExcellent knowledge of relational databases, SQL and ORM technologies (JPA2, Hibernate)

Responsibilities:Sustain the resiliency of critical infrastructure by diligently performing platform maintenance, ensuring optimal performance, security, and availability.Proactively identify and resolve infrastructure issues encompassing Linux systems in a Hybrid Cloud environment, providing swift restoration to operational status, and minimizing down-time.Enhance the security posture of the environment by administering IAM systems and maintaining robust host and network configurations.Maintain containerization platforms including Kubernetes and AWS EKS, guaranteeing stable platform for the operation of company's microservices.Engage collaboratively with the team to refine operational processes, and documentation.Manage and maintain Observability platform such as Graphite, Prometheus, Grafana, Elastic, and LogScale, ensuring reliable monitoring, logging, and alerting functionalities.Provide an outstanding support experience for company's internal Engineering teams by meeting Product and Engineering requirements for company's Cloud Platform.Requirements:Experience in a relevant technical role, such as Platform, Cloud Operations, or Site Reliability Engineer (SRE).Excellent proficiency with maintaining and troubleshooting Linux Operating Systems and distributed systems at scale.Experience with Kubernetes (k8s) and containerization in Production environments.Foundational knowledge of core infrastructure services, such as DNS, Identity Management, load balancers, web servers, etc.Proficiency with at least one programming or scripting language.A proactive attitude and a willingness to take on new challenges and deliver results.Outstanding communication and social skills, with an ability to connect with others to problem-solve, explain resolution etc.A relevant degree and/or equivalent qualifications, e.g., RHCSA, LPIC, AWS SysOps. 

Responsibilities:Build state of the art services that enable our customers to protect their organisations against modern security threats.Craft products for rapid delivery in an Agile development environment using DevOps practices.Help identify improvements and promote positive change within working groups and individuals.Mentor others in your areas of expertiseHighlight and drive improvements to the Software Engineering EnvironmentProvide hands-on technical leadership for one or more product/feature sets or Engineering domains.Work closely with Product Management, UX designers, and the larger engineering team to deliver quality products.Collaborate with the team to come up with technical designs and solutions with adequate documentation.Work closely with the team, principals and Architects to discuss solution and implementation strategy.Take full ownership of projects from design to implementation and deployment.Write quality code to meet business needs and quality standards.Help maintain the platform by fixing bugs and issues coming from the operational pipeline.Perform code reviews of fellow developers.Champion best practices and enable and support more junior members of the team.Requirements:﻿7+ years as a Software DeveloperEngineering / Computer science degree or equivalent experienceStrong skills in Java 11/17 and above .In depth expertise in AWS Serverless environment Experience in Junit 5 (or TestNG), Mocking frameworks (Mockito, EasyMock, or JMockit) and delivering code and solutions with quality built in.Knowledge of writing infrastructure as code (IaC) using Terraform (preferred ) or CloudFormationImplementing REST and Streaming APIs, JSON.Experience of working with Message Queues e.g. Kafka, RabbitMQ, AWS SQS SNS MSK.Knowledge of the web platform as a whole e.g. React, Angular, JavaScript, HTTP/S, web performance, web security, frameworks)Excellent communication skills and evidence of successful collaboration with designers and product ownersAbility to lead feature designs and story breakdown based on high-level high level architecture.Experience with relational databases such as PostgreSQL, and NoSQL databases like DynamoDB.Experienced in working within Agile methodologies and the Scrum framework. Actively participates in all phases of the sprint cycle, including planning, stand-ups, sprint reviews, retrospectives, and demos.Experience to design & develop microservices and event driven services.Candidate should have secure application development mindset.Able to do cross-team communication to get things done.Participate in on-call duties to support production applications.Passion for tackling complexity with simplicity and building platforms that can scale through multiple orders of magnitude.Ability to work both independently and in cooperation with others.Intellectually curious, passionate, and inventiveA sense of urgency and ownership over the product

Responsibilities: Leadership and Team Management:Build, lead and mentor a team of DevOps and cloud engineers, fostering a collaborative and innovative work environment spanning India & Mexico for a global enterprise.Set clear goals and expectations, conduct regular performance evaluations, and provide ongoing feedback to drive individual and team growth.Cloud Infrastructure Strategy:Develop and execute a comprehensive cloud strategy aligned with business goals, ensuring optimal resource utilization, scalability, and security.Stay abreast of industry best practices and emerging technologies to continually enhance the company's cloud infrastructure.DevOps Automation:Build, deploy & support our K8s based platforms and containerized workloads and ETL pipelines in Azure & AWS clouds.Oversee the implementation and improvement of CI/CD pipelines, automated testing, and deployment processes to accelerate application delivery.Drive automation initiatives to increase efficiency in managing infrastructure and application lifecycle.Infrastructure Monitoring and Optimization:Implement robust monitoring and alerting solutions to proactively identify and address potential issues.Optimize cloud resources to ensure cost-effectiveness while maintaining high performance and reliability.Security and Compliance:Collaborate with the security team to establish and enforce security best practices for infrastructure and applications.Ensure compliance with industry standards and regulations related to cloud infrastructure.Collaboration and Communication:Work closely with development, operations, and other cross-functional teams to understand requirements and provide scalable solutions.Communicate effectively with stakeholders, presenting technical information in a clear and understandable manner.Requirements:Proven experience in leading and managing a team of DevOps and cloud engineers.Extensive hands on experience with operating Kubernetes based platforms in AWS, Azure or GCP in the past as an individual contributor or a k8s architect.Extensive hands-on experience with cloud platforms such as AWS or Azure.Strong understanding of DevOps principles, Git, CI/CD pipelines, and infrastructure as code (IaC).In-depth knowledge of containerization with Docker.Experience with automation tools (e.g., Ansible, Terraform) and scripting languages (e.g., Python, Bash).Solid understanding of security best practices and compliance in Azure or AWS cloud environments.

Responsibilities:Work with SW teams to understand features and technical implementationWork with other engineers in designing, developing, and maintaining the automation infrastructureLead the charge in designing a testing strategy for each software productCreate and maintain testing plans for each software product that reflect customer usage models and approximate real-world environmentsPerform manual testing where required, whilst working to automate as much as possibleCreate scripts and tools to perform functional application, regression, and performance tests using various techniques (white and black box, etc)Provide standard metrics and results from all testing effortsBe an advocate for driving the software development process toward quality-centric methodologiesRequirements:Degree in Computer Science or related field or equivalent professional experienceDemonstrated testing skills and understanding of all aspects of QA processesStrong Linux command line skills, and the ability to use Linux effectively to create test environments and troubleshoot issuesSolid understanding of SW development lifecycleExperience with virtualization architecture and platformsFamiliarity with container-based software deployment and orchestration using Kubernetes is preferredExperience with CI/CD platforms and toolingExperience with testing frameworks like SeleniumCoding experience in python, bash, C, and/or javascriptGood troubleshooting and debugging skillsKnowledge of HPC clusters and/or networking a plus

Responsibilities:Assists with Information Systems projects.Assists in system analysis and design.Designs and develops low to moderately complex applications.Generates application documentation.Supports integration builds.Assists with maintenance and support.Requirements:Azure Cloud, .NET core, Java, Python, Angular JS, SQL Server, CI/CD Technologies, Kubernetes.Secondary Skills:SAFe Framework, Scrum MastersBachelor’s Degree or International equivalentBachelor's Degree or International equivalent in Computer Science, Information Systems,Mathematics, Statistics or related field - Preferred

Skills

Industry

Location

Jobtitle

7 kubernetes Jobs found

Data Engineer Lead - Python and PySpark

Java Tech Lead

Cloud Operations Engineer

Senior/Software Engineer 2 - Threat Reporting & Response

Infrastructure & DevOps Tech Lead

Software Engineer - Quality

Applications Developer

WhiteCrow
WhiteCrow is on a mission to connect companies with the best talent across the globe.

EMPLOYER

TALENT

COMPANY

Contact Us

JOBS BY SKILLS

JOBS BY FUNCTION

JOBS BY INDUSTRY

JOBS BY LOCATIONS

MODEL JOBS

JOBS BY CITY

Skills

Industry

Location

Jobtitle

7 kubernetes Jobs found

Data Engineer Lead - Python and PySpark

Java Tech Lead

Cloud Operations Engineer

Senior/Software Engineer 2 - Threat Reporting & Response

Infrastructure & DevOps Tech Lead

Software Engineer - Quality

Applications Developer

WhiteCrow WhiteCrow is on a mission to connect companies with the best talent across the globe.

EMPLOYER

TALENT

COMPANY

Contact Us

JOBS BY SKILLS

JOBS BY FUNCTION

JOBS BY INDUSTRY

JOBS BY LOCATIONS

MODEL JOBS

JOBS BY CITY

WhiteCrow
WhiteCrow is on a mission to connect companies with the best talent across the globe.