Data Engineer / Senior / Supervisor

ASC - Downstream Data Scientist

Senior Data Engineer

Role Description:The Data Engineering Senior Supervisor will lead a small team of data engineering professionals to design, build and operate high performance data centric products or solutions through the use of modern engineering practices and technologies.In this role, you will provide guidance to ensure the delivered data centric products or solutions are scalable, sustainable and robust.You will also lead team development and cross team relationships and delivery to advance the company's engineering delivery.Responsibilities:Lead a local or regional team of engineering professionals that design, develop, deploy and enhance new and existing data centric products or solutions through the use of modern platforms and technologies.Provide routine inputs and guidance to the data engineering team on business requirements analysis, technical specification's preparation, product delivery, testing and operation to support businesses strategic direction.Coach engineers, share relevant technical approaches, identify new trends, modern skills and present new methodologies within the data engineering community.Lead and develop a team, coach and make decisions related to talent management, hiring, performance, and disciplinary actions.Other duties as assignedRequirements:Minimum QualificationsBachelor's degree in a related field or equivalent experience.Minimum of four years of related work experience.Minimum of two years leading a team of Data Engineers.Preferred QualificationsConfirmed data engineering experience with data storage and management of large, heterogenous datasets, including formats, structures, and cataloging with such tools as Iceberg, Parquet, Avro, ORC, S3, HFDS, HIVE, Kudu or others.Experience leading Big Data engineering teams working in environments such as Hadoop and SparkExperience leading technology strategies with cloud Platforms including AWS, GCP or AzureExperience leading engineering teams working in streaming and stream integration or middleware platforms, tools, and architectures such as Kafka, Flink, JMS, or Kinesis.Confirmed knowledge of best practice patterns and how to apply them to modern data architectures, including data warehouses, data lakes, data mesh, hubs and associated capabilities including ingestion, governance, modeling, observability and more.Experience leveraging transformation and modeling tools, including SQL based transformation frameworks, orchestration and quality frameworks including dbt, Apache Nifi, Talend, AWS Glue, Airflow, Dagster, Great Expectations, Oozie and others.Strong programming knowledge of SQL, Python, R, Java, Scala or equivalent.Proficiency in engineering tooling including docker, git, and container orchestration services.Strong experience leading devops teams with demonstratable understanding of associated best practices for code management, continuous integration, and deployment strategies.Experience and knowledge of data governance considerations including quality, privacy, security associated implications for data product development and consumption.A passion for quality and continuous improvement with an owners mindset.Ability to work effectively as part of a team, group and cultureAbility to navigate ambiguity and work in agile ways.

Responsibilities:Formulate and lead multifaceted analytic studies against large volumes of data.Interpret and analyze data using exploratory mathematic and statistical techniques based on the scientific method.Coordinate research and analytic activities utilizing various data points (unstructured and structured) and employ programming to clean, massage, and organize the data.Experiment against data points, provide information based on experiment results and provide previously undiscovered solutions to command data challenges.Lead all data experiments tasked by the Data Science Team.Coordinate with Data Engineers to build data environments providing data identified by Data Analysts, Data Integrators, Knowledge Managers, and Intel Analysts.Develop methodology and processes for prioritization and scheduling of projects.Analyze problems and determine root causes.Define company data assets (data models), spark, sparkSQL, and hiveSQL jobs to populate data models.Work closely with all business units and engineering teams to develop strategy for long term data platform architecture.Requirements:As the successful candidate you will hold a Bachelor degree in Operations Research, Industrial Engineering, Applied Mathematics, Statistics, Physics, Computer Science, or related fields. An advanced degree is preferred.You will have 5-7 years of professional experience in related fieldYou will have Proficiency with one or more programming languages (Java, C++, Python, R, etc.)You will be able to demonstrate experience applying data science methods to real-world data problemsYou will also have experience in utilizing visualization tools to take advantage of the growing volume of available information

Responsibilities:Data engineers need to write code to develop, maintain, and optimize data pipelines, as well as to implement data storage solutions and data processing systems. They typically use programming languages such as Python, Java, or Scala, along with big data technologies like Hadoop, Spark, and KafkaDesigning scalable data architecture that supports both transactional and analytical workloads. This involves understanding business requirements and translating them into technical solutions.Developing robust data pipelines to ingest, cleanse, transform, and aggregate data from various sources (internal and external). This includes both batch and real-time/streaming data processing.Integrating data from disparate sources and ensuring data consistency, integrity, and reliability across different systems.Requirements:5-8 years experience with GCP, Big Query, Data Fusion, Analytics Hub and DataFlowExperience leading othersExperience managing projectsExcellent written and verbal communication skillsTime ManagementAbility to work alone and with a teamAbility to mentor junior membersA Bachelor’s degree in MIS or mathematics, statistics, or computer science, international equivalent, or equivalent job experience

Responsibilities:Formulates and leads guided, multifaceted analytic studies against large volumes of data.Interprets and analyzes data using exploratory mathematic and statistical techniques based on the scientific method.Coordinates research and analytic activities utilizing various data points (unstructured and structured) and employ programming to clean, massage, and organize the data.Experiments against data points, provide information based on experiment results and provide previously undiscovered solutions to command data challenges.Leads all data experiments tasked by the Data Science Team.Coordinates with Data Engineers to build data environments providing data identified by Data Analysts, Data Integrators, Knowledge Managers, and Intel Analysts.Develops methodology and processes for prioritization and scheduling of projects.Analyzes problems and determines root causes.Defines company data assets (data models), spark, sparkSQL, and hiveSQL jobs to populate data models.Works closely with all business units and engineering teams to develop strategy for long term data platform architecture.Requirements:Master’s degree in Operations Research, Industrial Engineering, Applied Mathematics, Statistics, Physics, Computer Science, or related fields5-7 years of professional experienceProficient with one or more programming languages (Java, C++, Python, R, etc.)Demonstrated experience applying data science methods to real-world data problemsExperience utilizing visualization tools to take advantage of the growing volume of available informationData Scientist Qualifications / Skills:Advanced analytical knowledge of dataConducting big data analysisData conditioningProgramming advanced computingDeveloping algorithmsDeveloping software and data modelsExecuting predictive analytics

Skills

Industry

Location

Jobtitle

4 spark Jobs found

Data Engineer / Senior / Supervisor

ASC - Downstream Data Scientist

Senior Data Engineer

ASC - Downstream Data Scientist

WhiteCrow
WhiteCrow is on a mission to connect companies with the best talent across the globe.

EMPLOYER

TALENT

COMPANY

Contact Us

JOBS BY SKILLS

JOBS BY FUNCTION

JOBS BY INDUSTRY

JOBS BY LOCATIONS

MODEL JOBS

JOBS BY CITY

Skills

Industry

Location

Jobtitle

4 spark Jobs found

Data Engineer / Senior / Supervisor

ASC - Downstream Data Scientist

Senior Data Engineer

ASC - Downstream Data Scientist

WhiteCrow WhiteCrow is on a mission to connect companies with the best talent across the globe.

EMPLOYER

TALENT

COMPANY

Contact Us

JOBS BY SKILLS

JOBS BY FUNCTION

JOBS BY INDUSTRY

JOBS BY LOCATIONS

MODEL JOBS

JOBS BY CITY

WhiteCrow
WhiteCrow is on a mission to connect companies with the best talent across the globe.