Keppel Logo

Keppel

Senior Data Engineer

Posted 22 Days Ago
Be an Early Applicant
Singapore
Senior level
Singapore
Senior level
The Senior Data Engineer will develop and maintain scalable data pipelines, enhance data accessibility, collaborate with teams for data modeling, and ensure data quality.
The summary above was generated by AI

JOB DESCRIPTION

  • Develop, maintain scalable data pipelines and build out new integrations to support continuing increases in data volume and complexity.
  • Develop and maintain scalable, optimized data pipelines leveraging Python and AWS services to support increasing data volume and complexity, while ensuring seamless integration with AI platforms like Bedrock and Google.
  • Further enhance data accessibility and drive data-driven decision making by collaborating with analytics and business teams to refine data models for business intelligence tools.
  • Develop data models, schemas, and standards that ensure data integrity, quality, and accessibility.
  • Develop, maintain, and optimize scalable data pipelines using Python and AWS services (e.g., S3, Lambda, ECS, EKS, RDS, SNS/SQS, Vector DB).
  • Build solutions with AI Services like Bedrock, Google etc.
  • Rapidly developing next-generation scalable, flexible, and high-performance data pipelines.
  • Collaborate with analytics and business teams to create and improve data models for business intelligence.
  • End-to-end ownership of data quality in our core datasets and data pipelines.
  • Participate in code reviews and contribute to DevOps / DataOps / MLOps.

JOB REQUIREMENTS

Requirements:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 5-6 years of experience in data engineering or a similar role.
  • Strong programming skills in Python, SQL, AWS and related tech stack.
  • Experience with building scalable data pipelines with technologies such as Glue, Airflow, Kafka, Spark etc..
  • Experience using Snowflake, DBT, Bedrock is a plus.
  • Good understanding of basic machine learning concepts (Sagemaker).

 #LI-JL2

BUSINESS SEGMENT

CorporatePLATFORMOperating Division

Top Skills

Airflow
AWS
Bedrock
Dbt
Glue
Kafka
Python
Sagemaker
Snowflake
Spark
SQL
HQ

Keppel Singapore Office

1 HarbourFront Avenue, Level 2, Keppel Bay Tower, Singapore, 098632

Similar Jobs

7 Days Ago
Singapore, SGP
Senior level
Senior level
Gaming • Hardware
The Senior Data Engineer will lead initiatives for AI data engineering, develop scalable data pipelines, and collaborate with AI/ML teams.
Top Skills: AirflowAWSAzureDaskDbtDockerGCPKubernetesNeo4JPrefectPythonSparkSQLTerraform
Senior level
Information Technology • Consulting
As a Senior Data Engineer, you'll design and optimize big data solutions using Spark, Scala, and Elasticsearch, implementing data transformations and processing pipelines.
Top Skills: AnsibleBitbucketDockerElasticsearchGrafanaHadoopJavaJenkinsOpenshift Container PlatformPrometheusPythonScalaSparkSplunk
23 Days Ago
Singapore, SGP
Senior level
Senior level
Gaming • Hardware
Design, build, and maintain data processing systems for analytics and AI applications. Develop data pipelines, manage data storage, and mentor junior engineers.
Top Skills: AirflowAws RedshiftAzure Data LakeBigQueryDaskData Build Tool (Dbt)DockerJavaKubernetesPythonSnowflakeSparkSQLTerraform

What you need to know about the Singapore Tech Scene

The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account