The Data Engineer will build and maintain ETL pipelines, design data transformations, and collaborate on modeling and performance optimization across data platforms.
We are looking for a highly motivated and skilled Data Engineer
Key Responsibilities- Build and maintain robust, scalable ETL pipelines across batch and real-time data sources.
- Design and implement data transformations using Spark (PySpark/Scala/Java) on Hadoop/Hive.
- Stream data from Kafka topics into data lakes or analytics layers using Spark Streaming.
- Collaborate with cross-functional teams on data modeling, ingestion strategies, and performance optimization.
- Implement and support CI/CD pipelines using Git, Jenkins, and container technologies like Docker/Kubernetes.
- Work within cloud and on-prem hybrid data platforms, contributing to automation, deployment, and monitoring of data workflows.
Skills
- Strong programming skills in Python, Scala, or Java.
- Hands-on experience with Apache Spark, Hadoop, Hive, Kafka, HBase, or related tools.
- Sound understanding of data warehousing, dimensional modeling, and SQL.
- Familiarity with Airflow, Git, Jenkins, and containerization tools (Docker/Kubernetes).
- Exposure to cloud platforms such as AWS or GCP is a plus.
- Experience with Agile delivery models and collaborative tools like Jira and Confluence.
- Experience with streaming data pipelines, machine learning workflows, or feature engineering.
- Familiarity with Terraform, Ansible, or other infrastructure-as-code tools.
- Exposure to Snowflake, Databricks, or modern data lakehouse architecture is a bonus.
Top Skills
Airflow
Ansible
AWS
Databricks
Docker
GCP
Git
Hadoop
Hbase
Hive
Java
Jenkins
Kafka
Kubernetes
Python
Scala
Snowflake
Spark
SQL
Terraform
Unison Consulting Singapore Office
1 Changi Business Park Crescent, , Plaza 8 #03-06 Tower A, Singapore, , Singapore, 486025
Unison Consulting Singapore Office
#12-00, 63 Market Street, Bank of Singapore Center, Singapore, , Singapore, 048942
Similar Jobs
Fintech • Information Technology • Payments
As a Data Engineer at Visa, you'll design, develop, and implement applications, focusing on Java technologies and REST APIs, while collaborating with teams and ensuring high performance and security standards.
Top Skills:
AngularSparkCSSDockerGitHadoopHTMLJavaJavaScriptJenkinsKafkaMavenMicroservicesMySQLReactSpring BootSQLUnix
Fintech • Financial Services
As a Data Engineer at Nascent, you will identify novel data sources, develop pipelines, conduct exploratory analyses, and collaborate across teams to enhance trading strategies.
Top Skills:
DockerJuliaLinux CliMatlabPandasPolarsPythonRSQL
Software • Travel
Lead the design and implementation of AI-driven data models, integrate business processes, and enhance data architecture for Omio's AI transformation efforts.
Top Skills:
AirflowBigQueryChatgptClaudeDataprocDbtDockerGCPGcsGeminiJavaK8SLookerPubsubPythonScalaSparkTerraform
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.
