The Data Engineer will build and maintain ETL pipelines, design data transformations, and collaborate on modeling and performance optimization across data platforms.
We are looking for a highly motivated and skilled Data Engineer
Key Responsibilities- Build and maintain robust, scalable ETL pipelines across batch and real-time data sources.
- Design and implement data transformations using Spark (PySpark/Scala/Java) on Hadoop/Hive.
- Stream data from Kafka topics into data lakes or analytics layers using Spark Streaming.
- Collaborate with cross-functional teams on data modeling, ingestion strategies, and performance optimization.
- Implement and support CI/CD pipelines using Git, Jenkins, and container technologies like Docker/Kubernetes.
- Work within cloud and on-prem hybrid data platforms, contributing to automation, deployment, and monitoring of data workflows.
Skills
- Strong programming skills in Python, Scala, or Java.
- Hands-on experience with Apache Spark, Hadoop, Hive, Kafka, HBase, or related tools.
- Sound understanding of data warehousing, dimensional modeling, and SQL.
- Familiarity with Airflow, Git, Jenkins, and containerization tools (Docker/Kubernetes).
- Exposure to cloud platforms such as AWS or GCP is a plus.
- Experience with Agile delivery models and collaborative tools like Jira and Confluence.
- Experience with streaming data pipelines, machine learning workflows, or feature engineering.
- Familiarity with Terraform, Ansible, or other infrastructure-as-code tools.
- Exposure to Snowflake, Databricks, or modern data lakehouse architecture is a bonus.
Top Skills
Airflow
Ansible
AWS
Databricks
Docker
GCP
Git
Hadoop
Hbase
Hive
Java
Jenkins
Kafka
Kubernetes
Python
Scala
Snowflake
Spark
SQL
Terraform
Unison Consulting Singapore Office
1 Changi Business Park Crescent, , Plaza 8 #03-06 Tower A, Singapore, , Singapore, 486025
Unison Consulting Singapore Office
#12-00, 63 Market Street, Bank of Singapore Center, Singapore, , Singapore, 048942
Similar Jobs
Cloud • Security • Software • Cybersecurity • Automation
Develop new features, review database changes, document best practices, and improve product performance in backend engineering focusing on data frameworks.
Top Skills:
KafkaNatsPostgresRubyRuby On Rails
Fintech • Financial Services • Cryptocurrency • NFT • Web3
Design and develop scalable backend services for a high-performance trading platform, focusing on data aggregation and reporting using Golang or Ruby. Collaborate with teams and mentor junior developers.
Top Skills:
AWSAzureDockerGCPGoKubernetesRuby
Software • Cryptocurrency
The Senior Backend Data Engineer will design and develop backend services for financial data aggregation, optimize data pipelines, and collaborate with teams to implement efficient systems.
Top Skills:
AWSAzureDockerEvent-Driven ArchitecturesGCPGoKubernetesMessage QueuesReal-Time Streaming FrameworksRuby
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.
