The Data Engineer will build and maintain ETL pipelines, design data transformations, and collaborate on modeling and performance optimization across data platforms.
We are looking for a highly motivated and skilled Data Engineer
Key Responsibilities- Build and maintain robust, scalable ETL pipelines across batch and real-time data sources.
- Design and implement data transformations using Spark (PySpark/Scala/Java) on Hadoop/Hive.
- Stream data from Kafka topics into data lakes or analytics layers using Spark Streaming.
- Collaborate with cross-functional teams on data modeling, ingestion strategies, and performance optimization.
- Implement and support CI/CD pipelines using Git, Jenkins, and container technologies like Docker/Kubernetes.
- Work within cloud and on-prem hybrid data platforms, contributing to automation, deployment, and monitoring of data workflows.
Skills
- Strong programming skills in Python, Scala, or Java.
- Hands-on experience with Apache Spark, Hadoop, Hive, Kafka, HBase, or related tools.
- Sound understanding of data warehousing, dimensional modeling, and SQL.
- Familiarity with Airflow, Git, Jenkins, and containerization tools (Docker/Kubernetes).
- Exposure to cloud platforms such as AWS or GCP is a plus.
- Experience with Agile delivery models and collaborative tools like Jira and Confluence.
- Experience with streaming data pipelines, machine learning workflows, or feature engineering.
- Familiarity with Terraform, Ansible, or other infrastructure-as-code tools.
- Exposure to Snowflake, Databricks, or modern data lakehouse architecture is a bonus.
Top Skills
Airflow
Ansible
AWS
Databricks
Docker
GCP
Git
Hadoop
Hbase
Hive
Java
Jenkins
Kafka
Kubernetes
Python
Scala
Snowflake
Spark
SQL
Terraform
Unison Consulting Singapore Office
1 Changi Business Park Crescent, , Plaza 8 #03-06 Tower A, Singapore, , Singapore, 486025
Unison Consulting Singapore Office
#12-00, 63 Market Street, Bank of Singapore Center, Singapore, , Singapore, 048942
Similar Jobs
Artificial Intelligence • Fintech • Payments • Financial Services • Generative AI
As a DevOps Engineer, you'll design and automate the global infrastructure while enhancing cloud performance, security, and collaboration, ensuring scalability for growth.
Top Skills:
ArgoCi/CdDebeziumDockerFlinkGCPGitlabGitopsGoJavaJenkinsKafkaKubernetesPinotPythonRustTerraform
Gaming • Software • Metaverse
The Data Engineer designs and maintains data architectures and pipelines, processes datasets, optimizes ETL processes, and collaborates with teams to support data-driven decisions.
Top Skills:
AirflowAWSAzureDelta LakeFlinkGCPHiveIcebergJavaKafkaLuigiPythonSparkSQL
Information Technology
Develop full-stack applications using Python and Java or .NET, with a focus on cloud native solutions and modern web front-end frameworks. Engage with stakeholders and lead teams in agile environments while ensuring high code quality and implementation of CI/CD practices.
Top Skills:
.NetAngularAutomated Testing FrameworksCi/CdCloud Native ApplicationsJavaJavaScriptPythonReactTypescriptVulnerability Scanning Tools
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.
