Unison Consulting Logo

Unison Consulting

Data Engineer ( Spark & Hive)

Posted 13 Days Ago
Be an Early Applicant
In-Office
4 Locations
Mid level
In-Office
4 Locations
Mid level
The Data Engineer will design and maintain scalable data pipelines, optimize data processing, support analytics, and implement data quality processes.
The summary above was generated by AI
Description

We are seeking a skilled Data Engineer to join our team in Singapore. The ideal candidate will have strong expertise in SQL, Python, Spark, and Hive, with hands-on experience building scalable data pipelines, data models, and analytical solutions. You will work closely with data scientists, analysts, and business stakeholders to deliver high-quality data solutions that support business decision-making.

Key Responsibilities:

  • Design, develop, and maintain robust, scalable data pipelines and ETL processes.
  • Optimize data storage, retrieval, and processing using SQL, Spark, and Hive.
  • Collaborate with cross-functional teams to gather requirements and translate them into technical solutions.
  • Implement data quality, validation, and monitoring processes to ensure reliability.
  • Support data modeling, warehousing, and integration for analytics and reporting.
  • Write clean, efficient, and reusable Python code for automation and data processing.
  • Ensure data security, compliance, and governance across all solutions.
Requirements

Bachelor’s degree in Computer Science, Engineering, or related field.

4–7 years of experience as a Data Engineer (or similar role).

Strong proficiency in SQL, Python, Spark, and Hive.

Experience with distributed data processing and big data ecosystems.

Hands-on experience with data pipeline tools (e.g., Airflow, NiFi, or similar) is a plus.

Familiarity with cloud platforms (AWS, Azure, or GCP) is advantageous.

Strong problem-solving and communication skills.

Top Skills

Airflow
AWS
Azure
GCP
Hive
Nifi
Python
Spark
SQL

Unison Consulting Singapore Office

1 Changi Business Park Crescent, , Plaza 8 #03-06 Tower A, Singapore, , Singapore, 486025

Unison Consulting Singapore Office

#12-00, 63 Market Street, Bank of Singapore Center, Singapore, , Singapore, 048942

Similar Jobs

6 Days Ago
In-Office
4 Locations
Senior level
Senior level
Information Technology • Consulting
The Data Engineer will design, develop, and optimize big data pipelines using SQL, Python, Spark, Hive, and Hadoop, ensuring data quality and performance.
Top Skills: SparkHadoopHivePythonSQL
6 Hours Ago
In-Office
Colombo, LKA
Senior level
Senior level
Information Technology • Software
The Deal Desk Analyst collaborates with sales teams to create, review, and approve commercial quotes, ensuring compliance and managing deal governance. Responsibilities include negotiating commercial terms and improving deal desk productivity.
Top Skills: ExcelPowerPointSalesforceSalesforce Cpq
7 Hours Ago
In-Office
Colombo, LKA
Entry level
Entry level
Fintech • Analytics
The Accounts Receivable Executive will manage invoicing, resolve discrepancies, maintain accounting records, and support finance teams while ensuring effective operations.
Top Skills: ExcelMS OfficeOracle

What you need to know about the Singapore Tech Scene

The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account