Design and maintain large-scale data pipelines and ETL processes, optimize SQL queries, and mentor junior engineers while ensuring data governance.
Job Description:
We are seeking a highly skilled Senior Data Engineer to join our team and contribute to building scalable, reliable, and high-performance data platforms. The ideal candidate will have strong expertise in Python, SQL, Spark, and hands-on experience with cloud-based big data platforms such as Databricks.
Key Responsibilities:- Design, develop, and maintain large-scale data pipelines and ETL processes.
- Work with Spark and Databricks to process and transform large datasets efficiently.
- Optimize SQL queries and data models for performance and scalability.
- Collaborate with data scientists, analysts, and business stakeholders to deliver reliable data solutions.
- Ensure best practices in data governance, data quality, and security.
- Mentor junior engineers and contribute to technical design reviews.
- Strong experience in Python programming for data engineering.
- Advanced knowledge of SQL for querying, optimization, and modeling.
- Hands-on expertise with Apache Spark for distributed data processing.
- Working knowledge of Databricks (Databricks Certification: Yes/No – preferred but not mandatory).
- Experience with data lakes, data warehouses, and cloud platforms (Azure/AWS/GCP).
- Familiarity with CI/CD pipelines and version control (Git).
- Excellent problem-solving and communication skills.
- Databricks Certification (Associate/Professional) – highly preferred.
- Knowledge of streaming frameworks (Kafka, Delta Live Tables).
- Experience with data orchestration tools (Airflow, ADF, etc.).
Top Skills
AWS
Azure
Databricks
GCP
Git
Python
Spark
SQL
Unison Consulting Singapore Office
1 Changi Business Park Crescent, , Plaza 8 #03-06 Tower A, Singapore, , Singapore, 486025
Unison Consulting Singapore Office
#12-00, 63 Market Street, Bank of Singapore Center, Singapore, , Singapore, 048942
Similar Jobs
Artificial Intelligence • Fintech • Payments • Financial Services • Generative AI
The Senior Data Engineer will design and implement ETL processes, manage data pipelines, ensure data governance, and leverage AI in data systems while collaborating cross-functionally.
Top Skills:
AirflowApache NifiBigQueryGoogle Cloud PlatformInformaticaMySQLOraclePostgresPythonRSQLTalend
Artificial Intelligence • Fintech • Payments • Financial Services • Generative AI
Develop next-gen data infrastructure solutions for AI initiatives, collaborating with data teams and ensuring system reliability and compliance.
Top Skills:
AWSAzureDatabricksFlinkGCPJavaKafkaPythonScalaSparkTableau
Artificial Intelligence • Fintech • Payments • Financial Services • Generative AI
Design and implement scalable data infrastructure solutions, manage systems like Kafka and Spark, conduct maintenance and testing, ensure security compliance, and collaborate with cross-functional teams.
Top Skills:
AWSAzureDatabricksFlinkGCPJavaKafkaPythonScalaSparkTableau
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.
