Design and implement scalable ETL pipelines using AWS and Python, optimize data solutions, and ensure data quality and compliance.
- Design and build scalable ETL pipelines and data integration workflows using AWS services and Python.
- Develop and optimize data lake and data warehouse solutions for structured and unstructured data.
- Leverage Apache Spark for large-scale data processing and transformation tasks.
- Collaborate with cross-functional teams to gather requirements and deliver clean, usable datasets for analytics and reporting.
- Ensure high data quality, security, and compliance in all stages of the data lifecycle.
- 5+ years of hands-on experience in data engineering roles.
- Proficiency in Python for building and automating data pipelines.
- Strong experience with AWS services (S3, Glue, Redshift, Lambda, etc.).
- Solid understanding of ETL processes and modern data warehousing concepts.
- Experience with big data tools, especially Apache Spark (PySpark preferred).
- Familiarity with DevOps and CI/CD practices for data pipeline deployment.
- Knowledge of data governance and cataloging tools.
- Strong problem-solving, communication, and collaboration skills.
Top Skills
Spark
AWS
Aws Glue
Aws Lambda
Aws Redshift
Aws S3
ETL
Python
Unison Consulting Singapore Office
1 Changi Business Park Crescent, , Plaza 8 #03-06 Tower A, Singapore, , Singapore, 486025
Unison Consulting Singapore Office
#12-00, 63 Market Street, Bank of Singapore Center, Singapore, , Singapore, 048942
Similar Jobs
Software
As a Tech Lead at Speechify, you'll actively ship production code for web products, collaborate with your product team, and contribute to product discussions, impacting millions of users.
Top Skills:
FirebaseReactReduxTypescriptVanilla Js
Software
The Software Engineer, Platform will build and optimize complex end-to-end systems, participate in product strategies, and collaborate on architecture with the Platform team.
Top Skills:
GoJavaNode.jsPythonReactTypescript
Software
Seeking a Senior iOS Engineer to lead key engineering decisions, actively develop the iOS app, maintain complex architecture, and contribute to product discussions.
Top Skills:
Ci/CdFastlaneGitSwiftSwiftui
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.