Design and implement scalable ETL pipelines using AWS and Python, optimize data solutions, and ensure data quality and compliance.
- Design and build scalable ETL pipelines and data integration workflows using AWS services and Python.
- Develop and optimize data lake and data warehouse solutions for structured and unstructured data.
- Leverage Apache Spark for large-scale data processing and transformation tasks.
- Collaborate with cross-functional teams to gather requirements and deliver clean, usable datasets for analytics and reporting.
- Ensure high data quality, security, and compliance in all stages of the data lifecycle.
- 5+ years of hands-on experience in data engineering roles.
- Proficiency in Python for building and automating data pipelines.
- Strong experience with AWS services (S3, Glue, Redshift, Lambda, etc.).
- Solid understanding of ETL processes and modern data warehousing concepts.
- Experience with big data tools, especially Apache Spark (PySpark preferred).
- Familiarity with DevOps and CI/CD practices for data pipeline deployment.
- Knowledge of data governance and cataloging tools.
- Strong problem-solving, communication, and collaboration skills.
Top Skills
Spark
AWS
Aws Glue
Aws Lambda
Aws Redshift
Aws S3
ETL
Python
Unison Consulting Singapore Office
1 Changi Business Park Crescent, , Plaza 8 #03-06 Tower A, Singapore, , Singapore, 486025
Unison Consulting Singapore Office
#12-00, 63 Market Street, Bank of Singapore Center, Singapore, , Singapore, 048942
Similar Jobs
Information Technology • Software
The Deal Desk Analyst collaborates with sales teams to create, review, and approve commercial quotes, ensuring compliance and managing deal governance. Responsibilities include negotiating commercial terms and improving deal desk productivity.
Top Skills:
ExcelPowerPointSalesforceSalesforce Cpq
Fintech • Analytics
The Accounts Receivable Executive will manage invoicing, resolve discrepancies, maintain accounting records, and support finance teams while ensuring effective operations.
Top Skills:
ExcelMS OfficeOracle
Information Technology • Software
As a SaaS Operations Engineer, you will manage incidents, execute services, deploy applications, and collaborate with teams to ensure quality service delivery for Sitecore's SaaS platform.
Top Skills:
AksAWSAzureElasticElastic SearchHelmJira Service DeskKubernetesLinuxAzureMongo DbNoSQLOpsgeniePagerdutyRedisRedisService Now
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.