Design and implement scalable ETL pipelines using AWS and Python, optimize data solutions, and ensure data quality and compliance.
- Design and build scalable ETL pipelines and data integration workflows using AWS services and Python.
- Develop and optimize data lake and data warehouse solutions for structured and unstructured data.
- Leverage Apache Spark for large-scale data processing and transformation tasks.
- Collaborate with cross-functional teams to gather requirements and deliver clean, usable datasets for analytics and reporting.
- Ensure high data quality, security, and compliance in all stages of the data lifecycle.
- 5+ years of hands-on experience in data engineering roles.
- Proficiency in Python for building and automating data pipelines.
- Strong experience with AWS services (S3, Glue, Redshift, Lambda, etc.).
- Solid understanding of ETL processes and modern data warehousing concepts.
- Experience with big data tools, especially Apache Spark (PySpark preferred).
- Familiarity with DevOps and CI/CD practices for data pipeline deployment.
- Knowledge of data governance and cataloging tools.
- Strong problem-solving, communication, and collaboration skills.
Top Skills
Spark
AWS
Aws Glue
Aws Lambda
Aws Redshift
Aws S3
ETL
Python
Unison Consulting Singapore Office
1 Changi Business Park Crescent, , Plaza 8 #03-06 Tower A, Singapore, , Singapore, 486025
Unison Consulting Singapore Office
#12-00, 63 Market Street, Bank of Singapore Center, Singapore, , Singapore, 048942
Similar Jobs
Information Technology • Software
The AI Engineer designs and deploys AI-driven applications, develops APIs, and implements MLOps practices using Azure services to enhance productivity.
Top Skills:
Azure Ai FoundryAzure Ai ServicesAzure Cognitive SearchAzure DevopsAzure OpenaiAzure PipelinesBashC#,.NetDockerFastapiGithub ActionsJavaScriptNode.jsNoSQLPowershellPythonReactSQLTypescript
Information Technology • Software
As a Cloud Operations Engineer, you'll monitor cloud service health, assist customers with application support, and ensure service reliability while communicating during critical events.
Top Skills:
AWSAzureCloud ServicesContainer VirtualizationContinuous DeploymentJenkinsTeamcity
Information Technology • Software
The AI Data Scientist develops, validates, and deploys machine learning models, collaborating with stakeholders to turn use cases into data-driven solutions focused on business outcomes.
Top Skills:
AirflowArgoDockerKedroKubeflowKubernetesLangchainMl StudioMlflowMs Co-Pilot StudioNumpyPandasPrompt FlowPythonPyTorchRagScikit-LearnSemantic KernelTensorFlowWeights & Biases
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.
