Design and develop scalable ETL pipelines and data integration workflows using AWS and Python, ensuring data quality and compliance.
- Design and build scalable ETL pipelines and data integration workflows using AWS services and Python.
- Develop and optimize data lake and data warehouse solutions for structured and unstructured data.
- Leverage Apache Spark for large-scale data processing and transformation tasks.
- Collaborate with cross-functional teams to gather requirements and deliver clean, usable datasets for analytics and reporting.
- Ensure high data quality, security, and compliance in all stages of the data lifecycle.
- 5+ years of hands-on experience in data engineering roles.
- Proficiency in Python for building and automating data pipelines.
- Strong experience with AWS services (S3, Glue, Redshift, Lambda, etc.).
- Solid understanding of ETL processes and modern data warehousing concepts.
- Experience with big data tools, especially Apache Spark (PySpark preferred).
- Familiarity with DevOps and CI/CD practices for data pipeline deployment.
- Knowledge of data governance and cataloging tools.
- Strong problem-solving, communication, and collaboration skills.
Top Skills
Spark
Aws Glue
Aws Lambda
Aws Redshift
Aws S3
Pyspark
Python
Unison Consulting Singapore Office
1 Changi Business Park Crescent, , Plaza 8 #03-06 Tower A, Singapore, , Singapore, 486025
Unison Consulting Singapore Office
#12-00, 63 Market Street, Bank of Singapore Center, Singapore, , Singapore, 048942
Similar Jobs
Artificial Intelligence • Big Data • Machine Learning • Software • Analytics
As a Senior SOC Analyst, you will lead security incident response, design security monitoring architecture, and mentor junior analysts while utilizing modern security tools and threat data.
Top Skills:
Cloud Security MonitoringCnapp SolutionsFalcon XdrKubernetesNetwork Monitoring ToolsPythonSecurity FrameworksSiem PlatformsTerraform
Artificial Intelligence • Big Data • Machine Learning • Software • Analytics
As a Machine Learning Engineer, you'll develop end-to-end ML workflows, implement Generative AI applications, collaborate with clients, and ensure model deployment to production.
Top Skills:
AutomlAWSAzureData ScienceGCPGenerative AiH2O.AiKubernetesLlmsMachine LearningVector Databases
Information Technology • Software
Senior DevOps Engineer responsible for automating solutions for operation platforms, mentoring team members, and enhancing the efficiency of software delivery processes.
Top Skills:
Ai-Assisted ToolsAnsibleAzure Application InsightsAzure DevopsAzure MonitorBashBitbucket PipelinesClickonceDockerGherkinKubernetesLinuxAzureNunitPowershellPythonSeleniumSpecflowTerraformVeracodeWindowsYaml
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.
