This role involves designing and maintaining data pipelines, managing APIs, collaborating with teams, and ensuring data quality and governance.
Assurity Trusted Solutions (ATS) is a wholly owned subsidiary of the Government Technology Agency (GovTech). As a Trusted Partner over the last decade, ATS offers a comprehensive suite of products and services ranging from infrastructure and operational services, authentication services, governance and assurance services as well as managed processes. In a dynamic digital and cyber landscape, where trust & collaboration are key, ATS continues to drive mutually beneficial business outcomes through collaboration with GovTech, government agencies and commercial partners to mitigate cyber risks and bolster security postures.
Key Responsibilities:
- Design, implement, and maintain scalable data pipelines and ETL processes to ingest, catalog, normalise data and to ensure high data quality and availability.
- Create and manage APIs for data access, integration, and delivery to various stakeholders.
- Collaborate with cross-functional teams to gather requirements and translate them into technical solutions.
- Optimally structure and document data transformation processes to enhance efficiency and maintainability.
- Lead data modelling efforts to ensure that data architecture supports business goals and analytical initiatives.
- Configure, curate and maintain the central data catalog or metadata repository e.g. DataZone or similar data catalogue and governance platforms
- Implement best practices for data governance and maintain compliance with relevant regulations.
- Collaborate with Project Manager, Frontend Developers, UX Designers and Data Analyst to build scalable data-driven products
- Support data consumers in subscribing to and using approved data products across domains
- Be responsible for developing backend APIs & working on databases to support the applications
- Work in an Agile Environment that practises Continuous Integration and Delivery
Requirements
- At least 3 years of experience as a Data Engineer, with a proven track record of designing and deploying large-scale data solutions.
- Strong proficiency in programming languages, particularly Python, PySpark and SQL derivatives (MySQL, NoSQl, etc.).
- Experience working with structured, semi-structured, and unstructured data
- Experience with AWS ETL and orchestration tools such as AWS MSK (Kafka), Firehose, SNS, Airflow or equivalent.
- Extensive knowledge of data modelling, data access and data storage infrastructure like Data Lake (both SQL and NoSQL) and Data Warehouses (e.g., AWS S3 , AWS Redshift, AWS Athena, BigQuery, RDBMs, NoSQL DBs).
- Knowledge of open table formats such as Apache Iceberg, Parquet etc.
- Familiarity with data mesh principles, domain ownership, data product thinking and federated governance
- Familiarity with Big Data technologies (e.g., Hadoop, Spark) and cloud services (e.g., AWS, GCP).
- Solid understanding of data architecture concepts, data lakes, and data marts, data catalog, data governance, metadata management and RBAC/ABAC models
- Exceptional analytical and problem-solving skills, with the ability to work in a fast-paced, collaborative environment.
- Excellent communication skills and experience working with stakeholders at various levels.
- Ability to mentor and guide team members in best practices and new technologies.
Join us and discover a meaningful and exciting career with Assurity Trusted Solutions!
The remuneration package will commensurate with your qualifications and experience. Interested applicants, please click "Apply Now".
We thank you for your interest and please note that only shortlisted candidates will be notified.
By submitting your application, you agree that your personal data may be collected, used and disclosed by Assurity Trusted Solutions Pte. Ltd. (ATS), GovTech and their service providers and agents in accordance with ATS’s privacy statement which can be found at: https://www.assurity.sg/privacy.html or such other successor site.
Benefits
- We promote a learning culture and encourage you to grow and learn.
- Annual Leave Benefits with additional perks such as Family Care and Birthday Leave.
- Working in a collaborative environment with helpful team members
Assurity Trusted Solutions Pte Ltd Singapore, Singapore, SGP Office
Singapore, Singapore
Similar Jobs
Information Technology • Software • Cybersecurity • Defense
Design and maintain high-throughput pipelines for large-scale unstructured data processing. Build transformation, enrichment, vector embedding, hybrid retrieval, multimedia analysis, and computer vision capabilities. Ensure data quality, reliability, testing, observability, and performance while collaborating with data scientists, frontend engineers, and product managers to support national security analytics.
Top Skills:
Ai ModelsCi/CdCloud-Native Data TechnologiesComputer VisionDockerEtl/EltHybrid SearchKeyword SearchKubernetesSemantic SearchVector DatabasesVector Embeddings
Big Data • Cloud • Logistics • Machine Learning • Retail
Leads architecture and development of large-scale batch and real-time data platforms and pipelines. Ensures data quality, governance, reliability, observability, scalability, and cost efficiency while building self-service capabilities. Supports analytics, machine learning, and generative AI teams with trusted data infrastructure. Establishes engineering standards, mentors engineers, and drives platform health across multiple teams. The role requires expertise in data integration, distributed processing, data modeling, cloud platforms, CI/CD, and infrastructure automation.
Top Skills:
Apache AirflowApache BeamApache FlinkApache HiveSparkBigQueryCi/CdETLGoogle Cloud PlatformInfrastructure AutomationJavaPrestoPythonScalaWcag 2.2 Aa
Financial Services
Design, build, test, deploy, and maintain scalable, resilient cloud-based data pipelines and microservices (primarily on AWS). Implement ETL/ELT, data lake/warehouse solutions, support analytics integration, enforce data quality, and follow Agile DevOps practices with CI/CD and IaC.
Top Skills:
AirflowAthenaAWSAws Step FunctionsBigQueryContainersDatabricksDbtDockerEksGlueIamKafkaKubernetesLambdaNoSQLPysparkPythonReactRedshiftRestful ApisS3SnowflakeSparkSpark Structured StreamingSQLTerraformTrinoTypescript
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.
