Centre for Strategic Infocomm Technologies
Data Engineer (Data & Systems Engineering)
Be an Early Applicant
Develop and maintain ETL data pipelines, optimize data flow and delivery, automate manual processes, and design scalable data infrastructure. Gather telemetry data to improve system efficiency and business metrics. Collaborate with cross-functional teams on requirements and data products, using databases, workflow tools, microservices, and APIs. Preferred experience includes Agile development, monitoring, fault-tolerant pipelines, big data technologies, and search engines.
We are seeking a Data Engineer to join our Data & Systems Engineering team. In this role, you will be responsible for enhancing and optimizing the data flow between our systems and refining our data pipeline architecture. You will collaborate closely with cross-functional teams to gather requirements, design scalable solutions, and implement cutting-edge data products. The ideal candidate is passionate about driving the development of our next generation of data initiatives.
Key Responsibilities
- Develop and maintain robust data pipelines for extracting, transforming, and loading data from diverse sources.
- Identify, design, and implement process improvements, including automation of manual processes, optimization of data delivery, and design of scalable infrastructure.
- Gather and analyze telemetry data to provide actionable insights, enhancing the efficiency of data systems and key business performance metrics.
Minimum Requirements
- A degree or professional qualification in Computer Science, Computer Engineering, Information Systems, or a related field.
- A minimum of 2 years of hands-on experience with object-oriented programming languages such as Python, Golang, Java, or C++. (Project/internship experience will be considered for recent graduates.)
- Proficiency with both relational SQL and NoSQL databases.
- Experience in building ETL flows using tools such as NiFi or Airflow.
- Familiarity with microservices architecture and RESTful API design.
Preferred Qualifications
- Experience with software development in Agile SCRUM environments, including testing and production error/metrics monitoring.
- Expertise in building scalable, fault-tolerant, and maintainable data pipelines.
- Proficiency in big data tools such as Hadoop, Spark, and Kafka.
- Experience with search engines like Elasticsearch or Solr.
Considerations for senior positions
- Candidates with at least 5 years of proven track record in data engineering development.
- Experience in technical coaching to junior data engineers.
As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered.
Centre for Strategic Infocomm Technologies Singapore, Singapore, SGP Office
Singapore, Singapore
Similar Jobs
Blockchain • Hardware • Software • Energy • Cryptocurrency • Big Data Analytics
The Data Engineer will build and manage scalable data pipelines and databases, collaborate on architecture, and drive data systems towards real-time capabilities in a fast-paced, innovative environment.
Top Skills:
AirflowClickhouseDockerKafkaKubernetesPl/PgsqlPostgresPythonRedpandaTrino
Fintech • Payments • Financial Services
Lead complex enterprise merchant onboarding and conduct multi-jurisdictional CDD, KYC, and AML risk assessments. Manage PEP, sanctions, adverse media, corporate-structure, and high-risk industry risks. Drive quality control, regulatory policy alignment, process optimization, tooling improvements, escalations, and team calibration. Partner with Commercial, Sales, Account Management, Product, Engineering, and Compliance teams while mentoring analysts and supporting compliant business growth.
.jpeg)
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Leads HBM product engineering reliability teams responsible for reliability test development, qualification execution, DPM reduction, failure analysis, root-cause resolution, manufacturing test optimization, and process conversions. Collaborates with fabrication, technology development, design, quality, and system teams to improve yield, cost, cycle time, quality, and product reliability. Provides technical decisions, risk management, project leadership, mentoring, and innovation while supporting HBM products across DRAM, interface die, and stacked components.
Top Skills:
DramElectrical Failure Analysis (Efa)High Bandwidth Memory (Hbm)JmpPhysical Failure Analysis (Pfa)PythonSemiconductor Manufacturing Test Flows
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.
