The Data Engineer will analyze data needs, document requirements, and implement efficient data collection mechanisms. This role includes planning and designing data engineering jobs, developing test plans, and automating processes to enhance efficiency. They will also support deployment of new solutions and ensure smooth operations of IT services, addressing production issues as needed.
- Strong data modelling and data analysis skills are a must.
- Familiarity with scripting for automating tasks using Python.
- Hands-on experience of reporting or visualization tool like SAP BO and Tableau is important.
- Good understanding and completion of projects using waterfall/Agile methodology.
- Good understanding of analytics and data warehouse implementations.
- Hands-on experience in DevOps deployment, ETL tools like Informatica, and data virtualisation tools like Denodo will be an added advantage.
- Analyse the Authority’s data needs and document the requirements.
- Refine data collection/consumption by migrating data collection to more efficient channels.
- Plan, design, and implement data engineering jobs and reporting solutions to meet the analytical needs.
- Develop test plan and scripts for system testing, support user acceptance testing.
- Work with partners to streamline processes and implement automation to improve efficiency and quality of output.
- Work with the Authority’s technical teams to ensure smooth deployment and adoption of new solution.
- Ensure the smooth operations and service level of IT solutions.
- Support production issues
Top Skills
Python
Unison Consulting Singapore Office
1 Changi Business Park Crescent, , Plaza 8 #03-06 Tower A, Singapore, , Singapore, 486025
Unison Consulting Singapore Office
#12-00, 63 Market Street, Bank of Singapore Center, Singapore, , Singapore, 048942
Similar Jobs
Be an Early Applicant
As a Junior Data Engineer, you will design, develop, and maintain data pipelines using Hadoop and Spark. You will collaborate with teams to ensure data quality, and implement CI/CD processes with DevOps. The role requires optimizing workflows for containerized deployment and mentoring junior members.
Be an Early Applicant
The Data Engineer (Python) will be responsible for ingesting data from various sources, curating data assets, collaborating with teams, deploying ML models, and architecting data pipelines to enable informed decision-making. The role focuses on enhancing the user experience through data-driven solutions.
Be an Early Applicant
As a Junior Data Engineer, you will support the Regional Data team by building data pipelines, ingesting data sources into the data warehouse, and creating tools for data consumers. You will ensure high-quality data assets for data scientists and collaborate with cross-functional teams to enhance data-driven decision-making.
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.