Oversee operations of big data platforms, monitor services, manage configurations, address vulnerabilities, and develop automation scripts for operational consistency.
- Oversee day-to-day operations of big data platform to ensure high availability, reliability and performance.
- Proactively monitor big data platform services, components and clusters to identify potential issues. Take corrective actions as needed to maintain platform health
- Manage configuration, upgrades, and patching of big data platform, ensuring all services are up to date
- Work with the Authority’s technical teams to ensure smooth deployment and adoption of new solution to support data ingestions, process and workflows
- Maintain clear and detailed documentation of platform configuration, troubleshooting steps and incident resolution.
- Continuously monitor for and address platform security vulnerabilities. Implement patching strategies to resolve identified vulnerabilities and maintain a secure environment.
- Develop automation script to streamline administrative tasks, platform health and ensure operational consistency.
- Ensure the smooth operations and service level of IT solutions.
- Support production issues
Requirements
- Hands-on experience, knowledge and troubleshooting of Cloudera Data Platform such as HDFS, YARN, HIVE, Spark, Impala, Ranger, operating systems, security and network.
- Hands on experience with monitoring tools like Cloudera Manager, Zabbix, Grafana, Splunk, SyslogNG
- Familiarity with middleware applications i.e. Informatica, Denodo and scripting languages like bash, python, or shell scripting for automation
- Experience with cloud technology i.e. AWS, Azure is a plus
- Ability to troubleshoot complex issues ranging from system resource to application stack traces.
- Track record in implementing systems with high availability, high performance, high security hosted at various data centres or hybrid cloud environments will be an added advantage.
- Cloudera Certified Administrator or similar certification are a plus.
- Excellent communication skill to work with cross-functional teams
- Ability to handle high-pressure situations and manage critical incidents
Top Skills
AWS
Azure
Bash
Cloudera Data Platform
Cloudera Manager
Grafana
Hdfs
Hive
Impala
Python
Ranger
Shell Scripting
Spark
Splunk
Syslogng
Yarn
Zabbix
Unison Consulting Singapore Office
1 Changi Business Park Crescent, , Plaza 8 #03-06 Tower A, Singapore, , Singapore, 486025
Unison Consulting Singapore Office
#12-00, 63 Market Street, Bank of Singapore Center, Singapore, , Singapore, 048942
Similar Jobs
Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Design and implement data models, build ETL pipelines, manage data quality and governance, and leverage AI in data engineering.
Top Skills:
AirflowBigQueryGoogle Cloud PlatformMySQLOraclePostgresPythonRSQL
Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
The Senior DevOps Engineer will lead DevOps strategy, manage cloud infrastructure, enhance data tools, and ensure operational stability across teams.
Top Skills:
FlinkGitopsKafkaKubernetesSparkTerraform
Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
The (Senior) Data Platform Engineer will design and build data pipelines, manage data infrastructure, and ensure data quality and consistency across the Growth Data Platform.
Top Skills:
BigQueryDatabricksDbtFlinkHadoopJavaKafkaKotlinPythonScalaSnowflakeSparkSpring BootSQL
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.
