The Platforms and Data Engineer will develop and manage high-performance analytics solutions, design data transformation processes, maintain data systems, and support AI projects.
Ensign is hiring !
Reporting to Head, Platforms and Data Engineering, the Platforms and Data Engineer will work closely with Data Scientists, Threat/Malware Researchers, Project Managers and Infrastructure Engineers to develop and manage high-performance analytics solutions. The incumbent will be accountable for the design, development, deployment and maintenance of AI analytics platforms as well as its data processing workflows.
Key Responsibilities:
- Familiarize with Ensign’s business domain and objectives to develop and deploy data solutions that meet internal business requirements and the needs of partners and customers
- Design, develop, test, deploy operational data transformation processes.
- Design, develop, manage data lake, data warehouse architecture and relational databases.
- Provide monitoring, maintenance and support for data operations as part of maintenance & support as required in client projects.
- Embrace the challenge of dealing with terabytes of data on a daily basis.
- Manage development, staging, production environments to provide overall system functionality, health, scalability, resiliency, and security.
- Responsible for implementing and maintaining complex AI analytics projects, focus on large sets of data to turn information into insights using multiple platforms.
- Deliver detailed documentation and ensure quality throughout project lifecycle.
Qualifications/Requirements:
- Bachelor’s degree in Computer Science /Computer Engineering or equivalent
- Experience in programming (Spark, Python, Go, Bash) for data engineering purposes
- Understanding of modern software engineering tools such as Git, GitLab
- Familiarity with Docker, Kubernetes and cloud services (AWS)
- Familiarity with network concepts.
- Comfort and experience working in Linux environment
- Aptitude for automation and software profiling
- Proven ability to handle multiple customer projects concurrently
- Detail-oriented, solution-focused and problem solver
Preferred Skills (Good to haves):
- Minimum 3 years of experience developing data engineering pipelines
- Knowledge of different data platforms (e.g. Kafka, MongoDB, Postgres,
Elasticsearch), associated tools and cloud-based technologies (e.g. Lambda, Glue). - Have strong knowledge in DevSecOps to design, develop, test, and deploy applications for customer projects.
- Experience in Cyber Security / Telco industry will be an advantage
- Knowledge in Agile and CI/CD is desirable
- Familiarity with virtualization platform (Proxmox, VMware, KVM)
- Familiarity with Hadoop ecosystem and MPP databases
- Ability to demonstrate programming skills and knowledge without being overly dependent on AI.
*Singaporeans only as the candidate may potentially be subjected to clearance depending on projects
Top Skills
AWS
Bash
Docker
Elasticsearch
Git
Gitlab
Glue
Go
Hadoop
Kafka
Kubernetes
Kvm
Lambda
MongoDB
Postgres
Proxmox
Python
Spark
VMware
Ensign InfoSecurity Singapore Office
30A Kallang Place, #08-01, Singapore, Singapore , Singapore, 339213
Similar Jobs
Artificial Intelligence • Fintech • Payments • Financial Services • Generative AI
The role involves designing and maintaining data pipelines, collaborating on data architecture, and integrating external data sources to optimize data operations.
Top Skills:
BigQueryDbtFlinkHadoopJavaKafkaKotlinPythonScalaSnowflakeSparkSpring BootSQL
Artificial Intelligence • Fintech • Payments • Financial Services • Generative AI
As a Staff Data Platform Engineer, you will oversee the architecture and operation of data and AI platforms, influence decision-making, and mentor a high-performing team.
Top Skills:
AirflowBigQueryDatabricksDataflowDataprocDbtGCPGoogle Cloud StorageKafkaKubernetesMcpRagSpark
Artificial Intelligence • Fintech • Payments • Financial Services • Generative AI
As a Senior Data Platform Engineer, you will design and optimize data architectures, develop large-scale distributed systems, and mentor junior engineers while advocating for high-quality software practices.
Top Skills:
BigQueryData LakeDbtFlinkHadoopJavaKafkaKotlinPythonScalaSnowflakeSparkSpring BootSQL
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.