The Platforms and Data Engineer will develop and manage high-performance analytics solutions, design data transformation processes, maintain data systems, and support AI projects.
Ensign is hiring !
Reporting to Head, Platforms and Data Engineering, the Platforms and Data Engineer will work closely with Data Scientists, Threat/Malware Researchers, Project Managers and Infrastructure Engineers to develop and manage high-performance analytics solutions. The incumbent will be accountable for the design, development, deployment and maintenance of AI analytics platforms as well as its data processing workflows.
Key Responsibilities:
- Familiarize with Ensign’s business domain and objectives to develop and deploy data solutions that meet internal business requirements and the needs of partners and customers
- Design, develop, test, deploy operational data transformation processes.
- Design, develop, manage data lake, data warehouse architecture and relational databases.
- Provide monitoring, maintenance and support for data operations as part of maintenance & support as required in client projects.
- Embrace the challenge of dealing with terabytes of data on a daily basis.
- Manage development, staging, production environments to provide overall system functionality, health, scalability, resiliency, and security.
- Responsible for implementing and maintaining complex AI analytics projects, focus on large sets of data to turn information into insights using multiple platforms.
- Deliver detailed documentation and ensure quality throughout project lifecycle.
Qualifications/Requirements:
- Bachelor’s degree in Computer Science /Computer Engineering or equivalent
- Experience in programming (Spark, Python, Go, Bash) for data engineering purposes
- Understanding of modern software engineering tools such as Git, GitLab
- Familiarity with Docker, Kubernetes and cloud services (AWS)
- Familiarity with network concepts.
- Comfort and experience working in Linux environment
- Aptitude for automation and software profiling
- Proven ability to handle multiple customer projects concurrently
- Detail-oriented, solution-focused and problem solver
Preferred Skills (Good to haves):
- Minimum 3 years of experience developing data engineering pipelines
- Knowledge of different data platforms (e.g. Kafka, MongoDB, Postgres,
Elasticsearch), associated tools and cloud-based technologies (e.g. Lambda, Glue). - Have strong knowledge in DevSecOps to design, develop, test, and deploy applications for customer projects.
- Experience in Cyber Security / Telco industry will be an advantage
- Knowledge in Agile and CI/CD is desirable
- Familiarity with virtualization platform (Proxmox, VMware, KVM)
- Familiarity with Hadoop ecosystem and MPP databases
- Ability to demonstrate programming skills and knowledge without being overly dependent on AI.
*Singaporeans only as the candidate may potentially be subjected to clearance depending on projects
Ensign InfoSecurity Singapore, Singapore, SGP Office
Singapore, Singapore
Similar Jobs
Fintech • Information Technology • Software • Financial Services
Design, build and operate enterprise-scale data and analytics platforms on GCP. Lead architecture, reliability and incident response for BigQuery/Dataproc/Spark workloads, implement IaC and CI/CD, drive SRE/observability, optimize performance and cost, mentor engineers and enforce security and operational best practices.
Top Skills:
AvroBigQueryCi/CdCloud StorageDataprocDevsecopsDockerGoogle Cloud Platform (Gcp)Infrastructure As CodeKubernetesObservabilityParquetSparkTerraform
Information Technology • Internet of Things • Software
Lead architecture, design, and development of a scalable ML and generative AI data platform. Build infrastructure to process structured and video telematics data, support model training and LLM access, implement logging/monitoring, integrate with cloud and Big Data systems, document architectures, support integrations, and mentor engineers.
Top Skills:
Apache FlinkAWSAzureBedrockCrewaiDockerGCPGoogle BigqueryKubernetesLanggraphLitellmOpenshiftPython 3RayVertex Ai
Financial Services
Operate, maintain, and optimize hybrid cloud Data and AI platforms (Cloudera CDP/CML, Hadoop, Spark) across AWS and on-prem. Perform platform upgrades, security patching, container/Kubernetes/OpenShift administration, monitoring, troubleshooting, and automation using Shell/Python. Collaborate with Infrastructure, Security, SRE, and Data/ML teams to ensure availability and scalability of AI/ML and Generative AI services (SageMaker, EMR, Bedrock).
Top Skills:
AnsibleApache IcebergSparkArgocdAthenaAWSBedrockC++Cloudera Data Platform (Cdp)Cloudera Machine Learning (Cml)CloudFormationCloudwatchContainersEc2EksEmrGitGithub ActionsGitlab Ci/CdGlueGpuHdfsHiveIamImpalaJavaJenkinsKubernetesLinux/UnixOpensearchOpenshiftOzonePythonS3SagemakerShellTerraformVector DatabasesVpcYarn
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.
