Responsible for managing data workflows and integration pipelines in hybrid IT environments, ensuring data integrity, and optimizing scripts and automation tools.
We are seeking a skilled and proactive Data Integration Engineer to join our remote team. In this role, you will be responsible for creating, optimizing, maintaining, and decommissioning data integrations across a diverse and complex hybrid IT landscape. This includes on-premises systems, SaaS platforms, and cloud environments (primarily AWS). You will play a key role in ensuring accurate, complete, and secure data flows that support both business and security initiatives.
Key Responsibilities:
- Design, build, and manage data workflows and integration pipelines across a hybrid IT environment.
- Ensure data integrity, observability, and resilience across internal systems and third-party platforms.
- Collaborate with internal stakeholders to gather requirements and deliver end-to-end integration solutions that are scalable and future-ready.
- Refactor or replace legacy data workflows to support modernized business processes.
- Identify integration inefficiencies and recommend improvements with long-term technical implications in mind.
- Maintain and develop scripts and automation tools using Python, Bash, PowerShell, and other relevant languages.
- Use DevOps practices to implement CI/CD workflows, maintain source control, and deploy changes reliably.
- Work with cloud services (especially AWS), containers, and both Linux and Windows environments.
- Integrate with and develop solutions for Splunk, including custom Splunk Apps (primarily Python-based).
- Collaborate occasionally with external stakeholders to support partner or cross-company integration efforts.
- Experience in a similar Data Integration, DevOps, or Systems Engineering role.
- Strong experience with Python, Bash, PowerShell, or similar scripting languages.
- Hands-on experience with hybrid IT environments: on-premises, SaaS, and cloud (especially AWS).
- Experience with containers (e.g., Docker), and cloud-based deployment and monitoring practices.
- Proficient in using CI/CD tools and managing code in source control systems (e.g., Git).
- Strong understanding of secure and reliable data pipeline design and observability.
- Familiarity with integrating and maintaining Splunk, including the development of custom apps.
- Ability to gather requirements, communicate tradeoffs, and deliver complete solutions independently.
- Strong communication and collaboration skills, both with internal and external stakeholders.
Preferred Qualifications:
- Experience working with infrastructure as code (e.g., Terraform, CloudFormation).
- Familiarity with additional monitoring or logging tools and data orchestration platforms.
- Prior experience supporting security-related or compliance-driven projects.
Top Skills
AWS
Bash
Ci/Cd
CloudFormation
Docker
Git
Powershell
Python
Splunk
Terraform
Similar Jobs
Artificial Intelligence • Hardware • Information Technology • Security • Software • Cybersecurity • Big Data Analytics
Responsible for designing, developing, and maintaining ETL/ELT pipelines using Databricks and Apache Spark, ensuring data quality and integrity across different sources.
Top Skills:
.Net CoreSparkC#Cosmos DbDatabricksDynamoDBMariadbMongoDBMySQLPowershellPythonSQL Server
Cloud • Information Technology • Security • Software
The Senior Data Engineer will develop data pipelines, curate and model data, and design databases to enable analytics insights across the organization.
Top Skills:
AirflowAWSDbtFivetranGitPythonSnowflakeSQLTableau
Software • Database
As a Data Engineer, you will design, build, and maintain data infrastructure, optimize database performance, and ensure data accessibility for analytics and business insights.
Top Skills:
AirflowAWSAzureDbtDockerGCPKubernetesPostgresPythonSQL
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.