Develop and maintain scalable data pipelines using Python and AWS services, enhance data accessibility, collaborate with teams for business intelligence, and contribute to best practices.
JOB DESCRIPTION
- Develop, maintain scalable data pipelines and builds out new integrations to support continuing increases in data volume and complexity. Develop and maintain scalable, optimized data pipelines leveraging Python and AWS services to support increasing data volume and complexity, while ensuring seamless integration with AI platforms like Bedrock and Google. Further enhance data accessibility and drive data-driven decision making by collaborating with analytics and business teams to refine data models for business intelligence tools. Strong exposure to work with AI Services like Bedrock, Google (Gemini), and OpenAI Models etc.
Develop, maintain, and optimize scalable data pipelines using Python and AWS services (e.g., S3, Lambda, ECS, RDS, SNS/SQS, Vector DB).
Develop unit and integration tests and contribute to engineering documentation.
Collaborate with analytics and business teams to improve data models for business intelligence.
Work closely with frontend and backend engineers, product managers, and analysts to ensure successful project delivery.
Participate in code reviews and contribute to the improvement of data engineering best practices.
BUSINESS SEGMENTCorporatePLATFORMOperating DivisionTop Skills
Aws Services
Ecs
Lambda
Python
Rds
S3
Sns/Sqs
Vector Db
Keppel Singapore Office
1 HarbourFront Avenue, Level 2, Keppel Bay Tower, Singapore, 098632
Similar Jobs
Artificial Intelligence • Fintech • Payments • Financial Services • Generative AI
As a Senior Data Platform Engineer, you will design and optimize data architectures, develop large-scale distributed systems, and mentor junior engineers while advocating for high-quality software practices.
Top Skills:
BigQueryData LakeDbtFlinkHadoopJavaKafkaKotlinPythonScalaSnowflakeSparkSpring BootSQL
Financial Services
The Senior Staff Engineer will integrate AI models across various business domains, ensuring system efficiency and high availability while improving best practices in the AI infrastructure.
Top Skills:
Ai ModelsApi DevelopmentJavaKafkaLangchainMicroservicesPythonSpring BootSpringcloud
Cloud • Hardware • Information Technology • Internet of Things • Software • Business Intelligence
Leading the architectural design for Dell's AI platform, mentoring engineers, driving technical execution of projects, and evaluating new technologies.
Top Skills:
AICloud-Native TechnologiesKubernetesMlOpenshift
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.
