Unison Consulting Logo

Unison Consulting

Data Engineer(Hadoop, Spark, Scala)

Sorry, this job was removed at 08:09 a.m. (SGT) on Tuesday, Jan 21, 2025
Be an Early Applicant
In-Office
Singapore, SGP
In-Office
Singapore, SGP

Similar Jobs

19 Minutes Ago
Easy Apply
Hybrid
Singapore, SGP
Easy Apply
Senior level
Senior level
Big Data • Cloud • Software • Database
Lead pre-sales architecture and technical engagements for MongoDB, advising customers on scalable distributed systems, driving demos, proofs-of-value, and account strategies while collaborating with sales to win deals and ensure customer success.
Top Skills: Apache KafkaAtlasAtlas Data LakeAtlas Full-Text SearchAtlas Stream ProcessingAtlas Vector SearchAWSCC#C++ChartsGCPJavaKubernetesAzureMongoDBNode.jsPythonRelational MigratorSQL
2 Hours Ago
In-Office
Singapore, SGP
Mid level
Mid level
Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Design, implement, and maintain native iOS applications and libraries. Own full-cycle product development, collaborate with product and finance stakeholders, refactor for maintainability, integrate secure data and compliance practices, and support CI/CD and testing pipelines.
Top Skills: AndroidCi/CdiOSRestful ApisSwift
2 Hours Ago
In-Office
Singapore, SGP
Mid level
Mid level
Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Build and architect frontend systems using React and TypeScript, implement micro-frontend SPAs, develop BFFs with Node/Apollo GraphQL, create design systems and shared components, deliver NPM packages, deploy on cloud/Kubernetes with CI/CD, and ensure high test coverage and quality across financial web products.
Top Skills: Alibaba Cloud (Aliyun)Ant DesignApollo GraphqlBootstrapCloudflareContentfulCSS3CypressEmotionGCPGitlab Ci/CdGraphQLHTML5Javascript (Es6+)Kubernetes (K8S)Material UiMicro FrontendsNext.JsNode.jsNpmPolyfillReactReact Testing LibraryReact-Test-RendererRestful ApisRollup.JsScssSingle Page Application (Spa)Styled-ComponentsTypescriptWebpack

Description
  • Design, develop, and maintain scalable data pipelines and ETL processes using Hadoop and Spark.
  • Write efficient and optimized data processing jobs in Scala to transform and load data.
  • Utilize SQL for querying and manipulating data across various databases.
  • Collaborate with data scientists and analysts to gather requirements and deliver data solutions that meet business needs.
  • Monitor and troubleshoot data processing workflows to ensure high performance and reliability.
  • Implement best practices for data quality, governance, and security.
  • Document data engineering processes, workflows, and architecture for team knowledge sharing.
  • Stay updated on industry trends and emerging technologies to continuously improve our data strategies.


Requirements
  • Bachelor’s degree in Computer Science, Engineering, or a related field.
  • 3+ years of experience as a Data Engineer or in a similar role.
  • Strong proficiency in Hadoop ecosystem components (e.g., HDFS, Hive, Pig).
  • Hands-on experience with Apache Spark for big data processing.
  • Proficient in Scala programming for data transformation tasks.
  • Advanced SQL skills for querying and managing large datasets.
  • Experience with data modeling, data warehousing, and ETL processes.
  • Familiarity with cloud platforms (AWS, GCP, or Azure) is a plus.
  • Strong analytical and problem-solving skills.

Unison Consulting Singapore Office

1 Changi Business Park Crescent, , Plaza 8 #03-06 Tower A, Singapore, , Singapore, 486025

Unison Consulting Singapore Office

#12-00, 63 Market Street, Bank of Singapore Center, Singapore, , Singapore, 048942

What you need to know about the Singapore Tech Scene

The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account