- Build and optimizing ‘big data’ data pipelines, architectures and data sets.
- Performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- To support and develop Data modeling, Implementation activities.
- Strong analytic skills related to working with unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- Manipulating, processing and extracting value from large disconnected datasets.
- Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
- Perform CI/CD Activities, Deployment activities in both cloud and on premises or as required.
- Experience with Data engineering tools (Python, Scala, Hadoop).
- Experience with relational (oracle, MySQL, MS Sql) or NoSQL databases, including Postgres and Cassandra.
- Experience with data pipeline and workflow management tools.
- Experience with stream-processing systems
- Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala,etc
- Experience on Cloudera/ Data bricks/ Snowflakes platforms will be added advantage
- Experience with Cloud (Aws, Azure or Google).
Unison Consulting Singapore Office
1 Changi Business Park Crescent, , Plaza 8 #03-06 Tower A, Singapore, , Singapore, 486025
Unison Consulting Singapore Office
#12-00, 63 Market Street, Bank of Singapore Center, Singapore, , Singapore, 048942
Similar Jobs
Gaming • Software • Metaverse
Responsible for maintaining the raw data pipeline for Tencent's overseas games, optimizing data processes and collaborating with teams for analytics.
Top Skills:
FlinkGoHadoopJavaKafkaMapreducePrestoPythonScalaSparkSQL
Retail
As a Data Engineer, you will collect, design, store, and process data while ensuring data integrity and building metrics for eCommerce business.
Top Skills:
HadoopHivePythonSparkSQL
Information Technology • Consulting
The Data Engineer will design and implement data platforms, manage data pipelines, ensure data quality, and mentor junior engineers, focusing on efficient data workflows and governance.
Top Skills:
AirflowAmundsenAWSBeamBigQueryBigtableDatabricksDataplexDbtDynamoDBFlinkGlue CatalogJavaKafkaMongoDBMySQLPostgresPower BIPubsubPythonQuicksightRedshiftScalaSnowflakeSparkSQLSupersetTableau
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.
