Designs and maintains scalable Microsoft Fabric and OneLake data lakehouse solutions. Builds ingestion and transformation pipelines, integrates structured and semi-structured data, implements medallion architecture, and develops SQL, Python, PySpark, and Spark SQL transformations. Responsibilities include data quality, security, monitoring, performance optimization, documentation, testing, CI/CD deployment, and preparing curated datasets for Power BI and analytics. Collaborates with architects, analysts, and reporting teams to deliver technical data solutions.
About Us
ABeam Consulting is a global professional services company that specializes in delivering business transformation and technology solutions to clients across a wide range of industries. With a global presence and over 9000 employees worldwide we aim to be the transformation partner of choice for all of our clients.
Role OverviewWe are seeking a Microsoft Fabric Data Lake Developer to design, develop, and maintain scalable data solutions using Microsoft Fabric and OneLake. The role involves building data pipelines, implementing lakehouse architectures, and preparing reliable datasets for analytics and reporting.
Key Responsibilities
- Design and develop lakehouse solutions using Microsoft Fabric, OneLake, and Delta tables.
- Build and maintain data ingestion and transformation pipelines using Fabric Data Factory, Dataflows Gen2, and notebooks.
- Integrate data from databases, APIs, enterprise applications, and file-based sources.
- Implement Bronze, Silver, and Gold data layers using a medallion architecture.
- Develop transformations using SQL, Python, PySpark, and Spark SQL.
- Implement incremental loading, change data capture, and data validation processes.
- Monitor pipelines, troubleshoot failures, and optimize performance and resource usage.
- Apply data security, access controls, governance, and data quality standards.
- Prepare curated datasets for Power BI reporting and downstream analytics.
- Collaborate with architects, business analysts, and reporting teams to translate requirements into technical solutions.
- Maintain technical documentation, source-to-target mappings, and operational support procedures.
- Support version control, testing, and deployment across development, test, and production environments.
- Hands-on experience with Microsoft Fabric, including Lakehouse, OneLake, Data Factory pipelines, and notebooks.
- Strong SQL skills and practical experience with Python or PySpark.
- Experience developing ETL/ELT pipelines and working with structured and semi-structured data.
- Understanding of Delta Lake, Parquet, dimensional modelling, and medallion architecture.
- Experience implementing data quality checks, error handling, logging, and monitoring.
- Knowledge of data security, workspace permissions, and access management.
- Familiarity with Git and CI/CD practices for data solutions.
- Strong analytical, troubleshooting, and communication skills.
- Experience with Azure Data Factory, Azure Data Lake Storage, Azure Databricks, or Azure Synapse Analytics.
- Experience integrating SAP, Dynamics 365, Salesforce, or other enterprise systems.
- Familiarity with Power BI semantic models and Direct Lake.
- Knowledge of Microsoft Purview and data governance practices.
Why Join Us
At ABeam Consulting, we place a strong emphasis on collaboration, and helping our employees grow and develop their skills, offering a supportive and empowering work environment. With a presence in multiple countries and a diverse range of clients, ABeam Consulting offers an exciting and dynamic workplace for individuals looking to build a career in consulting. ABeam Consulting has also recently joined SAP’s regional strategic partner initiative as their first regional partner in the region and has also been recognized by UiPath as a Diamond Partner in providing RPA solutions. With such accolades, we aim to continue driving enterprise and digital transformation initiatives in order to transform the way people work and communicate in the digital age. In addition, our industry team is working tirelessly in order to bring more solutions to the banking and finance sector.
ABeam Consulting Southeast Asia (SEA) Singapore, Singapore, SGP Office
Singapore, Singapore
Similar Jobs
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Leads private equity and debt fund accounting operations, including capital activity processing, NAV preparation, fee and carried interest calculations, waterfall allocations, investor reporting, and financial reporting. Supervises team members, manages operational controls, supports client interactions, resolves issues, coordinates with global stakeholders, and ensures accurate books, schedules, and deliverables across complex fund structures and instruments.
Top Skills:
Excel
Information Technology • Software • Financial Services • Big Data Analytics
As a PhD Intern, you will develop mathematical models, conduct statistical analysis, and implement trading strategies while collaborating with senior researchers.
Top Skills:
C++PythonR
Information Technology • Software • Financial Services • Big Data Analytics
Conduct quantitative investment research by building predictive models, applying statistical and mathematical techniques, optimizing multi-asset portfolios, and developing optimization algorithms. Analyze financial markets, price formation, and risk using large-scale data and coding in C++ or Python. Collaborate with researchers, engineers, and traders to develop scalable systems and identify investment opportunities.
Top Skills:
C++Python
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.
