The Associate Principal Engineer, Big Data Engineer will design and implement data solutions using Databricks and Azure services, mentor team members, and ensure coding quality. Key responsibilities include architecture reviews, technical designs, and addressing complex data engineering challenges, while collaborating effectively with clients and developers.
Company Description
👋🏼We're Nagarro.
We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (18000+ experts across 38 countries, to be exact). Our work culture is dynamic and non-hierarchical. We're looking for great new colleagues. That's where you come in!
Job Description
REQUIREMENTS:
- Total experience 11+ years.
- Excellent knowledge and experience in Big data engineer.
- Expertise in Databricks, Azure Synapse, Azure Data Factory, and PySpark.
- Strong working experience with architecture and development in Azure cloud services such as ADF, ADLS, Azure SQL, Logic Apps, and Azure Functions.
- Strong hands-on experience in Databricks and related architecture like Medallion.
- Experience in implementing and delivering data solutions and pipelines on Databricks.
- A strong understanding of data modeling, data structures, data warehouses, databases, and ETL processes.
- An in-depth understanding of large-scale data sets, including structured and unstructured data.
- Hands on experience in SQL.
- Should have a basic understanding of CI/CD and DevOps.
- Good to have GenAI experience
- Experience with building and maintaining a cloud system.
- Familiarity with data modeling, data warehousing, and building distributed systems.
- Expertise in Spanner for high-availability, scalable database solutions.
- Knowledge of data governance and security practices in cloud-based environments.
- Problem-solving mindset with the ability to tackle complex data engineering challenges.
- Strong communication and teamwork skills, with the ability to mentor and collaborate effectively.
RESPONSIBILITIES:
- Writing and reviewing great quality code.
- Understanding the client’s business use cases and technical requirements and be able to convert them in to technical design which elegantly meets the requirements.
- Mapping decisions with requirements and be able to translate the same to developers.
- Identifying different solutions and being able to narrow down the best option that meets the client’s requirements.
- Defining guidelines and benchmarks for NFR considerations during project implementation.
- Writing and reviewing design document explaining overall architecture, framework, and high-level design of the application for the developers.
- Reviewing architecture and design on various aspects like extensibility, scalability, security, design patterns, user experience, NFRs, etc., and ensure that all relevant best practices are followed.
- Developing and designing the overall solution for defined functional and non-functional requirements; and defining technologies, patterns, and frameworks to materialize it.
- Understanding and relating technology integration scenarios and applying these learnings in projects.
- Resolving issues that are raised during code/review, through exhaustive systematic analysis of the root cause, and being able to justify the decision taken.
- Carrying out POCs to make sure that suggested design/technologies meet the requirements.
Qualifications
Bachelor’s or master’s degree in computer science, Information Technology, or a related field.
Top Skills
Azure Cloud Services
Azure Data Factory
Azure Synapse
Big Data
Ci/Cd
Databricks
DevOps
Genai
Pyspark
Spanner
SQL
Nagarro Singapore Office
German Center, 25 International Business Park #04-113, Singapore, , Singapore, 609916
Similar Jobs
Artificial Intelligence • Information Technology • Machine Learning • Software • Virtual Reality • Analytics
The Associate Principal Engineer, Big Data will be responsible for designing and implementing complex data pipelines, ETL processes, and data integrations. This role requires strong expertise in Snowflake, SQL Server, and Python, as well as experience working with major cloud providers, specifically AWS. Excellent problem-solving and communication skills are also essential.
Artificial Intelligence • Information Technology • Machine Learning • Software • Virtual Reality • Analytics
The Associate Principal Engineer, Big Data will design and implement self-service data architectures, enabling business users to access and analyze data independently while ensuring quality, governance, and security. Responsibilities include data architecture design, tool selection, governance standards establishment, data modeling, and user training.
Artificial Intelligence • Fintech • Machine Learning • Social Impact • Software
As a Senior Data Platform Engineer at Upstart, you'll expand developer tools for data validation and quality checks, build frameworks for data lineage and governance, and improve data infrastructure's uptime and observability. Collaborating with various teams, you'll ensure architecture alignment with business goals and mentor junior members while enhancing platform performance and security.
Top Skills:
AirflowAWSDatabricksDbtDockerKafkaKubernetesPostgresPythonSparkSQL
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.
