The Senior Staff Engineer, Big Data Engineer will develop and implement data solutions using Azure services and Databricks, focusing on architecture, coding, and mentoring junior staff. Responsibilities include designing data pipelines, ensuring code quality, and addressing client requirements effectively.
Company Description
👋🏼We're Nagarro.
We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (18000+ experts across 38 countries, to be exact). Our work culture is dynamic and non-hierarchical. We're looking for great new colleagues. That's where you come in!
Job Description
REQUIREMENTS:
- Total experience 10+ years.
- Excellent knowledge and experience in Big data engineer.
- Expertise in Databricks and Python.
- Strong working experience with architecture and development in Azure cloud services such as ADF, ADLS, Azure SQL, Logic Apps, and Azure Functions.
- Strong hands-on experience in Databricks and related architecture like Medallion.
- Experience in implementing and delivering data solutions and pipelines on Databricks.
- A strong understanding of data modeling, data structures, data warehouses, databases, and ETL processes.
- Expert in software development activities like code maintainability, deployment, unit testing, etc.
- An in-depth understanding of large-scale data sets, including structured and unstructured data.
- Hands on experience in SQL.
- Should have a basic understanding of CI/CD and DevOps.
- Experience with building and maintaining a cloud system.
- Familiarity with data modeling, data warehousing, and building distributed systems.
- Expertise in Spanner for high-availability, scalable database solutions.
- Knowledge of data governance and security practices in cloud-based environments.
- Problem-solving mindset with the ability to tackle complex data engineering challenges.
- Strong communication and teamwork skills, with the ability to mentor and collaborate effectively.
RESPONSIBILITIES:
- Writing and reviewing great quality code.
- Understanding the client’s business use cases and technical requirements and be able to convert them in to technical design which elegantly meets the requirements.
- Mapping decisions with requirements and be able to translate the same to developers.
- Identifying different solutions and being able to narrow down the best option that meets the client’s requirements.
- Defining guidelines and benchmarks for NFR considerations during project implementation.
- Writing and reviewing design document explaining overall architecture, framework, and high-level design of the application for the developers.
- Reviewing architecture and design on various aspects like extensibility, scalability, security, design patterns, user experience, NFRs, etc., and ensure that all relevant best practices are followed.
- Developing and designing the overall solution for defined functional and non-functional requirements; and defining technologies, patterns, and frameworks to materialize it.
- Understanding and relating technology integration scenarios and applying these learnings in projects.
- Resolving issues that are raised during code/review, through exhaustive systematic analysis of the root cause, and being able to justify the decision taken.
- Carrying out POCs to make sure that suggested design/technologies meet the requirements.
Qualifications
Bachelor’s or master’s degree in computer science, Information Technology, or a related field.
Top Skills
Adf
Adls
Azure
Azure Functions
Azure Sql
Big Data
Ci/Cd
Databricks
DevOps
Logic Apps
Python
Spanner
SQL
Nagarro Singapore Office
German Center, 25 International Business Park #04-113, Singapore, , Singapore, 609916
Similar Jobs
Artificial Intelligence • Information Technology • Machine Learning • Software • Virtual Reality • Analytics
This position requires leveraging not only technical expertise but also leadership and problem-solving skills to guide teams and enhance client solutions. The role involves working collaboratively to tackle challenges and innovate beyond standard solutions.
Artificial Intelligence • Fintech • Machine Learning • Social Impact • Software
As a Senior Data Platform Engineer at Upstart, you'll expand developer tools for data validation and quality checks, build frameworks for data lineage and governance, and improve data infrastructure's uptime and observability. Collaborating with various teams, you'll ensure architecture alignment with business goals and mentor junior members while enhancing platform performance and security.
Top Skills:
AirflowAWSDatabricksDbtDockerKafkaKubernetesPostgresPythonSparkSQL
Artificial Intelligence • Information Technology • Machine Learning • Software • Virtual Reality • Analytics
As a Staff Engineer in Big Data, you will leverage your extensive tech knowledge to lead teams, solve complex problems, and drive innovative solutions for our clients.
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.
