Hyphen Connect Limited
LLM Pre-training & Distributed Engineer (AI Infrastructure)
Be an Early Applicant
Design, run, and optimize large-scale LLM pre-training on 1,000+ GPUs. Manage distributed training with PyTorch/DeepSpeed/Megatron-LM, optimize networking and memory, and automate checkpointing and failure recovery for long runs.
We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The ideal candidate will have a deep understanding of GPU clusters and extensive experience in system engineering to ensure efficient and reliable training processes.
Responsibilities:
- Orchestrate distributed training runs across 1,000+ GPUs using PyTorch, DeepSpeed, or Megatron-LM.
- Optimize networking (InfiniBand/RDMA) and memory management to prevent out-of-memory errors.
- Automate checkpointing and failure recovery during month-long training runs.
Required Skills:
- Deep expertise in 3D parallelism (Data, Tensor, Pipeline).
- Experience managing SLURM or Kubernetes-based GPU clusters.
- Strong systems engineering background (C++, CUDA, Python).
Similar Jobs
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Leads complex digital engagements from opportunity qualification through solution definition, mobilization, and delivery handover. Shapes client solutions, evaluates technical feasibility, develops proposals and statements of work, manages deployment readiness, and advises senior stakeholders. Oversees regional portfolios, governance, risks, capacity, financials, and partner performance while improving consulting processes and reusable delivery assets. Requires strong technical consulting, commercial, stakeholder management, and cross-functional leadership skills, preferably within payments or regulated technology.
Top Skills:
AgileAPIsAuthenticationCloud ComputingCybersecurityDigital IdentityDigital PlatformsDigital WalletsIntegration PatternsOpen BankingReal-Time PaymentsTokenization
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Manages technical and operational relationships with acquiring and processing customers across onboarding, implementation, integration, launch, and ongoing operations. Provides technical consultancy, coordinates internal specialists, oversees customer technology projects, resolves complex issues, and supports escalations. Partners with commercial account managers and cross-functional teams while translating business needs into technical actions and maintaining trusted customer relationships.
Top Skills:
AuthorizationCard Payment ProcessingClearingContactless PaymentsE-Commerce PaymentsEmvPayment GatewaysSettlement
Fintech • Payments • Financial Services
Build and scale AI-powered People Operations solutions across onboarding, transfers, offboarding, employee support, and HR systems. Identify workflow friction, develop automation and internal tools using AI coding assistants, low-code platforms, scripting, APIs, and webhooks, and improve self-service capabilities. Translate operational needs into technical requirements, maintain HR knowledge systems, measure efficiency gains, ensure data privacy and AI fairness, and enable the People team through documentation and training.
Top Skills:
Agentic WorkflowsAi Coding AssistantsArtificial IntelligenceDocusignFactory AiGenerative AiGoogle Apps ScriptGreenhouseLow-Code/No-Code PlatformsN8NPrompt EngineeringRest ApisSlackWebhooksWorkdayZapier
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.
