Hyphen Connect Limited
LLM Pre-training & Distributed Engineer (AI Infrastructure)
Be an Early Applicant
Design, run, and optimize large-scale LLM pre-training on 1,000+ GPUs. Manage distributed training with PyTorch/DeepSpeed/Megatron-LM, optimize networking and memory, and automate checkpointing and failure recovery for long runs.
We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The ideal candidate will have a deep understanding of GPU clusters and extensive experience in system engineering to ensure efficient and reliable training processes.
Responsibilities:
- Orchestrate distributed training runs across 1,000+ GPUs using PyTorch, DeepSpeed, or Megatron-LM.
- Optimize networking (InfiniBand/RDMA) and memory management to prevent out-of-memory errors.
- Automate checkpointing and failure recovery during month-long training runs.
Required Skills:
- Deep expertise in 3D parallelism (Data, Tensor, Pipeline).
- Experience managing SLURM or Kubernetes-based GPU clusters.
- Strong systems engineering background (C++, CUDA, Python).
Similar Jobs
Fintech • Mobile • Payments • Software • Financial Services
Build and maintain high-performance Android features for Wise's Spend product, collaborating with backend, frontend, and product teams. Implement key card flows (ordering, transactions, 3DS, disputes), drive technical planning and product direction, write clean maintainable code, and advocate mobile best practices across a distributed team.
Top Skills:
AndroidJetpack Compose
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Senior customer-facing AI leader who defines AI strategy, architects end-to-end LLM and RAG-based solutions, leads technical discovery and proof-of-value, drives enterprise AI adoption and governance, influences product roadmaps, and ensures successful production deployment and measurable business value across cloud-native and telecom environments.
Top Skills:
Agentic AiAi AgentsAi Orchestration PlatformsAPIsAutomation PlatformsCloudCloud-NativeData PlatformsGenerative AiKnowledge GraphsKubernetesLlmsMcp FrameworksMicroservicesModern Data EcosystemsRagVector Databases
Productivity • Software • App development • Automation
Lead customer-facing engagements to identify and remediate open-source license compliance issues (especially AGPLv3). Advise engineering, legal, and sales teams on technical findings, licensing implications, and commercial resolution strategies while maintaining engagement records in Salesforce.
Top Skills:
Agplv3ApryseGplItextPdfSalesforceSdk
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.
