The role focuses on designing and optimizing post-training algorithms for multimodal models, improving training pipelines, resolving technical challenges, and facilitating teamwork between algorithm and engineering teams.
Business UnitTechnology Engineering Group (TEG) is responsible for supporting the company and its business groups on technology and operational platforms, as well as the construction and operation of R&D management and data centers, TEG provides users with a full range of customer services. As the operator of the largest networking, devices, and data center in Asia,TEG also leads the Tencent Technology Committee in strengthening infrastructure R&D through internal and distributed open source collaboration, constructing new platforms and supporting business innovation.What the Role EntailsWho We Look ForEqual Employment Opportunity at Tencent
- Algorithm-Framework Co-design: Act as a technical bridge between the algorithm and framework teams. Deeply understand the principles and evolution trends of post-training algorithms for multimodal large models (e.g., RLHF, DPO, Curriculum Reinforcement Learning) and translate these into functional requirements for the underlying frameworks, providing insights for framework architecture design
- Training Pipeline Optimization and Evaluation: Lead or deeply participate in the setup, optimization, and effectiveness evaluation of post-training pipelines (e.g., multimodal SFT, RLHF). Focus on training stability, efficiency, and generalization capability, particularly proposing systematic improvements for areas like cross-modal alignment, reward function design, and policy optimization
- Technical Research and Bottleneck Resolution: Proactively track cutting-edge advancements in multimodal reinforcement learning post-training from academia and industry. Perform root cause analysis for training bottlenecks (e.g., insufficient OOD generalization, modality fusion conflicts) and collaborate with the framework team to develop and implement solutions
- Cross-team Support and Knowledge Sharing: Collaborate efficiently with framework development, hardware optimization, and business algorithm teams to ensure the implementation of technical solutions. Produce high-quality technical documentation, design drafts, and experimental reports. Organize internal sharing sessions to enhance the overall technical expertise of the team
- Education and Technical Background: A Master's degree or higher in Computer Science, Artificial Intelligence, Electronic Engineering, Automation, or related fields. A solid foundation in machine learning/deep learning, with a deep understanding of multimodal large models and the reinforcement learning post-training technology stack
Core Algorithm and Engineering Skills: - Proficiency in Python programming and familiarity with deep learning frameworks like PyTorch.
- Deep understanding of model architectures such as Transformer and Diffusion
- Thorough comprehension of the principles, processes, and common challenges (e.g., training instability, reward hacking) of post-training algorithms like SFT, RLHF, and DPO
- Strong engineering implementation and debugging skills, capable of rapidly validating algorithmic ideas and conducting rigorous experimental analysis for performance evaluation
Framework Collaboration and System Perspective: - Familiarity with at least one mainstream large model training/inference framework (e.g., Megatron-LM, DeepSpeed, VLLM) and an understanding of their architectural design principles
- Ability to assess framework usability, scalability, and performance from an algorithmic perspective and propose improvement suggestions. Experience with post-training frameworks like VERL or OpenRLHF is a plus
- Soft Skills: Excellent cross-team communication skills, able to clearly translate requirements and articulate solutions between algorithm and engineering teams. A strong sense of responsibility, self-motivation, and passion for solving complex problems
As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.
Top Skills
Deepspeed
Megatron-Lm
Python
PyTorch
Vllm
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The Marketing Senior Manager for SENA will lead marketing initiatives, manage multi-channel campaigns, oversee budgets, and collaborate with sales teams. The role involves data analysis, event planning, and generating insights to support business growth.
Top Skills:
Crm PlatformsMarketing Automation
Information Technology • Software • Financial Services
Conduct research, statistical analyses, develop trading strategies, and improve mathematical models using large data sets for market predictions.
Top Skills:
C++MatlabPythonR
Information Technology • Software • Financial Services
FPGA Engineers at Citadel Securities design and implement FPGA solutions to enhance trading system performance in ultra-low latency environments.
Top Skills:
BashCFpgaPythonSystem VerilogTclVhdl
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.
