Design and integrate vision encoders and audio-native models into agent reasoning loops, optimize streaming latency for voice-to-voice AI interactions, and architect multimodal RAG systems to retrieve insights from videos and PDFs. Implement cross-modal alignment and leverage Whisper, CLIP, and multimodal LLMs with streaming/WebRTC architectures.
We are seeking a talented Multimodal AI Systems Architect to develop and optimize AI systems that seamlessly integrate vision and audio models. This role focuses on enhancing our voice-to-voice interactions and multimodal retrieval capabilities, ensuring our systems are efficient and innovative.
Responsibilities:
- Integrate vision encoders and audio-native models into core agent reasoning loops.
- Optimize streaming latency for voice-to-voice AI interactions.
- Architect multimodal RAG systems capable of retrieving insights from videos and PDFs.
Qualifications:
- Experience with Whisper, CLIP, and multimodal LLM integration.
- Knowledge of streaming architectures and WebRTC.
- Expertise in cross-modal alignment.
Similar Jobs
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Lead the design and validation of SSD firmware test architecture, automation platforms, and CI/CD pipeline while resolving critical issues for enterprise products.
Top Skills:
CFioLinuxNvmeNvme-CliPciePynvmePythonSataShell
.jpeg)
2 Hours Ago
Artificial Intelligence • Hardware • Information Technology • Machine Learning
The DMTS in Process Development leads innovations in NAND thin film processes, mentors senior leaders, and shapes technical strategies across disciplines.
Top Skills:
AldAtom Probe TomographyCarbon-Based FilmsCvdDielectric FilmsEelsHighk FilmsLowk FilmsMl-Assisted Image AnalysisSimsTemXps
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Lead the design and validation of SSD firmware test architecture for enterprise and automotive products. Oversee automation platforms, troubleshoot critical issues, and implement validation strategies.
Top Skills:
CFioLinuxNvmeNvme-CliPciePynvmePythonSataShell
What you need to know about the Singapore Tech Scene
The digital revolution has driven a constant demand for tech professionals across industries like software development, data analytics and cybersecurity. In Singapore, one of the largest cities in Southeast Asia, the demand for tech talent is so high that the government continues to invest millions into programs designed to develop a talent pipeline directly from universities while also scaling efforts in pre-employment training and mid-career upskilling to expand and elevate its workforce.
