The Role

We’re building a world of multi-modal AIs that you can interact with as easily and naturally as the people you talk to every day - via fluid, engaging voice conversations. We envision a future where you engage with technology just by saying what you want to a truly knowledgeable agent - not struggling with limited user interfaces or underwhelmed by the capabilities of today’s AI assistants (e.g., Siri).

With this vision in mind, we’re building AI models that have the reasoning capabilities of today’s text-based LLMs, but can also consume and output voice and video data in real time. Unlike today’s LLMs, these models will have the ability to understand the considerable nuance present in human speech and absent in plain text, and this will also allow them to respond to the user more quickly and fluently.

We have a v1 version of the system up and running in our prototype app, hisanta.ai, and we’ve seen excellent engagement since launch. While the v1 builds around a text-based LLM, we’re actively working toward the speech-to-speech vision for v2.

We’re looking for a stellar AI expert with experience in LLMs and multimodal models (and available for in-person collaboration in Seattle) to help us build this future.

What you’ll do

• Lead the design and implementation of our multi-modal models.
• Guide our use of LLMs and relationships with model providers.
• Build a world-class team for solving the key problems around modeling human conversations and voice/vision.
• Develop methods to improve efficiency, correctness, and quality of models.
• Build tools to measure model quality and performance.

Things we’re looking for

• An incredibly strong AI expert with a track record of contributions to AI products and systems.
• Experience with building teams and directing the work of other researchers and engineers.
• Experience with Large Language Models or other generative AI models.
• Experience with speech or vision models.
• Strong experience in Python and, ideally, PyTorch.
• Ability to roll up your sleeves and get things done.
• A great communicator and team player.

Benefits