Haystack and Intelligent Search with Milos Rusic

Haystack and Intelligent Search with Milos Rusic

"I think this is how standards are created. Some very early adopters are throwing themselves on a technology the way we did, are working with it, really trying to industrialize it."

Eric Anderson (@ericmander) is joined by Milos Rusic (@rusic_milos) to discuss Haystack, the open-source NLP framework for leveraging Transformer models and building intelligent search systems. Milos and his colleagues at deepset were early contributors to Hugging Face’s Transformer models, and began building pipelines for searching large document stores. Today, Haystack is wildly popular, with an active Discord community and over 6,000 GitHub stars.

Subscribe to Contributor on Substack for email notifications, and join our Slack community!

In this episode we discuss:

  • A deep dive into how Haystack works and its many use cases

  • How a customer demo with one-minute long queries helped inspire Haystack

  • Marketing open-source projects vs word of mouth

  • NLP applications working with structured data and translating between types of data

  • Imagining a world where every person has their own personal ChatGPT


Other episodes:

The origin story behind the best open source projects and communities.