NLSOM
Visit WebsiteScience
Open Source
Facilitates collaboration among diverse neural networks through natural language communication.
About
NLSOM (Natural Language-Based Societies of Mind) is a framework inspired by Marvin Minsky's 'Society of Mind' and Jürgen Schmidhuber's 'Learning to Think.' It enables diverse societies of large multimodal neural networks to solve problems by interacting through natural language interfaces. This approach overcomes the limitations of single large language models by allowing new agents to be added modularly, all communicating through a universal symbolic language. NLSOM has been applied to tasks such as visual question answering, image captioning, text-to-image synthesis, 3D generation, egocentric retrieval, embodied AI, and general language-based task solving.
Features
- Integration of multiple neural networks for collaborative problem-solving.
- Natural language communication interface between agents.
- Modular addition of new agents.
- Application to various AI tasks including visual question answering and image captioning.
Tags
Neural Networks
Collaboration
Framework