Meet Bamba, IBM’s new attention-state space model
research.ibm.com
The open-source LLM combines the sequence-modeling skill of a transformer with the inferencing speed of an SSM. IBM Granite will soon adopt key Bamba features.