xLSTM
The new efficient architecture for language models.
PAPER (NeurIPS 2024)
PAPER (NeurIPS 2024)
Abstract page for arXiv paper 2405.04517: xLSTM: Extended Long Short-Term Memory
CODE
CODE
Bio-xLSTM (ICLR 2025)
Bio-xLSTM (ICLR 2025)
xLSTM 7B: A Recurrent LLM for Fast and Efficient Inference
xLSTM 7B: A Recurrent LLM for Fast and Efficient Inference
Recent breakthroughs in solving reasoning, math and coding problems with Large Language Models (LLMs) have been enabled by investing substantial computation budgets at inference time. Therefore...
x-LSTM-7B language model CODE
x-LSTM-7B language model CODE
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
NXAI (company)
NXAI (company)
Robotics with xLSTM
Robotics with xLSTM
Abstract page for arXiv paper 2410.22391: A Large Recurrent Action Model: xLSTM enables Fast Inference for Robotics Tasks
Vision-xLSTM: Pre-print
Vision-xLSTM: Pre-print
Transformers are widely used as generic backbones in computer vision, despite initially introduced for natural language processing. Recently, the Long Short-Term Memory (LSTM) has been extended to a scalable and performant architecture - the xLSTM - which overcomes long-standing LSTM limitations via exponential gating and parallelizable matrix memory structure. In this report, we introduce Vision-LSTM (ViL), an adaption of the xLSTM building blocks to computer vision. ViL comprises a stack of xLSTM blocks where odd blocks process the sequence of patch tokens from top to bottom while even blocks go from bottom to top. Experiments show that ViL holds promise to be further deployed as new generic backbone for computer vision architectures.
Jobs: PhD and PostDoc at ELLIS Linz
Jobs: PhD and PostDoc at ELLIS Linz
Careers at NXAI (xLSTM)
Careers at NXAI (xLSTM)
Tiled Flash Linear Attention
Tiled Flash Linear Attention
Abstract page for arXiv paper 2503.14376: Tiled Flash Linear Attention: More Efficient Linear RNN and xLSTM Kernels
View on mobile
Explore other Linktrees
arianagrande
@arianagrande
Sabrina Carpenter
@sabrinacarpenter
Courtney Pachman
@averagefashionblogger
Bits & Bites Blog
@bitsbitesblog
Popcast
@popcast
padmalakshmi
@padmalakshmi
briansetzer
@briansetzer
goodnoticingspod
@goodnoticingspod
Newt
@newton
Kent Rollins
@cowboykentrollins
previous
next
Discover more
See all
@lava.creative_
@PinkyBooToys
@dollparty_byzoe
@KatsuRasu
@motoactual
@balielingspirit
@eunicemowa7
@ash_fromyourfire
@aguacuanamogi
@yasSpillniy
@donotquotemee
@glitterball
@bibliotecadoselfos
@euchinese
@isaambiental
@SianBangIsanHalal
@pabpette
@travelrere15
@NatureSaintJohn
@reclaimnation.co.uk
@luubolsas._
@koicaghana
@Astxary
@morgan.hendry.stewart
@onefamilydental
@Riddimart
@firatarrega
@grungieexx
@locoflower
@cafenegreiros
@seafoxboats
@anya.ostrovskaia
@gerdaunextventures
@briswrldgoesround
@lsmodaboutique.com
@veronica.ra
@Mahume
@sophiastyles1
@soseoon
@kozypopgirl
@HTHSystems
@soujanyacollab
@perfeitastudio
@escolayogamiguelcorreia
@annyacessoriosd
✕