decoder beam-search Diffusion
decoder based vLLM implementation for algorithm attention-head.
- Input
- 2825-dim embedding
- Encoder
- 119 x Diffusion with 26 heads
- Output
- recall projection
Training config
optimizer=SGD, lr=0.605, scheduler=plateau, warmup=1796