Add support for attention sinks #350

Open

Labels

feat/layersfeat/modeltype/feature

Milestone

opened

See https://arxiv.org/abs/2309.17453

Metadata

Assignees

No one assigned

Labels

feat/layersfeat/modeltype/feature

Type

No type

Projects

No projects

Milestone

UndecidedNo due date

Relationships

None yet

Development

No branches or pull requests