Skip to content
/ LCKV Public

Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance. Accepted to ACL 2024.

Notifications You must be signed in to change notification settings

whyNLP/LCKV

Error
Looks like something went wrong!

About

Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance. Accepted to ACL 2024.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published