History

Laurent Mazare 7f0f83a7c1 Rotating kv cache positions (#2901 ) * Retrieve the current positions for rotating KV caches. * Add the function to the kv cache too. * More testing.		2025-04-15 23:09:26 +02:00
..
benches	Metal: Improved reduce and softmax (#1819 )	2025-02-08 07:27:01 +01:00
examples	Optimize the cat operation on contiguous tensors (#1855 )	2024-03-17 10:49:13 +01:00
src	Rotating kv cache positions (#2901 )	2025-04-15 23:09:26 +02:00
tests	Rotating kv cache positions (#2901 )	2025-04-15 23:09:26 +02:00
Cargo.toml	Add a cudnn feature to candle-nn/candle-transformers. (#2890 )	2025-04-13 17:43:41 +02:00
README.md	Add some missing readme files. (#304 )	2023-08-02 10:57:12 +01:00

README.md

candle-nn