dnrops
/
candle
mirror of https://github.com/huggingface/candle.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,319 Commits 72 Branches 14 Tags 38 MiB
Commit Graph

9 Commits

Author SHA1 Message Date
Laurent Mazare d9904a3baf
Update to cudarc 0.14 (breaking change). (#2858) 
* Start updating to cudarc 0.14.

* Adapt a couple more things.

* And a couple more fixes.

* More tweaks.

* And a couple more fixes.

* Bump the major version number.

* Proper module system for the cuda kernels.

* Proper ptx loading.

* Launch the sort kernel.

* Custom op.

* Start using the builder pattern.

* More builder.

* More builder.

* Get candle-core to compile.

* Get the tests to pass.

* Get candle-nn to work too.

* Support for custom cuda functions.

* cudnn fixes.

* Get flash attn to run.

* Switch the crate versions to be alpha.

* Bump the ug dependency.
 2025-04-03 09:12:19 +02:00
Laurent Mazare 89b5a06858
Use bindgen-cuda for the custom-kernel example. (#1536) 
* Use bindgen-cuda for the custom-kernel example.

* Only depend on the kernels when cuda is enabled.

* Skip rustfmt.
 2024-01-07 17:18:46 +01:00
Laurent Mazare 72ebb12bca
Remove some dead-code annotations. (#629) 
* Remove some dead-code annotations.

* More dead code removal.

* One more.

* CI fix.
 2023-08-27 18:52:33 +01:00
Laurent Mazare 03be33eea4
Relax the requirements on CustomOp. (#486) 
* Relax the requirements on CustomOp.

* Simplify the custom-ops when no backward is required.
 2023-08-17 11:12:05 +01:00
Laurent Mazare 1235aa2536
Use bail rather than wrapping a string where possible. (#249) 
* Use bail rather than wrapping a string where possible.

* Revert the cuda default bit.
 2023-07-26 15:42:46 +01:00
Nicolas Patry 1a5416ec35 Rename exposed ops. 2023-07-26 12:43:19 +02:00
Laurent Mazare b6f7dfb682
CPU implementation for the custom RMS example. (#228) 
* CPU implementation for the custom RMS example.

* Add the eps parameter.
 2023-07-23 20:04:20 +01:00
Laurent Mazare e449ce53a2
Wrapping code to call the custom op. (#225) 
* Wrapping code to call the custom op.

* Get the rms example to work.

* Get around rustfmt failing in the CI.

* Fix the rms computation.
 2023-07-23 11:31:17 +01:00
Laurent Mazare b8a10425ad
Kernel build example (#224) 
* Build example kernels.

* Add some sample custom kernel.

* Get the example kernel to compile.

* Add some cuda code.

* More cuda custom op.

* More cuda custom ops.
 2023-07-23 07:15:37 +01:00