Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[pull] master from davisking:master #81

Merged
merged 14 commits into from
Dec 18, 2024
Merged

[pull] master from davisking:master #81

merged 14 commits into from
Dec 18, 2024

Conversation

pull[bot]
Copy link

@pull pull bot commented Aug 29, 2024

See Commits and Changes for more details.


Created by pull[bot]

Can you help keep this open source service alive? 💖 Please sponsor : )

…3000)

* Add customizable dropout layer with compile-time rate specification

* Update to the name of the new dropout rate customisation class

* Fix: Replace float template parameter with int for C++17 compatibility

* Update dlib/dnn/layers_abstract.h

---------

Co-authored-by: Davis E. King <[email protected]>
@pull pull bot added the ⤵️ pull label Aug 29, 2024
arrufat and others added 13 commits September 1, 2024 09:05
* Fix layer_normalize gradients

* fix layer_norm CPU

* attempt to fix the cuda version

* fix gamma_grad and beta_grad

* update cuda test

* use a block of size 1 to avoid race conditions

* improve the speed of CUDA path of layer_norm

* improve the speed of CUDA path of layer_norm
* Add RMS Normalization Layer

* Update dnn.cpp

* Missing entry in visitors.h to take into account the new rms_norm_ layer

* Fix test function name

* Fix dangling pointer issue in CUDA implementation of rms_normalize_gradient

* Fixing the dnn.cpp test program for the new rms_norm_ layer

* General update of the rms_norm_ class
* remove using namespace std from headers

* more std::

* more std::

* more std:: on windows stuff

* remove uses of using namespace std::chrono

* do not use C++17 features

* Add Davis suggestion

* revert some more stuff

* revert removing include

* more std::chrono stuff
…PU & CUDA) (#3012)

* Fix Stride Indexing Bugs in `reorg` and `reorg_gradient` Functions (CPU & CUDA) and Add `add_to` Parameter

* 'add_to' parameter missing in cuda call reorg_gradient.launch_kernel()

* Cleanup: remove using namespace std; (#3016)

* remove using namespace std from headers

* more std::

* more std::

* more std:: on windows stuff

* remove uses of using namespace std::chrono

* do not use C++17 features

* Add Davis suggestion

* revert some more stuff

* revert removing include

* more std::chrono stuff

* fix build error

* Adjust comment formatting to be like other dlib comments

---------

Co-authored-by: Adrià <[email protected]>
Co-authored-by: Davis King <[email protected]>
* Add tril_ layer for lower triangular matrix operations

* Improved layer consistency

* Added constant_wrapper to fix the issue of the float in the template in c++17

* Looking for a solution for c++ 14

* Refactor tril_ layer for improved flexibility and C++14 compatibility

* Updates

* Updates

* Updates

* Updates

* Updates

* Updates
* Fix Stride Indexing Bugs in `reorg` and `reorg_gradient` Functions (CPU & CUDA) and Add `add_to` Parameter

* 'add_to' parameter missing in cuda call reorg_gradient.launch_kernel()

* Cleanup: remove using namespace std; (#3016)

* remove using namespace std from headers

* more std::

* more std::

* more std:: on windows stuff

* remove uses of using namespace std::chrono

* do not use C++17 features

* Add Davis suggestion

* revert some more stuff

* revert removing include

* more std::chrono stuff

* fix build error

* Adjust comment formatting to be like other dlib comments

* Add positional encodings layer to Dlib

* Implement embeddings_ layer and add supporting utility functions to tensor_tools.h

* Updates

* Updates

* Updates

* Updates

* Update

* Update dlib/cuda/tensor_tools.h

---------

Co-authored-by: Adrià <[email protected]>
Co-authored-by: Davis King <[email protected]>
Co-authored-by: Davis E. King <[email protected]>
The problem appeared when trying to save the empirical cross-correlation
matrix using the result of a matrix expression.  That path was not taken
into account by the JXL image saver.
@pull pull bot merged commit dfbee6d into kp-forks:master Dec 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants