Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Aggregate changes for v1 #744

Merged
merged 95 commits into from
Sep 7, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
95 commits
Select commit Hold shift + click to select a range
3afe9d7
chore!: remove cpu/gpu/stacktrace_truncation
avik-pal Jul 2, 2024
1fbe795
chore!: remove old preferences
avik-pal Jul 2, 2024
5a3b010
chore!: remove contrib deprecations
avik-pal Jul 2, 2024
eff6f50
chore!: remove `st_fixed_type`
avik-pal Jul 2, 2024
3e68b54
chore!: update layer_map/freeze
avik-pal Jul 2, 2024
7d21d8c
chore!: remove flattening of chains
avik-pal Jul 2, 2024
ab46dd8
fix: remove old usage of TrainState
avik-pal Jul 3, 2024
9ea6e60
chore: remove old `transform` export
avik-pal Jul 3, 2024
ae66cc8
ci: remove unncessary vars
avik-pal Jul 3, 2024
6ea4622
test: fix some tests
avik-pal Jul 3, 2024
6db3f6f
chore!: remove annotation of WrappedFunction
avik-pal Jul 4, 2024
8fb9ad4
fix!: remove potentially incorrect Tracker gradients for SimpleChains
avik-pal Jul 11, 2024
e2b0e16
fix: store the bias as a vector
avik-pal Jul 23, 2024
287932d
fix: test updates from new changes
avik-pal Jul 23, 2024
d818328
chore: drop pre-1.0 weight initializers
avik-pal Jul 27, 2024
e4ae250
refactor: migrate to `MLDataDevices`
avik-pal Jul 27, 2024
a35f1fb
feat: reexport NNlib
avik-pal Jul 27, 2024
dddfd66
chore: remove old versions
avik-pal Jul 27, 2024
fcf27c6
fix: errors in testing
avik-pal Jul 27, 2024
6f2f618
fix: don't reexport NNlib.dropout
avik-pal Jul 27, 2024
3ba442f
fix: remove explicit imports
avik-pal Aug 18, 2024
6553b87
fix: bad rebase
avik-pal Aug 18, 2024
221901a
fix: recurrent bias flatten
avik-pal Aug 18, 2024
506f5d2
chore: update to using [email protected]
avik-pal Aug 18, 2024
ef18ced
chore: update to using [email protected]
avik-pal Aug 18, 2024
f0c7374
fix: broken tests
avik-pal Aug 18, 2024
f4d3fc8
chore: remove all references to LuxDeviceUtils
avik-pal Aug 18, 2024
947817b
feat: define fallback `outputsize`
avik-pal Aug 18, 2024
c52754a
test: fix broken tests
avik-pal Aug 18, 2024
ec3be20
fix: printing of container layers
avik-pal Aug 19, 2024
005ecf4
fix!: (re)move deprecated `DynamicExpressionsLayer`
avik-pal Aug 29, 2024
cc9d663
fix!: (re)move deprecated `PeriodicEmbedding`
avik-pal Aug 29, 2024
fe81ec6
fix!: remove uses of DynamicExpressions
avik-pal Aug 29, 2024
929d60d
chore: apply formatting suggestion
avik-pal Aug 30, 2024
330545f
test: reexport NNlib in shared test modules
avik-pal Aug 30, 2024
1fd32e2
chore: mark version for release
avik-pal Aug 31, 2024
26e5058
chore: update compat entries for examples
avik-pal Aug 31, 2024
6d320b2
fix: remove old code from benchmarks
avik-pal Aug 31, 2024
6cb1b52
chore: run formatter
avik-pal Aug 31, 2024
a52f3d9
fix: qa testing
avik-pal Aug 31, 2024
80c7f0b
feat: controlled reexport of NNlib
avik-pal Aug 31, 2024
b9bbf99
docs: add a migration to v1 docs
avik-pal Sep 1, 2024
020afeb
test: try fixing the tests
avik-pal Sep 3, 2024
9f0cf23
fix: missing state type in StatefulLuxLayer
avik-pal Sep 3, 2024
b3c746a
chore: remove unnecessary `.0`
avik-pal Sep 3, 2024
e074134
fix!: cleanup the implementation of `layer_map`
avik-pal Sep 3, 2024
fac3d48
fix: tests
avik-pal Sep 3, 2024
4763413
fix: remove symbolic tutorial references
avik-pal Sep 4, 2024
2d1ad7b
fix: incorrect size propagator test rebase
avik-pal Sep 4, 2024
d41e3e3
fix!: remove allow_fast_activation
avik-pal Sep 4, 2024
43cee13
fix: bad rebase
avik-pal Sep 4, 2024
af560b6
fix: update freezing docs
avik-pal Sep 4, 2024
9b35c99
feat: correctly type-cast momentum and epsilon
avik-pal Sep 4, 2024
dce920d
feat: use the device iterators in the examples
avik-pal Sep 4, 2024
7b96d5d
fix: mark `Utils.eltype` as non-differentiable
avik-pal Sep 4, 2024
8c964f4
fix: misc docs issues
avik-pal Sep 5, 2024
5e8cda1
chore: remove old compat
avik-pal Sep 5, 2024
4d3f99c
feat: track running statistics in InstanceNorm
avik-pal Sep 5, 2024
95953aa
feat!: match initialization of convolution layers with Pytorch
avik-pal Sep 5, 2024
c6e6b04
fix: docstrings in InstanceNorm
avik-pal Sep 5, 2024
3219ae5
chore: run formatter
avik-pal Sep 5, 2024
4c8a7ee
feat!: upsampling now defaults to no align corners
avik-pal Sep 5, 2024
9ef520e
fix: tests and update init assumptions in tests
avik-pal Sep 5, 2024
e839347
fix: update initialization of linear layers
avik-pal Sep 5, 2024
8e68a1e
fix: update normalization defaults to match Pytorch
avik-pal Sep 5, 2024
183b18c
fix: update Embedding defaults to match Pytorch
avik-pal Sep 5, 2024
be1e74d
fix!: RNNCell defaults updated
avik-pal Sep 5, 2024
780de12
fix: testing failures due to non-zero bias
avik-pal Sep 5, 2024
01ce048
feat: update bias in LSTMCell
avik-pal Sep 5, 2024
965c9b3
feat: update bias in GRUCell
avik-pal Sep 5, 2024
0787b5b
feat: add cross correlation option to ConvTranspose
avik-pal Sep 5, 2024
6271c00
fix: accidental type to rand32
avik-pal Sep 5, 2024
1122d40
fix: unwanted printing
avik-pal Sep 5, 2024
e47f063
refactor: move the Upsample layer
avik-pal Sep 5, 2024
fd66780
feat: generalize pooling implementation and add LP versions
avik-pal Sep 5, 2024
15b20e4
fix: tests using old naming
avik-pal Sep 6, 2024
51956a9
test: remove unnecessary Enzyme runtime API
avik-pal Sep 6, 2024
8931b19
test: Enzyme with runtimeActivity enabled
avik-pal Sep 6, 2024
77dda0a
feat: add outpad to conv transpose
avik-pal Sep 6, 2024
03c57e5
docs: move docs around
avik-pal Sep 6, 2024
abf57f5
chore: run formatter
avik-pal Sep 6, 2024
74d22c4
test: more testing for ConvTranspose
avik-pal Sep 6, 2024
5afdd5a
test: more comprehensive testing for Pooling operations
avik-pal Sep 6, 2024
c548e64
test: minor test fixes
avik-pal Sep 6, 2024
3ccb1cc
fix: change in init
avik-pal Sep 6, 2024
bf11707
fix: DDIM updates and fix argument ordering
avik-pal Sep 6, 2024
f23be5f
fix: testing using old init assumptions
avik-pal Sep 6, 2024
06b20b8
fix: ConvMixer minor updates
avik-pal Sep 6, 2024
1039d97
fix: onehot supports GPUArrays
avik-pal Sep 6, 2024
9516a8d
test: explicitly zero init bias
avik-pal Sep 6, 2024
9ca0d38
fix: optionally test with FiniteDiff if ForwardDiff fails
avik-pal Sep 6, 2024
e395ed9
ci(buildkite): run some of the tutorials on CPU runners (#879)
avik-pal Sep 6, 2024
52c8880
docs: try fixing nested autodiff
avik-pal Sep 6, 2024
5010f10
docs: use the linux runners
avik-pal Sep 7, 2024
0bd7099
fix: update simplechains layer API
avik-pal Sep 7, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
44 changes: 38 additions & 6 deletions .buildkite/documentation.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@ steps:
- group: ":open_book: Build & Deploy Documentation"
if: build.message !~ /\[skip docs\]/ && !build.pull_request.draft
steps:
- label: "Tutorial Build [%N/%t]"
key: "tutorial-build"
parallelism: 6
- label: "Tutorial Build [%N/%t] CUDA Runners"
key: "tutorial-build-cuda"
parallelism: 4
plugins:
- JuliaCI/julia#v1:
version: "1"
Expand All @@ -13,7 +13,9 @@ steps:
dirs:
- src
- ext
command: julia --code-coverage=user --color=yes --project=docs docs/tutorials.jl
command: julia --code-coverage=user --color=yes --project=docs --threads=auto docs/tutorials.jl
env:
TUTORIAL_BACKEND_GROUP: "CUDA"
agents:
queue: "juliagpu"
cuda: "*"
Expand All @@ -22,10 +24,40 @@ steps:
- "docs/src/tutorials/intermediate/**/*"
- "docs/src/tutorials/advanced/**/*"
- "tutorial_deps/*"
- "**/*.cov"
timeout_in_minutes: 60

- label: "Tutorial Build [%N/%t] CPU Runners"
if: build.message !~ /\[skip docs\]/ && !build.pull_request.draft
key: "tutorial-build-cpu"
parallelism: 4
plugins:
- JuliaCI/julia#v1:
version: "1"
# - JuliaCI/julia-coverage#v1:
# codecov: true
# dirs:
# - src
# - ext
command: julia --code-coverage=user --color=yes --project=docs --threads=auto docs/tutorials.jl
env:
TUTORIAL_BACKEND_GROUP: "CPU"
agents:
queue: "juliaecosystem"
os: "linux"
arch: "x86_64"
artifact_paths:
- "docs/src/tutorials/beginner/**/*"
- "docs/src/tutorials/intermediate/**/*"
- "docs/src/tutorials/advanced/**/*"
- "tutorial_deps/*"
- "**/*.cov"
timeout_in_minutes: 60

- label: "Final Documentation Build"
depends_on: [tutorial-build]
depends_on:
- "tutorial-build-cuda"
- "tutorial-build-cpu"
plugins:
- JuliaCI/julia#v1:
version: "1"
Expand Down Expand Up @@ -65,4 +97,4 @@ env:
JULIA_NUM_THREADS: 4
GKSwstype: "100" # https://discourse.julialang.org/t/generation-of-documentation-fails-qt-qpa-xcb-could-not-connect-to-display/60988
SECRET_CODECOV_TOKEN: "jQ0BMTQgyZx7QGyU0Q2Ec7qB9mtE2q/tDu0FsfxvEG7/zOAGvXkyXrzIFFOQxvDoFcP+K2+hYZKMxicYdNqzr5wcxu505aNGN2GM3wyegAr+hO6q12bCFYx6qXzU9FLCCdeqINqn9gUSSOlGtWNFrbAlrTyz/D4Yo66TqBDzvaLL63FMnhCLaXW/zJt3hNuEAJaPY2O6Ze1rX2WZ3Y+i+s3uQ8aLImtoCJhPe8CRx+OhuYiTzGhynFfGntZ0738/1RN4gNM0S/hTC4gLE7XMVBanJpGh32rFaiDwW4zAyXKBrDkL3QA3MS1RvLTJxGJ085S16hCk0C4ddAhZCvIM9Q==;U2FsdGVkX1+bXdFeKMs5G79catOCyby2n07A2fg0FjVAvrjQLZ0yfvDS4paJiFikLkodho0khz2YALKb2Y0K6w=="
SECRET_DOCUMENTER_KEY: "iRC4P/r5o9pARB670eK9jPlKQKgkTMDAyvp2GbLG8WwLuT8T1VcWx/o4+ofGlzbTh5Z+LuFgPXfgqkjGuoWLcocHNm78xQMNMywB4rcLB2shqp8xG2vhglgnTBBS4EiyPAtVqGyi5AKmfF95PfkJvnI0Lqg5P/RWQvNGywLAR0Ikgr/lqocm2CvkFGbpMzpGxGvj76JYOusVeKvGAp698TXqPabSZR2oZQLfYnEZnaO8ivkqvMGQSXfgzoIMjCOrN1rSa84SWeI9BDeBslzDHwaYGlvjpfCyviiLtKj4t5Acl1gVE0qxxZxWuALIU6z+C1W8TbW7ZDCBUFs6UTIT+Q==;U2FsdGVkX1+/HSgg1skLszz835vSO6mEtXMhG62ohQQUc5opdo7kEIAG2wCoJPQrqGyaF9kKDVvrN5G2MdjUyaLBYlv90RzXhjTiMNFdgI3M4K500xKq3itY/aEL7hUSMRKxTos8u4xhdbRboY4rPcqgtCJ2LHEjNxmml/NfEo/8lk291rGoEYQLTvKP9cuo4enmEVVRhqmabBzt1MDz0m4c8RufJWW2Ni4osaKRkYPjl/ijJ38wvRUZIiyCX7uofh+3iCKWn0111q5xFhn256Pm79Cx2ZP+yTp9sMsVNMJZ3UJ5r18F3H+zFHWWQSoiWpHn2WNB/2VUEyt0Lp1LnogKru96P2oYkXi6kqrA+qlLISUUU7R7ggJU0IRS6MjSGDyVzlaZG8m+RmY0bmQKrDwSeq1JMGkBpjwPY1o4yOnFRB7Rj1bzToLtd2IFSa8x0a2dUSyL5pBlyWklzZCxPp05R53RNSOi2KfhNfdZU2H7xEj5+z2aV5OidzowXIyYH8FlusMdk3NAOsvTbmBGiwvN4Zub9Exli06ZwARu/oJHLRh+hgOErIJ7DoX6nPrAtofSy6Etydpt+c4HkVZtGPWFSTMNWIGNx2NB1IfveOTU60H5emQ7zow5grXz4VTczqvCIh2hoQdSR4Oplr6+tDDLhtcGGHchHt473o2ygQ1m1tg7oSvMN7jmkUV1N6GniQofmlbr8d5LK4i/QtfC5GHCKIg3ohRlDvuvvKzvVWofgHX3NhXFTKK/CWAIp76iOaCWJcI562SpKyn+pFqYKpatJ42WfF3VbNpJYVMYMai5BwAE2RyZ6FhHbsaHq/NXO/dRJwHeDm4Pc/LFlGFdzpdbuf+w2DoePc56PlNmKsLNlZVlwbWcExKttI8nz3Th3aHNNtbIbD9awf1RdDspudQrTPWkyEopDVm7TkOj/J891U5p24PF5dasIJR19Tqpic3LVJuBXYRbL/Z79VRjeE3wBGLTDdhzJMA8TrS+yMSCF80bIw/F44o4WbA3Ya425mph9MIt/a137osRKATYqbustmVW/LfIyVhuHCOCRQsqTyFU+ff6Tp0EE2i1du90wosr+UutXiubYphCmuKkZONPbiXjpW1CAi40iAwxfgOVqAl13y4FlUp4EiGS7hPBUbvvEXMqT3ssfL+mlideH/v08PQCRcyG03zcCjCTmjXCggqHd+eEXhnsNZ4PFKCKiN+znR5SW+/p+kJTaBrX2e/kMU6kzjwb4NyNmZie0hHSneVtwJ1FuXJk/Zph4quv5KugCCx21xb5pePqxfKRW5jtW6r2Rc7OSNN4BHjwAcj8fOVV+12Ak7//o8mRh0aveYfoEvjCdaI8OPfjduDGfmzPUvXiqV9kGpovdlDUATyoVa3l1CowJ5r8KDOD6Ps89OG7TV2c7Wzxq2FQVjMFXxv/4wMZR1F/0zyH+ofPLVZjK3039z35GD4uoOW9Uc7WSr4FbxxuCDwOXWgstuk3rk6ASZFSe7RIwE/Y16d/aqzI+LG8pHqaEdhg6o6Y6JxBYNQo/JoglUOHwD+N5g5n9vfBNzf0xTlE/r0yjO3LCHyWzCnWr3QdKgzm6EDyL8GO+yQIbtXtw6lRQB/UEZ+ayt175r08Yhey95IsPwLVDFRRlG6pYwmzTlQOEwvqDI8SDMWboU+jp6a5jrbaAmqiIkaoiIzrV1QDp1x+Sqj0veqN+RtcpXLawJevz8dm76H+Mmp1br61nwvGcBaOKukICVj3iLeeu5tV5NoEJznWPwveHrcarZtKvOOeJbydmNAz286i0F1ocX337dt17jIkRv9sHbfqAVapob+eT7F3N/UY99GWGDVbXzaruQwsuPPR6MbLolG6buHQaKX3OZ/zJqGWfEAHw5yJKoKNe8aSgY2DsoITqPlbNRQQmOIMuF8ffD8L1stD/P5Ohth5Nql2W+l6y87/nqxkJ9y4FFS4QzrMrl9ztugfsRoYyeSWRydLUHlTCv155VsGAxjCMBQg1rP99Smfd02EbCFlWlypIw/zem0LZ1zVuz/Wjb03n+dzi2GIKRlTrt6YMrGGAcKI+3Pf1D0rsDhXNkdFUjOeofUkDbBr/splYCKLucDHFVdN88XyaQoj2fBymNJ4BqvK64TVOLwPGAQvh/rHZ5PkJR3lMI4fg+Kxdl9/5xDjkD9aV+yRvfqVGodNW/qofq34nrdb3co1tZ4BxtSANKdJg3Fv6U0I4DOMVsJTeOn/918M31rif0rKAwnHAkeyQVbZyEsFoqxvE8gUFs1zTRwZJWlmY0xnuVcM8pOh6hULeYGiF57ZlbvymygYqObe58YgrChRnF4NhKIIYzuz7mOSKRXqF3Cr0LNYHcktUH9wrqISxiHbaUQceYZ1D0q8UfiayeK9yppMkltcDUL9M93xjTGJK8pVzARXn6ETuEsNTtLvbU/KMDY7bnVc7n08suLCk1YeJB/sn0wuTbPt+27NeYIG1YXBEE0dsgJW4z64489h71v4xws856gFOHZx0L/nkW7l328HA3jltbgJFl52mQHAJwUZrt5sJef/k7gsTdX1zQtjKN8lFjo4qpvJUpenmO9nT+Wty5cjohlETBos8CdSqj4SjEu7/UhDt52evt33EayoWJ8TjKd4VRFYCXnM6eGnSMDqUU5f7DxVjrwHnT26jtq9ijKTiAxls7fYjN8TGT/S3CHZZAK1u5gSbWfkFOcE+mioboNwDvuvysjL6de+bsc7r35w4hLFnPmKemcde4pNQfEnuelBFJqwYZbcAkhN8AmtqIWPXBw9n3eUx/TJgMFEIoB/frNDRbB0WJKdBkjdE1NVvAUl3jDnZbWjG6rqE+6UvyGqKBpd0FRYAfg3ss3hVB70uluULKUBVazlNIQlqX+qYEMBXaDIkxcftre8KYebQyJnxiOB5V+eELvm6L28bK4Xh2tpXzJL7aDlQnL8dRNvQdZgDL62EXYhrc3mz0I/p7br3KMcnei/LaPRAgcsW7WKLwzE5id6JnpOJj4VXdkX7IUB4xQjDRsGKxhjbklMVFA8g/801khNlwzU/IoXsHBgTs7yZoFX/oo4Jyp514hwqPlvJEgci0OHiSA6Mx3le2nUh0SQH+AzFJ2vi7Bn1a4psiuqd+vJJ1iuNw5CBCZlV+GO8sG93BBGnLzZDoRvkIMbzwESFP3JYZ/lKs29CB2Adobl9YbwP3he0I9cD0A/RPC70gzTdVEfL6T4iPUhBr1Bn3YlUPeC2QvCTbpKkxDsfzchuq/y0xlmL4E7Rdb+4TSMlViXfnc6aoD9vvPMWLJFF2qrxRLKhUTse5V6RoE+EVmHSiX0Vd7sd/bYp7asOC0b1xL+zjfJ5DSrtMA/P8L1p+CoLNXgVfgzCB3sCa+GLSLS2INsL1Qtnfkl8IGaMDeV+VAyHjY0HCj0l1X99f/RzD6TYrZAkLS8h1EM/JjomglhVG9/HTKS20BBJeos5ifrVd38rhONJy0HCP28pn4rCIyIE4bNG+1tEsHAg4FDYgh/OYuBsaGYgha9TGV5lGIxmVCECq3IPpkPN1CsLqv3KuDvNeH6XOOAzVtFj4VoIV6QgRLP8+94ZiiEDaPQxQ7BZoqrqFYrxWHDtEuon46VtQ3Nfq/1Rq/HvszJv6JE77w7qvKlxG9sXgxzCDRqNrG83cwY2hpDBr8U0hPMrEx977Weja1aG/rG6uirNBcY5qAAOLDo+9RvV1xqvWFF8SkT97tzNUHbzw8tuUlCT9m4rshCG+jBw59rpUZwW+eR1ih9qU7Nyr3oNgi/zmkORF1duym8VSfW5dxtRBIqxxM0oSWoHti+HSd0VLdHw8jRpbQddMBr1sjD1jIgp3w2dU4oEthzStKCPY2/lAWBm+1Es1okGhEM3I939DRcYOjfJnTCtJLJ9DTKycVDMerXvHnCgImZ0Oh4mtLF+63hn+9wUc56owFeNqs+NJHqmBBFX2uNr/Rj9mzYkRRPsYYSyCB7jIS+Z8Zall6W3dwLcsE3uw/oPKx5bJDAhnp7kZgzLC0zlS2D0ZcNZuW2uUtwhZJM6OOyV+FUFgizmpIQAQ8Nm6n/1yk0asB4jZFf221a9ZmzvUfWKmmIR7OxX3qBH9x2uMMhemv9LZdEHMcjTeIXRYciMLWUNeWagYhDgV1cRBGCDTh2EhHvYX7ZXfpsHjLOR+sAEr7uR3siitf/mRkiLfT2YBgTACKKoj05UuC8aknEV4T5bWiye+gKGioml5G/fWYHyHow37g6D84n0cBTWmI0oPlg+rqpeRLOeYaTeCXOtM/7M1FHuGvzmBnag2vhKY2tpjVrg2nI3p4SRlzTyoQkyMfRXN87v5nAheVcLgrYtkv9aX7R6VMZ1UIsxn62ZHFa2IR6skB/xw7RRuJY5r5FIWs1LqIQDaon5L4C4v9rnBxMYoUM"
SECRET_DOCUMENTER_KEY: "iRC4P/r5o9pARB670eK9jPlKQKgkTMDAyvp2GbLG8WwLuT8T1VcWx/o4+ofGlzbTh5Z+LuFgPXfgqkjGuoWLcocHNm78xQMNMywB4rcLB2shqp8xG2vhglgnTBBS4EiyPAtVqGyi5AKmfF95PfkJvnI0Lqg5P/RWQvNGywLAR0Ikgr/lqocm2CvkFGbpMzpGxGvj76JYOusVeKvGAp698TXqPabSZR2oZQLfYnEZnaO8ivkqvMGQSXfgzoIMjCOrN1rSa84SWeI9BDeBslzDHwaYGlvjpfCyviiLtKj4t5Acl1gVE0qxxZxWuALIU6z+C1W8TbW7ZDCBUFs6UTIT+Q==;U2FsdGVkX1+/HSgg1skLszz835vSO6mEtXMhG62ohQQUc5opdo7kEIAG2wCoJPQrqGyaF9kKDVvrN5G2MdjUyaLBYlv90RzXhjTiMNFdgI3M4K500xKq3itY/aEL7hUSMRKxTos8u4xhdbRboY4rPcqgtCJ2LHEjNxmml/NfEo/8lk291rGoEYQLTvKP9cuo4enmEVVRhqmabBzt1MDz0m4c8RufJWW2Ni4osaKRkYPjl/ijJ38wvRUZIiyCX7uofh+3iCKWn0111q5xFhn256Pm79Cx2ZP+yTp9sMsVNMJZ3UJ5r18F3H+zFHWWQSoiWpHn2WNB/2VUEyt0Lp1LnogKru96P2oYkXi6kqrA+qlLISUUU7R7ggJU0IRS6MjSGDyVzlaZG8m+RmY0bmQKrDwSeq1JMGkBpjwPY1o4yOnFRB7Rj1bzToLtd2IFSa8x0a2dUSyL5pBlyWklzZCxPp05R53RNSOi2KfhNfdZU2H7xEj5+z2aV5OidzowXIyYH8FlusMdk3NAOsvTbmBGiwvN4Zub9Exli06ZwARu/oJHLRh+hgOErIJ7DoX6nPrAtofSy6Etydpt+c4HkVZtGPWFSTMNWIGNx2NB1IfveOTU60H5emQ7zow5grXz4VTczqvCIh2hoQdSR4Oplr6+tDDLhtcGGHchHt473o2ygQ1m1tg7oSvMN7jmkUV1N6GniQofmlbr8d5LK4i/QtfC5GHCKIg3ohRlDvuvvKzvVWofgHX3NhXFTKK/CWAIp76iOaCWJcI562SpKyn+pFqYKpatJ42WfF3VbNpJYVMYMai5BwAE2RyZ6FhHbsaHq/NXO/dRJwHeDm4Pc/LFlGFdzpdbuf+w2DoePc56PlNmKsLNlZVlwbWcExKttI8nz3Th3aHNNtbIbD9awf1RdDspudQrTPWkyEopDVm7TkOj/J891U5p24PF5dasIJR19Tqpic3LVJuBXYRbL/Z79VRjeE3wBGLTDdhzJMA8TrS+yMSCF80bIw/F44o4WbA3Ya425mph9MIt/a137osRKATYqbustmVW/LfIyVhuHCOCRQsqTyFU+ff6Tp0EE2i1du90wosr+UutXiubYphCmuKkZONPbiXjpW1CAi40iAwxfgOVqAl13y4FlUp4EiGS7hPBUbvvEXMqT3ssfL+mlideH/v08PQCRcyG03zcCjCTmjXCggqHd+eEXhnsNZ4PFKCKiN+znR5SW+/p+kJTaBrX2e/kMU6kzjwb4NyNmZie0hHSneVtwJ1FuXJk/Zph4quv5KugCCx21xb5pePqxfKRW5jtW6r2Rc7OSNN4BHjwAcj8fOVV+12Ak7//o8mRh0aveYfoEvjCdaI8OPfjduDGfmzPUvXiqV9kGpovdlDUATyoVa3l1CowJ5r8KDOD6Ps89OG7TV2c7Wzxq2FQVjMFXxv/4wMZR1F/0zyH+ofPLVZjK3039z35GD4uoOW9Uc7WSr4FbxxuCDwOXWgstuk3rk6ASZFSe7RIwE/Y16d/aqzI+LG8pHqaEdhg6o6Y6JxBYNQo/JoglUOHwD+N5g5n9vfBNzf0xTlE/r0yjO3LCHyWzCnWr3QdKgzm6EDyL8GO+yQIbtXtw6lRQB/UEZ+ayt175r08Yhey95IsPwLVDFRRlG6pYwmzTlQOEwvqDI8SDMWboU+jp6a5jrbaAmqiIkaoiIzrV1QDp1x+Sqj0veqN+RtcpXLawJevz8dm76H+Mmp1br61nwvGcBaOKukICVj3iLeeu5tV5NoEJznWPwveHrcarZtKvOOeJbydmNAz286i0F1ocX337dt17jIkRv9sHbfqAVapob+eT7F3N/UY99GWGDVbXzaruQwsuPPR6MbLolG6buHQaKX3OZ/zJqGWfEAHw5yJKoKNe8aSgY2DsoITqPlbNRQQmOIMuF8ffD8L1stD/P5Ohth5Nql2W+l6y87/nqxkJ9y4FFS4QzrMrl9ztugfsRoYyeSWRydLUHlTCv155VsGAxjCMBQg1rP99Smfd02EbCFlWlypIw/zem0LZ1zVuz/Wjb03n+dzi2GIKRlTrt6YMrGGAcKI+3Pf1D0rsDhXNkdFUjOeofUkDbBr/splYCKLucDHFVdN88XyaQoj2fBymNJ4BqvK64TVOLwPGAQvh/rHZ5PkJR3lMI4fg+Kxdl9/5xDjkD9aV+yRvfqVGodNW/qofq34nrdb3co1tZ4BxtSANKdJg3Fv6U0I4DOMVsJTeOn/918M31rif0rKAwnHAkeyQVbZyEsFoqxvE8gUFs1zTRwZJWlmY0xnuVcM8pOh6hULeYGiF57ZlbvymygYqObe58YgrChRnF4NhKIIYzuz7mOSKRXqF3Cr0LNYHcktUH9wrqISxiHbaUQceYZ1D0q8UfiayeK9yppMkltcDUL9M93xjTGJK8pVzARXn6ETuEsNTtLvbU/KMDY7bnVc7n08suLCk1YeJB/sn0wuTbPt+27NeYIG1YXBEE0dsgJW4z64489h71v4xws856gFOHZx0L/nkW7l328HA3jltbgJFl52mQHAJwUZrt5sJef/k7gsTdX1zQtjKN8lFjo4qpvJUpenmO9nT+Wty5cjohlETBos8CdSqj4SjEu7/UhDt52evt33EayoWJ8TjKd4VRFYCXnM6eGnSMDqUU5f7DxVjrwHnT26jtq9ijKTiAxls7fYjN8TGT/S3CHZZAK1u5gSbWfkFOcE+mioboNwDvuvysjL6de+bsc7r35w4hLFnPmKemcde4pNQfEnuelBFJqwYZbcAkhN8AmtqIWPXBw9n3eUx/TJgMFEIoB/frNDRbB0WJKdBkjdE1NVvAUl3jDnZbWjG6rqE+6UvyGqKBpd0FRYAfg3ss3hVB70uluULKUBVazlNIQlqX+qYEMBXaDIkxcftre8KYebQyJnxiOB5V+eELvm6L28bK4Xh2tpXzJL7aDlQnL8dRNvQdZgDL62EXYhrc3mz0I/p7br3KMcnei/LaPRAgcsW7WKLwzE5id6JnpOJj4VXdkX7IUB4xQjDRsGKxhjbklMVFA8g/801khNlwzU/IoXsHBgTs7yZoFX/oo4Jyp514hwqPlvJEgci0OHiSA6Mx3le2nUh0SQH+AzFJ2vi7Bn1a4psiuqd+vJJ1iuNw5CBCZlV+GO8sG93BBGnLzZDoRvkIMbzwESFP3JYZ/lKs29CB2Adobl9YbwP3he0I9cD0A/RPC70gzTdVEfL6T4iPUhBr1Bn3YlUPeC2QvCTbpKkxDsfzchuq/y0xlmL4E7Rdb+4TSMlViXfnc6aoD9vvPMWLJFF2qrxRLKhUTse5V6RoE+EVmHSiX0Vd7sd/bYp7asOC0b1xL+zjfJ5DSrtMA/P8L1p+CoLNXgVfgzCB3sCa+GLSLS2INsL1Qtnfkl8IGaMDeV+VAyHjY0HCj0l1X99f/RzD6TYrZAkLS8h1EM/JjomglhVG9/HTKS20BBJeos5ifrVd38rhONJy0HCP28pn4rCIyIE4bNG+1tEsHAg4FDYgh/OYuBsaGYgha9TGV5lGIxmVCECq3IPpkPN1CsLqv3KuDvNeH6XOOAzVtFj4VoIV6QgRLP8+94ZiiEDaPQxQ7BZoqrqFYrxWHDtEuon46VtQ3Nfq/1Rq/HvszJv6JE77w7qvKlxG9sXgxzCDRqNrG83cwY2hpDBr8U0hPMrEx977Weja1aG/rG6uirNBcY5qAAOLDo+9RvV1xqvWFF8SkT97tzNUHbzw8tuUlCT9m4rshCG+jBw59rpUZwW+eR1ih9qU7Nyr3oNgi/zmkORF1duym8VSfW5dxtRBIqxxM0oSWoHti+HSd0VLdHw8jRpbQddMBr1sjD1jIgp3w2dU4oEthzStKCPY2/lAWBm+1Es1okGhEM3I939DRcYOjfJnTCtJLJ9DTKycVDMerXvHnCgImZ0Oh4mtLF+63hn+9wUc56owFeNqs+NJHqmBBFX2uNr/Rj9mzYkRRPsYYSyCB7jIS+Z8Zall6W3dwLcsE3uw/oPKx5bJDAhnp7kZgzLC0zlS2D0ZcNZuW2uUtwhZJM6OOyV+FUFgizmpIQAQ8Nm6n/1yk0asB4jZFf221a9ZmzvUfWKmmIR7OxX3qBH9x2uMMhemv9LZdEHMcjTeIXRYciMLWUNeWagYhDgV1cRBGCDTh2EhHvYX7ZXfpsHjLOR+sAEr7uR3siitf/mRkiLfT2YBgTACKKoj05UuC8aknEV4T5bWiye+gKGioml5G/fWYHyHow37g6D84n0cBTWmI0oPlg+rqpeRLOeYaTeCXOtM/7M1FHuGvzmBnag2vhKY2tpjVrg2nI3p4SRlzTyoQkyMfRXN87v5nAheVcLgrYtkv9aX7R6VMZ1UIsxn62ZHFa2IR6skB/xw7RRuJY5r5FIWs1LqIQDaon5L4C4v9rnBxMYoUM"
2 changes: 1 addition & 1 deletion .buildkite/pipeline.yml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
steps:
- label: "Triggering Pipelines (Pull Request)"
if: "build.pull_request.base_branch == 'main'"
if: build.branch != "main" || build.tag == null
agents:
queue: "juliagpu"
plugins:
Expand Down
2 changes: 0 additions & 2 deletions .github/workflows/CI.yml
Original file line number Diff line number Diff line change
Expand Up @@ -154,8 +154,6 @@ jobs:
with:
version: ${{ matrix.version }}
- uses: julia-actions/julia-downgrade-compat@v1
with:
skip: 'AMDGPU'
- uses: julia-actions/julia-buildpkg@v1
- uses: julia-actions/julia-runtest@v1
env:
Expand Down
17 changes: 6 additions & 11 deletions Project.toml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
name = "Lux"
uuid = "b2108857-7c20-44ae-9111-449ecde12c47"
authors = ["Avik Pal <[email protected]> and contributors"]
version = "0.5.68"
version = "1.0.0"

[deps]
ADTypes = "47edcb42-4c32-4615-8424-f2b9edc5f35b"
Expand All @@ -20,7 +20,6 @@ GPUArraysCore = "46192b85-c4d5-4398-a991-12ede77f4527"
LinearAlgebra = "37e2e46d-f89d-539d-b4ee-838fcccc9c8e"
LossFunctions = "30fc2ffe-d236-52d8-8643-a9d8f7c094a7"
LuxCore = "bb33d45b-7691-41d6-9220-0943567d0623"
LuxDeviceUtils = "34f89e08-e1d5-43b4-8944-0b49ac560553"
LuxLib = "82251201-b29d-42c6-8e01-566dec8acb11"
MLDataDevices = "7e8f7934-dd98-4c1a-8fe8-92b47a384d40"
MacroTools = "1914dd2f-81c6-5fcd-8719-6d5c9610ff09"
Expand All @@ -42,7 +41,6 @@ WeightInitializers = "d49dbf32-c5c2-4618-8acc-27bb2598ef2d"
[weakdeps]
CUDA = "052768ef-5323-5732-b1bb-66c8b64840ba"
ComponentArrays = "b0b7db55-cfe3-40fc-9ded-d10e2dbeff66"
DynamicExpressions = "a40a106e-89c9-4ca8-8020-a735e8728b6b"
Enzyme = "7da242da-08ed-463a-9acd-ee780be4f1d9"
Flux = "587475ba-b771-5e3f-ad9e-33799f191a9c"
FunctionWrappers = "069b7b12-0de2-55c6-9aab-29f3d0a68a2e"
Expand All @@ -56,7 +54,6 @@ Zygote = "e88e6eb3-aa80-5325-afca-941959d7151f"

[extensions]
LuxComponentArraysExt = "ComponentArrays"
LuxDynamicExpressionsExt = "DynamicExpressions"
LuxEnzymeExt = "Enzyme"
LuxFluxExt = "Flux"
LuxMLUtilsExt = "MLUtils"
Expand All @@ -70,15 +67,14 @@ LuxZygoteExt = "Zygote"
[compat]
ADTypes = "1.5"
Adapt = "4"
ArgCheck = "2.1"
ArgCheck = "2.3"
ArrayInterface = "7.9"
CUDA = "5.3.2"
ChainRulesCore = "1.24"
Compat = "4.15"
ComponentArrays = "0.15.16"
ConcreteStructs = "0.2.3"
DispatchDoctor = "0.4.12"
DynamicExpressions = "0.16, 0.17, 0.18, 0.19"
Enzyme = "0.12.26"
EnzymeCore = "0.7.7"
FastClosures = "0.3.2"
Expand All @@ -89,9 +85,8 @@ Functors = "0.4.12"
GPUArraysCore = "0.1.6"
LinearAlgebra = "1.10"
LossFunctions = "0.11.1"
LuxCore = "0.1.24"
LuxDeviceUtils = "0.1.26"
LuxLib = "0.3.42"
LuxCore = "1"
LuxLib = "1.2"
MLDataDevices = "1.1"
MLUtils = "0.4.4"
MPI = "0.20.19"
Expand All @@ -104,7 +99,7 @@ Preferences = "1.4.3"
Random = "1.10"
Reexport = "1.2.2"
ReverseDiff = "1.15"
SIMDTypes = "0.1.0"
SIMDTypes = "0.1"
Setfield = "1.1.1"
SimpleChains = "0.4.7"
Static = "1.1.1"
Expand All @@ -113,6 +108,6 @@ Statistics = "1.10"
Tracker = "0.2.34"
UnrolledUtilities = "0.1.2"
VectorizationBase = "0.21.70"
WeightInitializers = "0.1.5, 1"
WeightInitializers = "1"
Zygote = "0.6.70"
julia = "1.10"
74 changes: 41 additions & 33 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -37,6 +37,9 @@ import Pkg
Pkg.add("Lux")
```

> [!TIP]
> If you are using a pre-v1 version of Lux.jl, please see the [Updating to v1 section](https://lux.csail.mit.edu/dev/introduction/updating_to_v1/) for instructions on how to update.

## 🤸 Quickstart

```julia
Expand Down Expand Up @@ -74,7 +77,43 @@ st_opt, ps = Optimisers.update(st_opt, ps, gs)

Look in the [examples](/examples/) directory for self-contained usage examples. The [documentation](https://lux.csail.mit.edu) has examples sorted into proper categories.

## 🧪 Testing
## 🆘 Getting Help

For usage related questions, please use [Github Discussions](https://github.com/orgs/LuxDL/discussions) which allows questions and answers to be indexed. To report bugs use [github issues](https://github.com/LuxDL/Lux.jl/issues) or even better send in a [pull request](https://github.com/LuxDL/Lux.jl/pulls).

## 🧑‍🔬 Citation

If you found this library to be useful in academic work, then please cite:

```bibtex
@software{pal2023lux,
author = {Pal, Avik},
title = {{Lux: Explicit Parameterization of Deep Neural Networks in Julia}},
month = apr,
year = 2023,
note = {If you use this software, please cite it as below.},
publisher = {Zenodo},
version = {v0.5.0},
doi = {10.5281/zenodo.7808904},
url = {https://doi.org/10.5281/zenodo.7808904}
}

@thesis{pal2023efficient,
title = {{On Efficient Training \& Inference of Neural Differential Equations}},
author = {Pal, Avik},
year = {2023},
school = {Massachusetts Institute of Technology}
}
```

Also consider starring [our github repo](https://github.com/LuxDL/Lux.jl/).

## 🧑‍💻 Contributing

This section is somewhat incomplete. You can contribute by contributing to finishing this
section 😜.

### 🧪 Testing

The full test of `Lux.jl` takes a long time, here's how to test a portion of the code.

Expand Down Expand Up @@ -122,36 +161,5 @@ ReTestItems.runtests("tests/"; name = "NAME OF THE TEST")
For the `SkipConnection` tests that would be:

```julia
ReTestItems.runtests("tests/"; name = SkipConnection)
```

## 🆘 Getting Help

For usage related questions, please use [Github Discussions](https://github.com/orgs/LuxDL/discussions) which allows questions and answers to be indexed. To report bugs use [github issues](https://github.com/LuxDL/Lux.jl/issues) or even better send in a [pull request](https://github.com/LuxDL/Lux.jl/pulls).

## 🧑‍🔬 Citation

If you found this library to be useful in academic work, then please cite:

```bibtex
@software{pal2023lux,
author = {Pal, Avik},
title = {{Lux: Explicit Parameterization of Deep Neural Networks in Julia}},
month = apr,
year = 2023,
note = {If you use this software, please cite it as below.},
publisher = {Zenodo},
version = {v0.5.0},
doi = {10.5281/zenodo.7808904},
url = {https://doi.org/10.5281/zenodo.7808904}
}

@thesis{pal2023efficient,
title = {{On Efficient Training \& Inference of Neural Differential Equations}},
author = {Pal, Avik},
year = {2023},
school = {Massachusetts Institute of Technology}
}
ReTestItems.runtests("tests/"; name = "SkipConnection")
```

Also consider starring [our github repo](https://github.com/LuxDL/Lux.jl/).
2 changes: 1 addition & 1 deletion benchmarks/setup.jl
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
using ADTypes: ADTypes, AutoEnzyme, AutoZygote
using Adapt: adapt
using Lux: Lux, BatchNorm, Chain, Conv, CrossCor, Dense, Dropout, FlattenLayer, MaxPool
using Lux: Lux, BatchNorm, Chain, Conv, Dense, Dropout, FlattenLayer, MaxPool
using MLDataDevices: AbstractDevice, CPUDevice, CUDADevice, AMDGPUDevice
using NNlib: relu, gelu
using Random: Random
Expand Down
4 changes: 2 additions & 2 deletions benchmarks/setups/models.jl
Original file line number Diff line number Diff line change
Expand Up @@ -25,10 +25,10 @@ function setup_vgg16_benchmarks!(suite::BenchmarkGroup, cpu_or_gpu::String,
conv_bn((3, 3), 512 => 512, relu; pad=(1, 1), stride=(1, 1)),
conv_bn((3, 3), 512 => 512, relu; pad=(1, 1), stride=(1, 1)),
conv_bn((3, 3), 512 => 512, relu; pad=(1, 1), stride=(1, 1)),
MaxPool((2, 2)); disable_optimizations=true),
MaxPool((2, 2))),
FlattenLayer(),
Chain(Dense(512, 4096, relu), Dropout(0.5f0), Dense(4096, 4096, relu),
Dropout(0.5f0), Dense(4096, 10); name="Classifier"); disable_optimizations=true)
Dropout(0.5f0), Dense(4096, 10); name="Classifier"))

for bsize in (32, 64, 128)
setup_forward_pass_benchmark!(suite, "vgg16(32, 32, 3, $bsize)",
Expand Down
Loading
Loading