Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WeightCompression] Statistics caching #3017

Merged
merged 101 commits into from
Oct 31, 2024
Merged

[WeightCompression] Statistics caching #3017

merged 101 commits into from
Oct 31, 2024

Commits on Oct 15, 2024

  1. draft

    @kshpv
    kshpv committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    de0c068 View commit details
    Browse the repository at this point in the history

  2. add gzip

    @kshpv
    kshpv committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    8f8b4cf View commit details
    Browse the repository at this point in the history

  3. add description

    @kshpv
    kshpv committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    ac3b28d View commit details
    Browse the repository at this point in the history

  4. update WCstatistics

    @kshpv
    kshpv committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    1f026eb View commit details
    Browse the repository at this point in the history

  5. fix init

    @kshpv
    kshpv committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    ebe17c3 View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'remote/develop' into statistics_cahing

    @kshpv
    kshpv committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    9d69dac View commit details
    Browse the repository at this point in the history

  7. rollback build_statistic_container

    @kshpv
    kshpv committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    8a358b1 View commit details
    Browse the repository at this point in the history

  8. typo; fix mypy

    @kshpv
    kshpv committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    3ffa566 View commit details
    Browse the repository at this point in the history

  9. remain only compressed mode

    @kshpv
    kshpv committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    24fc759 View commit details
    Browse the repository at this point in the history

  10. add docstrings

    @kshpv
    kshpv committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    25fa2ee View commit details
    Browse the repository at this point in the history

  11. minor

    @kshpv
    kshpv committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    afd3ca9 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. rm WeightQuantizationErrorTensorStatistic

    @kshpv
    kshpv committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    ecb82a8 View commit details
    Browse the repository at this point in the history

  2. add tests

    @kshpv
    kshpv committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    19646c1 View commit details
    Browse the repository at this point in the history

  3. improve code

    @kshpv
    kshpv committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    86dc4da View commit details
    Browse the repository at this point in the history

  4. add __eq__ for statistics

    @kshpv
    kshpv committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    d3903a4 View commit details
    Browse the repository at this point in the history

  5. polishing

    @kshpv
    kshpv committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    1e86ddd View commit details
    Browse the repository at this point in the history

  6. dump objects

    @kshpv
    kshpv committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    43161e9 View commit details
    Browse the repository at this point in the history

  7. _get_statistics_key abstarctmethod

    @kshpv
    kshpv committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    ac6bef9 View commit details
    Browse the repository at this point in the history

  8. build_statistic_container -> from_kwargs

    @kshpv
    kshpv committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    ca7317d View commit details
    Browse the repository at this point in the history

  9. add state methods for pickle of Tensor

    @kshpv
    kshpv committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    8263c9d View commit details
    Browse the repository at this point in the history

  10. rm redundant test case

    @kshpv
    kshpv committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    8253a9b View commit details
    Browse the repository at this point in the history

  11. from_kwargs to WCTensorStatistic

    @kshpv
    kshpv committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    3566914 View commit details
    Browse the repository at this point in the history

  12. polishing

    @kshpv
    kshpv committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    5b739a6 View commit details
    Browse the repository at this point in the history

  13. fix fx

    @kshpv
    kshpv committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    504102f View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2024

  1. draft to a new logic

    @kshpv
    kshpv committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    7c38d87 View commit details
    Browse the repository at this point in the history

  2. extend logic by collecting all stats at first

    @kshpv
    kshpv committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    63c776b View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'remote/develop' into statistics_cahing

    @kshpv
    kshpv committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    9601066 View commit details
    Browse the repository at this point in the history

  4. rollback

    @kshpv
    kshpv committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    08f7374 View commit details
    Browse the repository at this point in the history

  5. add logging to aggregator

    @kshpv
    kshpv committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    b80ea31 View commit details
    Browse the repository at this point in the history

  6. add cache_statistics.py

    @kshpv
    kshpv committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    982c66c View commit details
    Browse the repository at this point in the history

  7. typos

    @kshpv
    kshpv committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    faa5c9c View commit details
    Browse the repository at this point in the history

  8. typo

    @kshpv
    kshpv committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    9feefd2 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. rollback changes in algorithm_key

    @kshpv
    kshpv committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    f295ae1 View commit details
    Browse the repository at this point in the history

  2. polishing

    @kshpv
    kshpv committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    17752eb View commit details
    Browse the repository at this point in the history

  3. comments

    @kshpv
    kshpv committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    7982bf4 View commit details
    Browse the repository at this point in the history

  4. add disable() in TensorCollector

    @kshpv
    kshpv committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    2e0e7bc View commit details
    Browse the repository at this point in the history

  5. fix name

    @kshpv
    kshpv committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    fe8e1f2 View commit details
    Browse the repository at this point in the history

  6. fix bug

    @kshpv
    kshpv committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    2230490 View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2024

  1. True to all subalgos

    @kshpv
    kshpv committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    5c20916 View commit details
    Browse the repository at this point in the history

  2. disable gptq

    @kshpv
    kshpv committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    1ff1274 View commit details
    Browse the repository at this point in the history

  3. draft configuration test

    @kshpv
    kshpv committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    f8eefd6 View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2024

  1. add opt_125m test

    @kshpv
    kshpv committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    f55c345 View commit details
    Browse the repository at this point in the history

  2. polishing

    @kshpv
    kshpv committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    9701881 View commit details
    Browse the repository at this point in the history

  3. add reqs

    @kshpv
    kshpv committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    b2efda0 View commit details
    Browse the repository at this point in the history

  4. rm test for torch

    @kshpv
    kshpv committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    aeea789 View commit details
    Browse the repository at this point in the history

  5. upgrade reqs

    @kshpv
    kshpv committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    35a64f5 View commit details
    Browse the repository at this point in the history

  6. rollback GPTQ support

    @kshpv
    kshpv committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    a18e18b View commit details
    Browse the repository at this point in the history

  7. add errors for torch, torch_fx

    @kshpv
    kshpv committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    e576ca5 View commit details
    Browse the repository at this point in the history

  8. add get_weight_compression_configuration, check_weight_compression_co… 

    …nfiguration
    @kshpv
    kshpv committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    74fc99e View commit details
    Browse the repository at this point in the history

  9. polishing

    @kshpv
    kshpv committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    4fd2afc View commit details
    Browse the repository at this point in the history

  10. docstrings

    @kshpv
    kshpv committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    83012ec View commit details
    Browse the repository at this point in the history

  11. comments

    @kshpv
    kshpv committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    b7818b7 View commit details
    Browse the repository at this point in the history

  12. fix bugs

    @kshpv
    kshpv committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    3563476 View commit details
    Browse the repository at this point in the history

  13. typehint

    @kshpv
    kshpv committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    5a75175 View commit details
    Browse the repository at this point in the history

  14. rename

    @kshpv
    kshpv committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    39fcf12 View commit details
    Browse the repository at this point in the history

  15. add ignored scope as a param

    @kshpv
    kshpv committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    7122ff1 View commit details
    Browse the repository at this point in the history

  16. typo

    @kshpv
    kshpv committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    5c6180c View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. disable gptq

    @kshpv
    kshpv committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    1912b4e View commit details
    Browse the repository at this point in the history

  2. add backend name in statistics_key

    @kshpv
    kshpv committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    fae1b20 View commit details
    Browse the repository at this point in the history

  3. add backend check

    @kshpv
    kshpv committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    a2ea028 View commit details
    Browse the repository at this point in the history

  4. docstrings

    @kshpv
    kshpv committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    e1ba427 View commit details
    Browse the repository at this point in the history

  5. mypy

    @kshpv
    kshpv committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    684a6d2 View commit details
    Browse the repository at this point in the history

  6. typos

    @kshpv
    kshpv committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    54d0204 View commit details
    Browse the repository at this point in the history

  7. statistics_serializer + statistics_validator

    @kshpv
    kshpv committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    f3a3414 View commit details
    Browse the repository at this point in the history

  8. upd test

    @kshpv
    kshpv committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    82897f3 View commit details
    Browse the repository at this point in the history

  9. some test fixes

    @kshpv
    kshpv committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    3949ee7 View commit details
    Browse the repository at this point in the history

  10. statistics_file_path -> statistics_dir_path

    @kshpv
    kshpv committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    20cc58f View commit details
    Browse the repository at this point in the history

  11. mypy

    @kshpv
    kshpv committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    b8a4612 View commit details
    Browse the repository at this point in the history

  12. comments

    @kshpv
    kshpv committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    db1ed56 View commit details
    Browse the repository at this point in the history

  13. from_kwargs -> from_config + minor

    @kshpv
    kshpv committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    cc88aeb View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2024

  1. Merge remote-tracking branch 'remote/develop' into statistics_cahing

    @kshpv
    kshpv committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    342b766 View commit details
    Browse the repository at this point in the history

  2. add test on tensor collector

    @kshpv
    kshpv committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    21ffb31 View commit details
    Browse the repository at this point in the history

  3. fix test

    @kshpv
    kshpv committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    9c5b999 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. add cache methods for TensorCollector

    @kshpv
    kshpv committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    769bb28 View commit details
    Browse the repository at this point in the history

  2. upd errors

    @kshpv
    kshpv committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    f80be5b View commit details
    Browse the repository at this point in the history

  3. mypy + fixes

    @kshpv
    kshpv committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    c6b2d81 View commit details
    Browse the repository at this point in the history

  4. fixes

    @kshpv
    kshpv committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    1459f0e View commit details
    Browse the repository at this point in the history

  5. error

    @kshpv
    kshpv committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    a27df2c View commit details
    Browse the repository at this point in the history

  6. more tests

    @kshpv
    kshpv committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    ac95062 View commit details
    Browse the repository at this point in the history

  7. rm register_tensor

    @kshpv
    kshpv committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    f07d879 View commit details
    Browse the repository at this point in the history

  8. comments

    @kshpv
    kshpv committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    793bf5b View commit details
    Browse the repository at this point in the history

  9. add subset_size to metadata

    @kshpv
    kshpv committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    1b24408 View commit details
    Browse the repository at this point in the history

  10. statistics_dir_path -> statistics_path

    @kshpv
    kshpv committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    7ba24dd View commit details
    Browse the repository at this point in the history

  11. make cache_weight_compression_statistics common function

    @kshpv
    kshpv committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    7192c92 View commit details
    Browse the repository at this point in the history

  12. import issue

    @kshpv
    kshpv committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    5c0155d View commit details
    Browse the repository at this point in the history

  13. polishing

    @kshpv
    kshpv committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    6e6587a View commit details
    Browse the repository at this point in the history

  14. add onnx and torch_fx tests on aggregator

    @kshpv
    kshpv committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    931febd View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2024

  1. add get_matmul_nodes()

    @kshpv
    kshpv committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    32462f8 View commit details
    Browse the repository at this point in the history

  2. add lora to test scope

    @kshpv
    kshpv committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    05e7643 View commit details
    Browse the repository at this point in the history

  3. test refactor

    @kshpv
    kshpv committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    bc73ac8 View commit details
    Browse the repository at this point in the history

  4. minor

    @kshpv
    kshpv committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    d27e41f View commit details
    Browse the repository at this point in the history

  5. comments

    @kshpv
    kshpv committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    c94ee95 View commit details
    Browse the repository at this point in the history

Commits on Oct 29, 2024

  1. rm gptq; optimize NNCFGraph creation;

    @kshpv
    kshpv committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    4080132 View commit details
    Browse the repository at this point in the history

  2. introduce get_compression_nodes_info for WC

    @kshpv
    kshpv committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    8799874 View commit details
    Browse the repository at this point in the history

  3. comments

    @kshpv
    kshpv committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    787b365 View commit details
    Browse the repository at this point in the history

  4. rollback changes in apply (torch has no support layer attributes)

    @kshpv
    kshpv committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    dd926b5 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2024

  1. available_backends -> get_available_backends

    @kshpv
    kshpv committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    fd6be94 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'remote/develop' into statistics_cahing

    @kshpv
    kshpv committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    35157bf View commit details
    Browse the repository at this point in the history

  3. typo

    @kshpv
    kshpv committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    26bab53 View commit details
    Browse the repository at this point in the history

  4. rollback backend check

    @kshpv
    kshpv committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    6ba8ac3 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. comments

    @kshpv
    kshpv committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    1cf2055 View commit details
    Browse the repository at this point in the history