Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add LayerNorm support for Vivado #1110

Open
wants to merge 54 commits into
base: main
Choose a base branch
from
Open

Add LayerNorm support for Vivado #1110

wants to merge 54 commits into from

Commits on Sep 13, 2024

  1. paser_mht

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    c4c818b View commit details
    Browse the repository at this point in the history

  2. change parser and modify keras_to_hls

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    3ee64d1 View commit details
    Browse the repository at this point in the history

  3. IR_mutihead_attention

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    5626a1a View commit details
    Browse the repository at this point in the history

  4. IR done

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    d51f8a9 View commit details
    Browse the repository at this point in the history

  5. create mha file in template

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    89025a2 View commit details
    Browse the repository at this point in the history

  6. mha .h file dummy algo

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    d76cf60 View commit details
    Browse the repository at this point in the history

  7. config of mha

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    56811de View commit details
    Browse the repository at this point in the history

  8. update mha config

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    45cd493 View commit details
    Browse the repository at this point in the history

  9. dummy mha

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    1402f48 View commit details
    Browse the repository at this point in the history

  10. add transpose into mha

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    430b9ea View commit details
    Browse the repository at this point in the history

  11. projection_of_qkv_in_mha

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    97f3e8d View commit details
    Browse the repository at this point in the history

  12. mha_first_draft

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    52cc7e8 View commit details
    Browse the repository at this point in the history

  13. able to predict model correct

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    3961f97 View commit details
    Browse the repository at this point in the history

  14. delete some unnassary comments

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    3533999 View commit details
    Browse the repository at this point in the history

  15. delete comments

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    d2f0df6 View commit details
    Browse the repository at this point in the history

  16. resource strategy of transformer

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    6aaa5ed View commit details
    Browse the repository at this point in the history

  17. change sm lagacy

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    3b7a288 View commit details
    Browse the repository at this point in the history

  18. update MHA, optimized

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    130092d View commit details
    Browse the repository at this point in the history

  19. support resource

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    09b0ba0 View commit details
    Browse the repository at this point in the history

  20. update

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    b49fffd View commit details
    Browse the repository at this point in the history

  21. dense_muti_dim_support

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    5324a11 View commit details
    Browse the repository at this point in the history

  22. parallel execute dense

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    bf8c788 View commit details
    Browse the repository at this point in the history

  23. updates

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    b6be2c4 View commit details
    Browse the repository at this point in the history

  24. add_layerNorm_support

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    2472b7d View commit details
    Browse the repository at this point in the history

  25. MHA updated

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    97e71e9 View commit details
    Browse the repository at this point in the history

  26. LayerNorm_bug_fix

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    5ed4a76 View commit details
    Browse the repository at this point in the history

  27. update bit precision

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    5d28f58 View commit details
    Browse the repository at this point in the history

  28. config update

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    2fc68d0 View commit details
    Browse the repository at this point in the history

  29. add some comment

    @Ethan0Jiang @JanFSchulte
    Ethan0Jiang authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    b5c95cf View commit details
    Browse the repository at this point in the history

  30. run pre-commit

    @JanFSchulte
    JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    3b8aa8d View commit details
    Browse the repository at this point in the history

  31. Added support on QMultiHeadAttention, QLayerNormalization, and quanti… 

    …zed_softmax
    @LostEcho365 @JanFSchulte
    LostEcho365 authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    d28b24c View commit details
    Browse the repository at this point in the history

  32. updated on hls4ml transformer

    @LostEcho365 @JanFSchulte
    LostEcho365 authored and JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    de79bb9 View commit details
    Browse the repository at this point in the history

  33. trying to clean the diff

    @JanFSchulte
    JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    6c23326 View commit details
    Browse the repository at this point in the history

  34. trying to clean the diff

    @JanFSchulte
    JanFSchulte committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    20a0199 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. trying to clean the diff

    Rian Flynn committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    ddccde2 View commit details
    Browse the repository at this point in the history

  2. trying to clean the diff

    Rian Flynn committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    afbe00b View commit details
    Browse the repository at this point in the history

  3. trying to clean the diff

    Rian Flynn committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    dedf96c View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. undo vhdl -> verilog change

    Rian Flynn committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    a9de9cb View commit details
    Browse the repository at this point in the history

  2. halfway working layernorm + test

    Rian Flynn committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    49313d3 View commit details
    Browse the repository at this point in the history

  3. layernorm is now pretty functional

    Rian Flynn committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    1156ba5 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. layernorm on pytorch also

    Rian Flynn committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    17e0048 View commit details
    Browse the repository at this point in the history

  2. minor cleanup

    Rian Flynn committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    63891fd View commit details
    Browse the repository at this point in the history

  3. more cleanup, pre-commit

    Rian Flynn committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    8dccac6 View commit details
    Browse the repository at this point in the history

  4. test for mha which kinda works maybe if you squint

    Rian Flynn committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    595cc71 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. multihead attention working on keras and pytorch

    Rian Flynn committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    5f3ec00 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. fiddly precision / accuracy changes for layernorm

    Rian Flynn committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    5697334 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2024

  1. Merge remote-tracking branch 'upstream/main' into transformer

    @rianbrooksflynn
    rianbrooksflynn committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    d2e27b8 View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2024

  1. fix lookup table and label loops

    @rianbrooksflynn
    rianbrooksflynn committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    a149f2e View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. remove dense_seq

    @rianbrooksflynn
    rianbrooksflynn committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    552fa83 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into transformer

    @rianbrooksflynn
    rianbrooksflynn committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    69f26bc View commit details
    Browse the repository at this point in the history

  3. undo qkeras changes

    @rianbrooksflynn
    rianbrooksflynn committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    be5f5a4 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2024

  1. fix merge conflict residue

    @rianbrooksflynn
    rianbrooksflynn committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    adf7356 View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2024

  1. Merge remote-tracking branch 'upstream/main' into transformer

    @rianbrooksflynn
    rianbrooksflynn committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    8437581 View commit details
    Browse the repository at this point in the history

  2. remove non-layernorm changes

    @rianbrooksflynn
    rianbrooksflynn committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    39ab36c View commit details
    Browse the repository at this point in the history