Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Paged Attention alibi support #926

Merged
merged 1 commit into from
Nov 22, 2024
Merged

Paged Attention alibi support #926

merged 1 commit into from
Nov 22, 2024

Conversation

EricLBuehler
Copy link
Owner

No description provided.

@EricLBuehler EricLBuehler changed the title Pasged attn alibi support Paged Attention alibi support Nov 22, 2024
Copy link

Code Metrics Report
  ===============================================================================
 Language            Files        Lines         Code     Comments       Blanks
===============================================================================
 C Header                2           35           28            0            7
 Dockerfile              1           41           22           10            9
 Happy                   1          442          369            0           73
 JSON                   12          105          104            0            1
 Python                 53         2274         1949           63          262
 Shell                   1           57           22           18           17
 TOML                   18          583          520            2           61
 YAML                    2           21           19            2            0
-------------------------------------------------------------------------------
 Jupyter Notebooks       4            0            0            0            0
 |- Markdown             2           77           32           31           14
 |- Python               2          196          169            1           26
 (Total)                            273          201           32           40
-------------------------------------------------------------------------------
 Markdown               40         3009            0         2286          723
 |- BASH                 6          101           98            0            3
 |- JSON                 1           12           12            0            0
 |- Python               6          114          102            0           12
 |- Rust                10          361          306            0           55
 |- TOML                 2           75           63            0           12
 (Total)                           3672          581         2286          805
-------------------------------------------------------------------------------
 Rust                  280        84913        76186         1764         6963
 |- Markdown           136         1435           25         1306          104
 (Total)                          86348        76211         3070         7067
===============================================================================
 Total                 415        91480        79219         4145         8116
===============================================================================
  

@EricLBuehler EricLBuehler merged commit afc9d41 into master Nov 22, 2024
12 checks passed
@EricLBuehler EricLBuehler deleted the paged_attn_alibi branch November 22, 2024 13:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant