Skip to content

Commit

Permalink
chore: minor clarifications in the WP notebook (#779)
Browse files Browse the repository at this point in the history
  • Loading branch information
bcm-at-zama authored Jul 23, 2024
1 parent e3fae84 commit e4c21fa
Showing 1 changed file with 16 additions and 11 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -577,9 +577,7 @@
"source": [
"## Conclusion\n",
"\n",
"Here is a recap of the results obtained by running this notebook, compared to the results in the whitepaper [1].\n",
"\n",
"A pre-computed comparison to a `hpc7a` instance with 192 vCPU is also shown when running this notebook on a large server machine."
"Here is a recap of the results obtained by running this notebook on a `m6i.metal` instance, compared to the results in the whitepaper [1]."
]
},
{
Expand All @@ -599,9 +597,9 @@
" <th id=\"T_4ba03_level0_col0\" class=\"col_heading level0 col0\" >Num Layers</th>\n",
" <th id=\"T_4ba03_level0_col1\" class=\"col_heading level0 col1\" >Accuracy [1]</th>\n",
" <th id=\"T_4ba03_level0_col2\" class=\"col_heading level0 col2\" >FHE Latency [1]</th>\n",
" <th id=\"T_4ba03_level0_col3\" class=\"col_heading level0 col3\" >Our Accuracy fp32</th>\n",
" <th id=\"T_4ba03_level0_col4\" class=\"col_heading level0 col4\" >Our Accuracy FHE</th>\n",
" <th id=\"T_4ba03_level0_col5\" class=\"col_heading level0 col5\" >Our FHE Latency</th>\n",
" <th id=\"T_4ba03_level0_col3\" class=\"col_heading level0 col3\" >Our m6i.metal Accuracy fp32</th>\n",
" <th id=\"T_4ba03_level0_col4\" class=\"col_heading level0 col4\" >Our m6i.metal Accuracy FHE</th>\n",
" <th id=\"T_4ba03_level0_col5\" class=\"col_heading level0 col5\" >Our m6i.metal FHE Latency</th>\n",
" <th id=\"T_4ba03_level0_col6\" class=\"col_heading level0 col6\" >Speedup</th>\n",
" </tr>\n",
" </thead>\n",
Expand Down Expand Up @@ -639,10 +637,17 @@
}
],
"source": [
"df, fmt = format_results_df(PAPER_NOTES, results_cml, \"Our\")\n",
"df, fmt = format_results_df(PAPER_NOTES, results_cml, \"Our m6i.metal\")\n",
"df.style.format(fmt)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"A pre-computed comparison to a `hpc7a.96xlarge` instance with 192 vCPU is also shown when running this notebook on a large server machine."
]
},
{
"cell_type": "code",
"execution_count": 8,
Expand All @@ -660,9 +665,9 @@
" <th id=\"T_e8864_level0_col0\" class=\"col_heading level0 col0\" >Num Layers</th>\n",
" <th id=\"T_e8864_level0_col1\" class=\"col_heading level0 col1\" >Accuracy [1]</th>\n",
" <th id=\"T_e8864_level0_col2\" class=\"col_heading level0 col2\" >FHE Latency [1]</th>\n",
" <th id=\"T_e8864_level0_col3\" class=\"col_heading level0 col3\" >hpc7a Accuracy fp32</th>\n",
" <th id=\"T_e8864_level0_col4\" class=\"col_heading level0 col4\" >hpc7a Accuracy FHE</th>\n",
" <th id=\"T_e8864_level0_col5\" class=\"col_heading level0 col5\" >hpc7a FHE Latency</th>\n",
" <th id=\"T_e8864_level0_col3\" class=\"col_heading level0 col3\" >Our hpc7a.96xlarge Accuracy fp32</th>\n",
" <th id=\"T_e8864_level0_col4\" class=\"col_heading level0 col4\" >Our hpc7a.96xlarge Accuracy FHE</th>\n",
" <th id=\"T_e8864_level0_col5\" class=\"col_heading level0 col5\" >Our hpc7a.96xlarge FHE Latency</th>\n",
" <th id=\"T_e8864_level0_col6\" class=\"col_heading level0 col6\" >Speedup</th>\n",
" </tr>\n",
" </thead>\n",
Expand Down Expand Up @@ -703,7 +708,7 @@
"# This benchmark was done on a hpc7 machine with 192-cores\n",
"BENCH_HPC7A = {20: [0.987, 0.959, 0.995], 50: [0.9745, 0.9477, 3.03]}\n",
"\n",
"df, fmt = format_results_df(PAPER_NOTES, BENCH_HPC7A, \"hpc7a\")\n",
"df, fmt = format_results_df(PAPER_NOTES, BENCH_HPC7A, \"Our hpc7a.96xlarge\")\n",
"df.style.format(fmt)"
]
},
Expand Down

0 comments on commit e4c21fa

Please sign in to comment.