Skip to content

Commit

Permalink
Main walkthrough pathing
Browse files Browse the repository at this point in the history
  • Loading branch information
JadenFiotto-Kaufman committed Aug 30, 2024
1 parent 2149c22 commit 541182f
Show file tree
Hide file tree
Showing 69 changed files with 196 additions and 191 deletions.
4 changes: 2 additions & 2 deletions public/_modules/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -54,8 +54,8 @@

<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<link href="../_static/css/custom.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../_static/css/home.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../_static/css/custom.css?v=1725048340" rel="stylesheet" type="text/css" />
<link href="../_static/css/home.css?v=1725048340" rel="stylesheet" type="text/css" />

</head>

Expand Down
4 changes: 2 additions & 2 deletions public/_modules/nnsight/contexts/Conditional/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -54,8 +54,8 @@

<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<link href="../../../../_static/css/custom.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/home.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/custom.css?v=1725048340" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/home.css?v=1725048340" rel="stylesheet" type="text/css" />

</head>

Expand Down
4 changes: 2 additions & 2 deletions public/_modules/nnsight/contexts/GraphBasedContext/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -54,8 +54,8 @@

<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<link href="../../../../_static/css/custom.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/home.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/custom.css?v=1725048340" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/home.css?v=1725048340" rel="stylesheet" type="text/css" />

</head>

Expand Down
4 changes: 2 additions & 2 deletions public/_modules/nnsight/contexts/Invoker/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -54,8 +54,8 @@

<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<link href="../../../../_static/css/custom.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/home.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/custom.css?v=1725048340" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/home.css?v=1725048340" rel="stylesheet" type="text/css" />

</head>

Expand Down
4 changes: 2 additions & 2 deletions public/_modules/nnsight/contexts/Tracer/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -54,8 +54,8 @@

<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<link href="../../../../_static/css/custom.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/home.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/custom.css?v=1725048340" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/home.css?v=1725048340" rel="stylesheet" type="text/css" />

</head>

Expand Down
4 changes: 2 additions & 2 deletions public/_modules/nnsight/contexts/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -54,8 +54,8 @@

<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<link href="../../../_static/css/custom.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../_static/css/home.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../_static/css/custom.css?v=1725048340" rel="stylesheet" type="text/css" />
<link href="../../../_static/css/home.css?v=1725048340" rel="stylesheet" type="text/css" />

</head>

Expand Down
4 changes: 2 additions & 2 deletions public/_modules/nnsight/contexts/session/Iterator/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -54,8 +54,8 @@

<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<link href="../../../../../_static/css/custom.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../../_static/css/home.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../../_static/css/custom.css?v=1725048340" rel="stylesheet" type="text/css" />
<link href="../../../../../_static/css/home.css?v=1725048340" rel="stylesheet" type="text/css" />

</head>

Expand Down
10 changes: 4 additions & 6 deletions public/_modules/nnsight/contexts/session/Session/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -54,8 +54,8 @@

<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<link href="../../../../../_static/css/custom.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../../_static/css/home.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../../_static/css/custom.css?v=1725048340" rel="stylesheet" type="text/css" />
<link href="../../../../../_static/css/home.css?v=1725048340" rel="stylesheet" type="text/css" />

</head>

Expand Down Expand Up @@ -680,11 +680,9 @@ <h1>Source code for nnsight.contexts.session.Session</h1><div class="highlight">
<span class="bp">self</span><span class="p">,</span> <span class="n">value</span><span class="p">:</span> <span class="n">Dict</span><span class="p">[</span><span class="nb">int</span><span class="p">,</span> <span class="n">Dict</span><span class="p">[</span><span class="nb">str</span><span class="p">,</span> <span class="n">Any</span><span class="p">]]</span>
<span class="p">):</span>

<span class="n">graphs</span> <span class="o">=</span> <span class="nb">list</span><span class="p">(</span><span class="bp">self</span><span class="o">.</span><span class="n">bridge</span><span class="o">.</span><span class="n">id_to_graph</span><span class="o">.</span><span class="n">values</span><span class="p">())</span>
<span class="k">for</span> <span class="n">graph_id</span><span class="p">,</span> <span class="n">saves</span> <span class="ow">in</span> <span class="n">value</span><span class="o">.</span><span class="n">items</span><span class="p">():</span>

<span class="k">for</span> <span class="n">i</span><span class="p">,</span> <span class="p">(</span><span class="n">graph_id</span><span class="p">,</span> <span class="n">saves</span><span class="p">)</span> <span class="ow">in</span> <span class="nb">enumerate</span><span class="p">(</span><span class="n">value</span><span class="o">.</span><span class="n">items</span><span class="p">()):</span>

<span class="n">graph</span> <span class="o">=</span> <span class="n">graphs</span><span class="p">[</span><span class="n">i</span><span class="p">]</span>
<span class="n">graph</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">bridge</span><span class="o">.</span><span class="n">id_to_graph</span><span class="p">[</span><span class="n">graph_id</span><span class="p">]</span>

<span class="k">for</span> <span class="n">node_name</span><span class="p">,</span> <span class="n">node_value</span> <span class="ow">in</span> <span class="n">saves</span><span class="o">.</span><span class="n">items</span><span class="p">():</span>
<span class="n">graph</span><span class="o">.</span><span class="n">nodes</span><span class="p">[</span><span class="n">node_name</span><span class="p">]</span><span class="o">.</span><span class="n">_value</span> <span class="o">=</span> <span class="n">node_value</span>
Expand Down
4 changes: 2 additions & 2 deletions public/_modules/nnsight/envoy/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -54,8 +54,8 @@

<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<link href="../../../_static/css/custom.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../_static/css/home.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../_static/css/custom.css?v=1725048340" rel="stylesheet" type="text/css" />
<link href="../../../_static/css/home.css?v=1725048340" rel="stylesheet" type="text/css" />

</head>

Expand Down
27 changes: 17 additions & 10 deletions public/_modules/nnsight/intervention/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -54,8 +54,8 @@

<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<link href="../../../_static/css/custom.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../_static/css/home.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../_static/css/custom.css?v=1725048340" rel="stylesheet" type="text/css" />
<link href="../../../_static/css/home.css?v=1725048340" rel="stylesheet" type="text/css" />

</head>

Expand Down Expand Up @@ -540,17 +540,16 @@ <h1>Source code for nnsight.intervention</h1><div class="highlight"><pre>
<span class="kn">from</span> <span class="nn">__future__</span> <span class="kn">import</span> <span class="n">annotations</span>

<span class="kn">import</span> <span class="nn">inspect</span>
<span class="kn">from</span> <span class="nn">contextlib</span> <span class="kn">import</span> <span class="n">AbstractContextManager</span>
<span class="kn">from</span> <span class="nn">typing</span> <span class="kn">import</span> <span class="n">Any</span><span class="p">,</span> <span class="n">Callable</span><span class="p">,</span> <span class="n">Collection</span><span class="p">,</span> <span class="n">Dict</span><span class="p">,</span> <span class="n">List</span><span class="p">,</span> <span class="n">Union</span>
<span class="kn">from</span> <span class="nn">collections</span> <span class="kn">import</span> <span class="n">defaultdict</span>
<span class="kn">from</span> <span class="nn">contextlib</span> <span class="kn">import</span> <span class="n">AbstractContextManager</span>
<span class="kn">from</span> <span class="nn">typing</span> <span class="kn">import</span> <span class="n">Any</span><span class="p">,</span> <span class="n">Callable</span><span class="p">,</span> <span class="n">Collection</span><span class="p">,</span> <span class="n">Dict</span><span class="p">,</span> <span class="n">List</span><span class="p">,</span> <span class="n">Tuple</span><span class="p">,</span> <span class="n">Union</span>

<span class="kn">import</span> <span class="nn">torch</span>
<span class="kn">from</span> <span class="nn">torch.utils.hooks</span> <span class="kn">import</span> <span class="n">RemovableHandle</span>
<span class="kn">from</span> <span class="nn">typing_extensions</span> <span class="kn">import</span> <span class="n">Self</span>

<span class="kn">from</span> <span class="nn">.contexts.Conditional</span> <span class="kn">import</span> <span class="n">Conditional</span>

<span class="kn">from</span> <span class="nn">.</span> <span class="kn">import</span> <span class="n">util</span>
<span class="kn">from</span> <span class="nn">.contexts.Conditional</span> <span class="kn">import</span> <span class="n">Conditional</span>
<span class="kn">from</span> <span class="nn">.tracing</span> <span class="kn">import</span> <span class="n">protocols</span>
<span class="kn">from</span> <span class="nn">.tracing.Graph</span> <span class="kn">import</span> <span class="n">Graph</span>
<span class="kn">from</span> <span class="nn">.tracing.Node</span> <span class="kn">import</span> <span class="n">Node</span>
Expand Down Expand Up @@ -724,7 +723,9 @@ <h1>Source code for nnsight.intervention</h1><div class="highlight"><pre>

<span class="k">return</span> <span class="nb">super</span><span class="p">()</span><span class="o">.</span><span class="fm">__getattr__</span><span class="p">(</span><span class="s2">&quot;shape&quot;</span><span class="p">)</span>

<span class="k">return</span> <span class="n">util</span><span class="o">.</span><span class="n">apply</span><span class="p">(</span><span class="bp">self</span><span class="o">.</span><span class="n">node</span><span class="o">.</span><span class="n">proxy_value</span><span class="p">,</span> <span class="k">lambda</span> <span class="n">x</span><span class="p">:</span> <span class="n">x</span><span class="o">.</span><span class="n">shape</span><span class="p">,</span> <span class="n">torch</span><span class="o">.</span><span class="n">Tensor</span><span class="p">)</span>
<span class="k">return</span> <span class="n">util</span><span class="o">.</span><span class="n">apply</span><span class="p">(</span>
<span class="bp">self</span><span class="o">.</span><span class="n">node</span><span class="o">.</span><span class="n">proxy_value</span><span class="p">,</span> <span class="k">lambda</span> <span class="n">x</span><span class="p">:</span> <span class="n">x</span><span class="o">.</span><span class="n">shape</span><span class="p">,</span> <span class="n">torch</span><span class="o">.</span><span class="n">Tensor</span>
<span class="p">)</span>

<span class="nd">@property</span>
<span class="k">def</span> <span class="nf">device</span><span class="p">(</span><span class="bp">self</span><span class="p">)</span> <span class="o">-&gt;</span> <span class="n">Collection</span><span class="p">[</span><span class="n">torch</span><span class="o">.</span><span class="n">device</span><span class="p">]:</span>
Expand All @@ -743,7 +744,9 @@ <h1>Source code for nnsight.intervention</h1><div class="highlight"><pre>

<span class="k">return</span> <span class="nb">super</span><span class="p">()</span><span class="o">.</span><span class="fm">__getattr__</span><span class="p">(</span><span class="s2">&quot;device&quot;</span><span class="p">)</span>

<span class="k">return</span> <span class="n">util</span><span class="o">.</span><span class="n">apply</span><span class="p">(</span><span class="bp">self</span><span class="o">.</span><span class="n">node</span><span class="o">.</span><span class="n">proxy_value</span><span class="p">,</span> <span class="k">lambda</span> <span class="n">x</span><span class="p">:</span> <span class="n">x</span><span class="o">.</span><span class="n">device</span><span class="p">,</span> <span class="n">torch</span><span class="o">.</span><span class="n">Tensor</span><span class="p">)</span>
<span class="k">return</span> <span class="n">util</span><span class="o">.</span><span class="n">apply</span><span class="p">(</span>
<span class="bp">self</span><span class="o">.</span><span class="n">node</span><span class="o">.</span><span class="n">proxy_value</span><span class="p">,</span> <span class="k">lambda</span> <span class="n">x</span><span class="p">:</span> <span class="n">x</span><span class="o">.</span><span class="n">device</span><span class="p">,</span> <span class="n">torch</span><span class="o">.</span><span class="n">Tensor</span>
<span class="p">)</span>

<span class="nd">@property</span>
<span class="k">def</span> <span class="nf">dtype</span><span class="p">(</span><span class="bp">self</span><span class="p">)</span> <span class="o">-&gt;</span> <span class="n">Collection</span><span class="p">[</span><span class="n">torch</span><span class="o">.</span><span class="n">device</span><span class="p">]:</span>
Expand All @@ -762,7 +765,9 @@ <h1>Source code for nnsight.intervention</h1><div class="highlight"><pre>

<span class="k">return</span> <span class="nb">super</span><span class="p">()</span><span class="o">.</span><span class="fm">__getattr__</span><span class="p">(</span><span class="s2">&quot;dtype&quot;</span><span class="p">)</span>

<span class="k">return</span> <span class="n">util</span><span class="o">.</span><span class="n">apply</span><span class="p">(</span><span class="bp">self</span><span class="o">.</span><span class="n">node</span><span class="o">.</span><span class="n">proxy_value</span><span class="p">,</span> <span class="k">lambda</span> <span class="n">x</span><span class="p">:</span> <span class="n">x</span><span class="o">.</span><span class="n">dtype</span><span class="p">,</span> <span class="n">torch</span><span class="o">.</span><span class="n">Tensor</span><span class="p">)</span></div>
<span class="k">return</span> <span class="n">util</span><span class="o">.</span><span class="n">apply</span><span class="p">(</span>
<span class="bp">self</span><span class="o">.</span><span class="n">node</span><span class="o">.</span><span class="n">proxy_value</span><span class="p">,</span> <span class="k">lambda</span> <span class="n">x</span><span class="p">:</span> <span class="n">x</span><span class="o">.</span><span class="n">dtype</span><span class="p">,</span> <span class="n">torch</span><span class="o">.</span><span class="n">Tensor</span>
<span class="p">)</span></div>



Expand Down Expand Up @@ -969,7 +974,9 @@ <h1>Source code for nnsight.intervention</h1><div class="highlight"><pre>

<span class="c1"># Updates the count of intervention node calls.</span>
<span class="c1"># If count matches call_iter, time to inject value into node.</span>
<span class="k">if</span> <span class="n">call_iter</span> <span class="o">!=</span> <span class="n">intervention_handler</span><span class="o">.</span><span class="n">count</span><span class="p">(</span><span class="n">intervention_node_name</span><span class="p">):</span>
<span class="k">if</span> <span class="n">call_iter</span> <span class="o">!=</span> <span class="n">intervention_handler</span><span class="o">.</span><span class="n">count</span><span class="p">(</span>
<span class="n">intervention_node_name</span>
<span class="p">):</span>

<span class="k">continue</span>

Expand Down
4 changes: 2 additions & 2 deletions public/_modules/nnsight/models/LanguageModel/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -54,8 +54,8 @@

<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<link href="../../../../_static/css/custom.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/home.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/custom.css?v=1725048340" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/home.css?v=1725048340" rel="stylesheet" type="text/css" />

</head>

Expand Down
4 changes: 2 additions & 2 deletions public/_modules/nnsight/models/NNsightModel/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -54,8 +54,8 @@

<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<link href="../../../../_static/css/custom.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/home.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/custom.css?v=1725048340" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/home.css?v=1725048340" rel="stylesheet" type="text/css" />

</head>

Expand Down
4 changes: 2 additions & 2 deletions public/_modules/nnsight/models/UnifiedTransformer/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -54,8 +54,8 @@

<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<link href="../../../../_static/css/custom.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/home.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/custom.css?v=1725048340" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/home.css?v=1725048340" rel="stylesheet" type="text/css" />

</head>

Expand Down
4 changes: 2 additions & 2 deletions public/_modules/nnsight/patching/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -54,8 +54,8 @@

<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<link href="../../../_static/css/custom.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../_static/css/home.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../_static/css/custom.css?v=1725048340" rel="stylesheet" type="text/css" />
<link href="../../../_static/css/home.css?v=1725048340" rel="stylesheet" type="text/css" />

</head>

Expand Down
4 changes: 2 additions & 2 deletions public/_modules/nnsight/schema/Config/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -54,8 +54,8 @@

<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<link href="../../../../_static/css/custom.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/home.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/custom.css?v=1725048340" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/home.css?v=1725048340" rel="stylesheet" type="text/css" />

</head>

Expand Down
4 changes: 2 additions & 2 deletions public/_modules/nnsight/schema/Response/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -54,8 +54,8 @@

<meta name="viewport" content="width=device-width, initial-scale=1"/>
<meta name="docsearch:language" content="en"/>
<link href="../../../../_static/css/custom.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/home.css?v=1725036146" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/custom.css?v=1725048340" rel="stylesheet" type="text/css" />
<link href="../../../../_static/css/home.css?v=1725048340" rel="stylesheet" type="text/css" />

</head>

Expand Down
Loading

0 comments on commit 541182f

Please sign in to comment.