Skip to content

Commit

Permalink
correct
Browse files Browse the repository at this point in the history
  • Loading branch information
范丞德 committed Oct 18, 2024
1 parent 849b020 commit b213ace
Show file tree
Hide file tree
Showing 6 changed files with 47 additions and 3 deletions.
27 changes: 26 additions & 1 deletion spectromotion/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -202,7 +202,7 @@ <h3>
<h3>
Pipeline
</h3>
<image src="img/overview_combined.png" width=90% style="display: block; margin: auto;"></image>
<image src="img/overview_combined.png" width=100% style="display: block; margin: auto;"></image>
<p class="text-justify">
(a) We optimize a NeRF to minimize a reconstruction loss \(\mathcal{L}_\mathrm{recon}\) between renderings and a few input images, as well as a sample loss \(\mathcal{L}_\mathrm{sample}\) between a rendering from a random pose and an image predicted by a diffusion model for that pose. (b) To generate the sample image, we use a PixelNeRF-style model to fuse information from the input images and to render a predicted feature map corresponding to the sample view camera pose. (c) This feature map is concatenated with the noisy latent (computed from the current NeRF rendering at that pose) and is provided to a diffusion model, which additionally uses CLIP embeddings of the input images via cross-attention. The resulting decoded output sample is used to enforce an image-space loss on the corresponding NeRF rendering (\(\mathcal{L}_\mathrm{sample}\)).
</p>
Expand Down Expand Up @@ -326,7 +326,32 @@ <h3>
</div>
</div>
</div>

<br>
<div class="row">
<div class="col-md-8 col-md-offset-2">
<h3>
Ablation study on coarse-to-fine and losses.
</h3><br>

<div class="text-center ">
<ul class="nav nav-pills center-pills">
<li class="method-pill active" data-value="coarse"
onclick="selectCompVideo(this)"><a>w/o coarse-to-fine</a></li>
<li class="method-pill" data-value="normal"
onclick="selectCompVideo(this)"><a>w/o normal loss</a></li>
<li class="method-pill" data-value="reg"
onclick="selectCompVideo(this)"><a>w/o regularization loss</a></li>
<li class="method-pill" data-value="gamma"
onclick="selectCompVideo(this)"><a>w/o gamma</a></li>
</ul>
</div>

<script>
selectCompVideoAblation = document.querySelector('.method-pill.active-pill');
</script>
</div>
</div>
<br>

<div class="row">
Expand Down
23 changes: 21 additions & 2 deletions spectromotion/js/app.js
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@ var activeScenePill = null;
var activeModePill = null;
var activeVidID = 0;
var select = false;
var activeMethodPillAblation = null;


$(document).ready(function () {
Expand All @@ -19,6 +20,7 @@ $(document).ready(function () {
activeMethodPill = $('.method-pill').filter('.active')[0];
activeModePill = $('.mode-pill').filter('.active')[0];
activeScenePill = $('.scene-pill').filter('.active')[0];
activeMethodPillAblation = $('.method-pill').filter('.active')[0];

resizeAndPlay($('#sparsity')[0]);
});
Expand Down Expand Up @@ -62,7 +64,24 @@ function selectCompVideo(methodPill, scenePill, n_views, modePill) {
video_active.src = "videos/comparison/" + pill + "_" + method + "_vs_ours_" + mode + ".mp4";
video_active.load();

if (n_views) {
viewNum.innerHTML = n_views;
}

function selectCompVideoAblation(methodPillAblation) {
// Your existing logic for video selection
// var video = document.getElementById("compVideo");
select = true;
var videoSwitch = document.getElementById("compVideoSwitch");
var viewNum = document.getElementById("compVideoValue");

if (activeMethodPillAblation) {
activeMethodPillAblation.classList.remove("active");
}

activeMethodPillAblation = methodPillAblation;
methodPillAblation.classList.add("active");
method = methodPillAblation.getAttribute("data-value");

video_active.src = "videos/comparison/" + method + "_vs_ours_rgb.mp4";
video_active.load();

}
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.

0 comments on commit b213ace

Please sign in to comment.