Skip to content

Commit

Permalink
update project page
Browse files Browse the repository at this point in the history
  • Loading branch information
yumin kim committed Jul 19, 2024
1 parent ac3c2bd commit 7d0458b
Show file tree
Hide file tree
Showing 61 changed files with 15 additions and 138 deletions.
14 changes: 1 addition & 13 deletions cxrl2024/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -986,19 +986,7 @@ <h4 class="title is-4 has-text-centered">Pipeline</h4>
<div class="content has-text-justified">
<img src="./static/images/overview.png" alt="Main figure">
<br>
<p>
The pipeline of <i>CXRL</i>.
Our model employs policy gradient optimization utilizing multi-reward feedback, fine-tuning image generator, and ACE to produce realistic and accurate CXR that corresponds closely to the input report.
<br>
<b>Contribution</b>
<br>
<ul>
<li>Our study pioneers in applying RL to text-conditioned medical image synthesis, particularly in CXRs, focusing on detail refinement and input condition control for clinical accuracy.</li>
<li>We advance report-to-CXR generation with an RLCF-based rewarding mechanism, emphasizing posture alignment, pathology accuracy, and consistency between input reports and generated CXRs.</li>
<li>We jointly optimize the image generator and ACE via reward feedback models, ensuring image-text alignment and medical accuracy across varied reports, setting a new benchmark in a report-to-CXR generation.</li>
</ul>
</p>
</div>


<br>
<h4 class="title is-4 has-text-centered">Reward Feedback Models</h4>
Expand Down
139 changes: 14 additions & 125 deletions petite2024/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -883,7 +883,7 @@ <h1 class="title is-2 publication-title">
</a>
</span>
<span class="link-block">
<a href=""
<a href="https://arxiv.org/pdf/2407.07517"
class="external-link button is-normal is-rounded is-dark">
<span class="icon">
<i class="ai ai-arxiv"></i>
Expand All @@ -893,7 +893,7 @@ <h1 class="title is-2 publication-title">
</span>
<!-- Code Link. -->
<span class="link-block">
<a href=""
<a href="https://github.com/MICV-yonsei/PETITE"
class="external-link button is-normal is-rounded is-dark">
<span class="icon">
<i class="fab fa-github"></i>
Expand Down Expand Up @@ -1099,117 +1099,6 @@ <h4 class="title is-4 has-text-centered">UNETR</h4>
</div>
</section>


<!-- <section class="section">
<div class="container is-max-desktop">
<div class="columns is-centered">
<div class="column is-four-fifths">
<h3 class="title is-3 has-text-centered">Qualitative Results</h3>
<br>
<h4 class="title is-4 has-text-centered">COCO-Stuff</h4>
<section class="hero is-light is-small">
<div class="slideContent">
<div style="width: 100%;">
<div id="results-carousel" class="carousel results-carousel">
<div class="">
<div class="content has-text-centered">
<img src="./static/images/coco1.png" alt="Coco figure">
</div>
</div>
<div class="">
<div class="content has-text-centered">
<img src="./static/images/coco2.png" alt="Coco figure">
</div>
</div>
<div class="">
<div class="content has-text-centered">
<img src="./static/images/coco3.png" alt="Coco figure">
</div>
</div>
<div class="">
<div class="content has-text-centered">
<img src="./static/images/coco4.png" alt="Coco figure">
</div>
</div>
<div class="">
<div class="content has-text-centered">
<img src="./static/images/coco5.png" alt="Coco figure">
</div>
</div>
</div>
</div>
</div>
<div class="content has-text-centered">
<img src="./static/images/labels_coco.png" alt="Coco label">
</div>
</section>
<div class="content has-text-centered">
<p>
Qualitative results of COCO-Stuff dataset trained with ViT-S/8 backbone.
</p>
</div>
<br>
<h4 class="title is-4 has-text-centered">Cityscapes</h4>
<section class="hero is-light is-small">
<div class="slideContent">
<div style="width: 100%;">
<div id="results-carousel" class="carousel results-carousel">
<div class="">
<div class="content has-text-centered">
<img src="./static/images/city1.png" alt="City figure">
</div>
</div>
<div class="">
<div class="content has-text-centered">
<img src="./static/images/city2.png" alt="City figure">
</div>
</div>
<div class="">
<div class="content has-text-centered">
<img src="./static/images/city3.png" alt="City figure">
</div>
</div>
<div class="">
<div class="content has-text-centered">
<img src="./static/images/city4.png" alt="City figure">
</div>
</div>
</div>
</div>
</div>
<div class="content has-text-centered">
<img src="./static/images/labels_city.png" alt="Coco label">
</div>
</section>
<div class="content has-text-centered">
<p>
Qualitative results of Cityscapes dataset trained with ViT-B/8 backbone.
</p>
</div>
<br>
<h4 class="title is-4 has-text-centered">Potsdam-3</h4>
<section class="hero is-light is-small">
<div class="content has-text-centered">
<img src="./static/images/potsdam.png" alt="Potsdam supplymentary visualization">
</div>
</section>
<div class="content has-text-centered">
<p>
Qualitative results of Potsdam-3 dataset trained with ViT-B/8 backbone.
</p>
</div>
</div>
</div>
</div>
</section> -->


<section class="section">
<div class="container is-max-desktop">
<div class="columns is-centered">
Expand All @@ -1221,13 +1110,13 @@ <h3 class="title is-3 has-text-centered">Quantitative Main Results</h3>
<div class="column">
<!-- <h4 class="title is-4 has-text-centered">3D CVT-GAN</h4> -->
<div class="content has-text-centered">
<img src="./static/petite_images/main_cvt_result.png" alt="cocostuff table" width="100%">
<img src="./static/petite_images/main_result.png" alt="cocostuff table" width="100%">
</div>
</div>
<div class="column">
<!-- <div class="column"> -->
<!-- <h4 class="title is-4 has-text-centered">UNETR</h4> -->
<div class="content has-text-centered">
<img src="./static/petite_images/main_unetr_result.png" alt="cocostuff table" width="100%">
<!-- <div class="content has-text-centered"> -->
<!-- <img src="./static/petite_images/main_unetr_result.png" alt="cocostuff table" width="100%"> -->
</div>
</div>
</div>
Expand Down Expand Up @@ -1255,19 +1144,19 @@ <h3 class="title is-3 has-text-centered">Ablation Results</h3>
<div class="column">
<!-- <h4 class="title is-4 has-text-centered">3D CVT-GAN</h4> -->
<div class="content has-text-centered">
<img src="./static/petite_images/ablation_cvt.png" alt="cocostuff table" width="100%">
<img src="./static/petite_images/ablation.png" alt="cocostuff table" width="100%">
</div>
</div>
<div class="column">
<!-- <div class="column"> -->
<!-- <h4 class="title is-4 has-text-centered">UNETR</h4> -->
<div class="content has-text-centered">
<img src="./static/petite_images/ablation_unetr.png" alt="cocostuff table" width="100%">
<!-- <div class="content has-text-centered"> -->
<!-- <img src="./static/petite_images/ablation_unetr.png" alt="cocostuff table" width="100%"> -->
</div>
</div>
</div>
<div class="content has-text-centered">
<p>
Comparison with experimental with BitFit. <br>
Optimal Mix-PEFT (Ours) outperforms each PEFT method with or without BitFit. <br>
<i>Best</i> : <strong>Bold</strong>; <i>Second best</i> : <u>Underline</u>.
</p>
</div>
Expand Down Expand Up @@ -1302,7 +1191,7 @@ <h4 class="title is-4 has-text-centered">Scanner Specifications</h4>
<div class="column">
<h4 class="title is-4 has-text-centered">Computation costs of PEFT methods</h4>
<div class="content has-text-centered">
<img src="./static/petite_images/computational_cost.png" alt="cocostuff table" width="100%">
<img src="./static/petite_images/computation.png" alt="cocostuff table" width="100%">
</div>
</div>

Expand Down Expand Up @@ -1331,13 +1220,13 @@ <h3 class="title is-3 has-text-centered">21 Feasible Experimental Mix-PEFT with
<div class="column is-half">
<h4 class="title is-4 has-text-centered">3D CVT-GAN</h4>
<div class="content has-text-centered">
<img src="./static/petite_images/mix_peft_cvt.png" alt="cocostuff table" width="100%">
<img src="./static/petite_images/supple_cvt.png" alt="cocostuff table" width="100%">
</div>
</div>
<div class="column is-half">
<h4 class="title is-4 has-text-centered">UNETR</h4>
<div class="content has-text-centered">
<img src="./static/petite_images/mix_peft_unetr.png" alt="cocostuff table" width="100%">
<img src="./static/petite_images/supple_unetr.png" alt="cocostuff table" width="100%">
</div>
</div>
</div>
Expand Down
Binary file removed petite2024/static/images/1st.png
Binary file not shown.
Binary file removed petite2024/static/images/1st_a.png
Binary file not shown.
Binary file removed petite2024/static/images/1st_b.png
Binary file not shown.
Binary file removed petite2024/static/images/city1.png
Binary file not shown.
Binary file removed petite2024/static/images/city2.png
Binary file not shown.
Binary file removed petite2024/static/images/city3.png
Binary file not shown.
Binary file removed petite2024/static/images/city4.png
Binary file not shown.
Binary file removed petite2024/static/images/city_supply.png
Binary file not shown.
Binary file removed petite2024/static/images/coco.png
Binary file not shown.
Binary file removed petite2024/static/images/coco1.png
Binary file not shown.
Binary file removed petite2024/static/images/coco2.png
Binary file not shown.
Binary file removed petite2024/static/images/coco3.png
Binary file not shown.
Binary file removed petite2024/static/images/coco4.png
Binary file not shown.
Binary file removed petite2024/static/images/coco5.png
Binary file not shown.
Binary file removed petite2024/static/images/coco_supply.png
Binary file not shown.
Binary file removed petite2024/static/images/eagle_emoji.png
Binary file not shown.
Binary file removed petite2024/static/images/eicue1.png
Binary file not shown.
Binary file removed petite2024/static/images/eicue2.png
Binary file not shown.
Binary file removed petite2024/static/images/eicue3.png
Binary file not shown.
Binary file removed petite2024/static/images/eicue4.png
Binary file not shown.
Binary file removed petite2024/static/images/eicue5.png
Binary file not shown.
Binary file removed petite2024/static/images/eicue6.png
Binary file not shown.
Binary file removed petite2024/static/images/eicue7.png
Binary file not shown.
Binary file removed petite2024/static/images/eicue8.png
Binary file not shown.
Binary file removed petite2024/static/images/eicue9.png
Binary file not shown.
Binary file removed petite2024/static/images/eigen_map.png
Diff not rendered.
Binary file removed petite2024/static/images/eigen_map_supply.png
Diff not rendered.
Binary file removed petite2024/static/images/eigenmodule.png
Diff not rendered.
Binary file removed petite2024/static/images/eigenvector.png
Diff not rendered.
Binary file removed petite2024/static/images/eigenvector_supply.png
Diff not rendered.
Binary file removed petite2024/static/images/labels_city.png
Diff not rendered.
Binary file removed petite2024/static/images/labels_coco.png
Diff not rendered.
Binary file removed petite2024/static/images/mainfigure.png
Diff not rendered.
Binary file removed petite2024/static/images/potsdam.png
Diff not rendered.
Binary file removed petite2024/static/images/table_city.png
Diff not rendered.
Binary file removed petite2024/static/images/table_coco.png
Diff not rendered.
Binary file removed petite2024/static/images/table_potsdam.png
Diff not rendered.
Binary file removed petite2024/static/images/tag_hp.png
Diff not rendered.
Binary file removed petite2024/static/images/tag_img.png
Diff not rendered.
Binary file removed petite2024/static/images/tag_label.png
Diff not rendered.
Binary file removed petite2024/static/images/tag_ours.png
Diff not rendered.
Binary file removed petite2024/static/images/tag_stego.png
Diff not rendered.
Binary file removed petite2024/static/images/tags_coco.png
Diff not rendered.
Binary file removed petite2024/static/images/vector1.png
Diff not rendered.
Binary file removed petite2024/static/images/vector2.png
Diff not rendered.
Binary file removed petite2024/static/images/vector3.png
Diff not rendered.
Binary file removed petite2024/static/images/vector4.png
Diff not rendered.
Binary file removed petite2024/static/images/vector5.png
Diff not rendered.
Binary file removed petite2024/static/images/vector6.png
Diff not rendered.
Binary file removed petite2024/static/images/vector7.png
Diff not rendered.
Binary file removed petite2024/static/images/vector8.png
Diff not rendered.
Binary file removed petite2024/static/images/vector9.png
Diff not rendered.
Binary file added petite2024/static/petite_images/ablation.png
Binary file added petite2024/static/petite_images/computation.png
Diff not rendered.
Binary file added petite2024/static/petite_images/main_result.png
Binary file added petite2024/static/petite_images/supple_cvt.png
Binary file added petite2024/static/petite_images/supple_unetr.png
Binary file added petite2024/static/petite_images/table2.png

0 comments on commit 7d0458b

Please sign in to comment.