Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add the blog post #242

Draft
wants to merge 7 commits into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
38 changes: 38 additions & 0 deletions _posts/2024-12-18-NeurIPS-2024-acoustics.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
---
date: 2024-12-18 9:00:00-7:00:00
description: null
featuredImage: assets/acoustic_species_id/2024_12_18_NeurIPS_Poster.jpg
author: Sean Perry and Ludwig von Schoenfeldt
layout: blog-post
slug: /acoustics-at-neurips-2024
title: Acoustic Species ID goes to NeurIPS 2024!
categories:
- news-and-updates
tags:
- acoustic-species-id
- bioacoustics
---

Our work, "A Deep Learning Approach to the Automated Segmentation of Bird Vocalizations from Weakly Labeled Crowd-sourced Audio" was accepted and presented at NeurIPS 2024 in the "Tackling Climate Change with Machine Learning" Workshop hosted by Climate Change AI! Congrats to the authors: Jacob Ayers, Sean Perry, Samantha Prestrelski, Tianqi Zhang, Ludwig von Schoenfeldt, Mugen Blue, Gabriel Steinberg, Mathias Tobler, Ian Ingram, Curt Schurgers and Ryan Kastner.

{% include
img_caption.html
src="assets/acoustic_species_id/2024_12_18_NeurIPS_Canda_Place.jpg"
caption="View of Canada Place, an iconic landmark of Vancouver. View taken from the east side of the Vancouver Convention Center. The conference actually took place in both buildings with an underground tunnel connecting the two, as seen on the bottom right of the image. Taken by Sean Perry"
%}

This focused on the issue of weakly labeled datasets, often associated with large, crowdsourced bioacoustic datasets. Traditional methods frequently use approaches rooted in digital signal processing to identify the species of interest. The paper takes a look at testing these methods with deep learning models. It can be found [here](https://www.climatechange.ai/papers/neurips2024/8). Credits to **Mathias Tobler** for first conceptualizing the idea.

Key contributions to this work include [PyHa](https://github.com/UCSD-E4E/pyha), the Python repository where the main technologies used in the paper are stored. Credits primarily to **Jacob Ayers** for creating the repo and for his vision of the project and **Samantha Prestrelski** for developing it and carrying out experiments. Further thanks to **Gabriel Steinberg** for his technical contributions with isolation techniques and chunking methods and **Mugen Blue** for his training of TweetyNet, which was the most successful method used (as seen in the paper).

Shout out to **Sean Perry** for developing [Pyrenote](https://github.com/UCSD-E4E/Pyrenote), the tool used to label the data used in the project.

Last week, **Sean Perry** and **Ludwig von Schoenfeldt** attended NeurIPS 2024 and presented the work! The two traveled out of the country to Vancouver, Canada to attend most of the conference, getting to see hundreds of posters, amazing research in machine learning, and present their own work! It was an inspiring moment getting to see where the future of the field could be heading.

Acoustic Species is planning many exciting extensions to this work. We will continue to evalute how these methods may influence the behavior of upstream models as we continue to work to improve bioacoustic machine learning techinques to identify species of interest.

{% include
img_caption.html
src="assets/acoustic_species_id/2024_12_18_NeurIPS_North_Vancover.jpg"
caption="View of North Vancouver, taken from the west side of Canada Place looking northwest. The previous day was raining and the storm had started to move on north, appearing over the valleys of the mountains and the ski resorts. Taken by Sean Perry"
%}
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading