Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Origin/decoding #803

Open
wants to merge 253 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 250 commits
Commits
Show all changes
253 commits
Select commit Hold shift + click to select a range
692cbc9
area/depth added to umap code
Jun 17, 2020
32f46d3
adding plane_index to all_sess; adding pca explained variance; reorga…
Jun 19, 2020
5df1973
umap/pca: removing plane_index; the implementation based on unique de…
Jun 19, 2020
fc82dd4
adding iamge-change df, running speed, image names to load file, to u…
Jun 20, 2020
b965482
empty init file
matchings Jun 25, 2020
5d51c58
Merge remote-tracking branch 'origin/feature/update_response_analysis…
matchings Jun 25, 2020
af19af0
manual neuropil subtraction codes added
Jun 27, 2020
4cdd6c9
umap edits
Jun 27, 2020
9b34bfe
Merge branch 'feature/clustering' of https://github.com/AllenInstitut…
Jun 27, 2020
3fe6739
refactoring: new script for running umap and pca
Jun 29, 2020
046bf25
ignore weird file causing problems
matchings Jun 29, 2020
4447cef
Merge remote-tracking branch 'origin/feature/clustering' into feature…
matchings Jun 29, 2020
9c98aab
umap: try different parameters and plots
Jul 1, 2020
8273e2c
marina's clustering attempt codes added
Jul 1, 2020
c0f29e0
set dff and stim info for all sessions - allensdk
Jul 7, 2020
ea20640
marina's codes for clustering added
Jul 7, 2020
bbdbbf8
all_sess_dff_stim modified
Jul 8, 2020
c0a9b60
add notebook
matchings Jul 9, 2020
bed191c
umap: updates to notebook for creating metrics feature vector
Jul 9, 2020
b4f2b48
Merge remote-tracking branch 'origin/feature/clustering' into feature…
matchings Jul 10, 2020
76fbe7a
add updated notebook
matchings Jul 10, 2020
8df18b2
add try except to multi_session_metrics creation
matchings Jul 13, 2020
349ef75
umap and gmm codes added for the metrics feature matrix
Jul 21, 2020
af16f4c
umap gmm codes refactoring
Jul 21, 2020
622f431
using de-cross-talked dff traces for omission analysis
Jul 22, 2020
38ef990
svm codes updated for ct traces; some edits to omission population av…
Jul 23, 2020
38e6bba
scripts on the analysis computer added, related to crosstalk files, c…
Jul 23, 2020
0836983
svm pbs codes, minor changes
Jul 23, 2020
6177881
omit function: sections made clear; svm : edits
Jul 23, 2020
59d3a5d
svm init: job directory fixedgit status
Jul 23, 2020
3f47b3d
omission function: iomit (num omissions) fixed!
Jul 23, 2020
4887abb
pbs correlation codes edited for the cluster
Jul 31, 2020
9d197b4
bug with omit code; image surround omission
Aug 1, 2020
d345990
align traces on omissions for Akul
Aug 1, 2020
a6eab39
svm: std changed to sem for error bars; set_traces_active: bug fixed …
Aug 4, 2020
75b569f
summary of keras codes added
Aug 4, 2020
d848169
small edits
Aug 4, 2020
7a62671
population average: baseline computation: multiple methods tried; als…
Aug 6, 2020
445d5a1
notes file added about summary of correlation codes
Aug 7, 2020
3b417b5
doug and marina clustering notebooks
Aug 10, 2020
8956fb9
omission population average plotting edits
Aug 10, 2020
49a32db
umap, hdbscan clustering; svm weights saved
Aug 12, 2020
ca1df91
umap clusteirng notebooks
Aug 12, 2020
08e3220
Merge branch 'feature/update_response_analysis' into feature/clustering
matchings Aug 12, 2020
8d03fd0
adding notebooks
matchings Aug 12, 2020
a696d70
minor stuff
Aug 19, 2020
50259a3
bug fixes: image traces/peaks: some were nans, mean changed to nanmea…
Aug 20, 2020
9f4d2ac
histogram of depth and number of neurons for each planes; some other …
Aug 21, 2020
ff89bac
statistical tests added
Aug 25, 2020
cc17509
Merge branch 'master' into feature/clustering
Aug 25, 2020
0d21bf3
update QC session log
matchings Aug 25, 2020
3552b02
add function to get behavior model summary
matchings Aug 25, 2020
381e763
Merge remote-tracking branch 'origin/feature/clustering' into feature…
matchings Aug 25, 2020
451c911
old file committed
Sep 11, 2020
62516e3
Merge branch 'master' into feature/clustering
Sep 13, 2020
aa7cba0
minor
Sep 22, 2020
26d534a
Merge branch 'master' into feature/clustering
Sep 22, 2020
6045b46
minor
Sep 25, 2020
4eb8802
starting the image decoding analysis
Sep 28, 2020
5aa0f7a
edits
Sep 29, 2020
b06f07b
Merge remote-tracking branch 'origin/dev' into feature/clustering
Sep 29, 2020
e8c3f72
Merge remote-tracking branch 'origin/dev' into feature/clustering
Sep 30, 2020
609554f
Merge remote-tracking branch 'origin/dev' into feature/clustering
Sep 30, 2020
eb631ea
svm codes created for multi-class classification
Oct 8, 2020
97c80d0
svm images, taking care of cluster pbs
Oct 8, 2020
e5858f4
code added to get the entire list of 8 experiments for each session a…
Oct 9, 2020
ebeb1ea
Merge remote-tracking branch 'origin/master' into feature/clustering
Oct 9, 2020
2930991
taking care of pbs args
Oct 10, 2020
b60a712
minor
Oct 10, 2020
494d211
session number
Oct 10, 2020
9a2262d
svm decoding of images; post analysis; also codes set to take slc
Oct 15, 2020
d28f7c1
Merge remote-tracking branch 'origin/master' into feature/clustering
Oct 15, 2020
2551970
bug fix
Oct 15, 2020
1bfec3e
codes modified to analyze image expectation signal
Oct 15, 2020
20da886
edits
Oct 16, 2020
c1e1e6f
taking care of negative values of frames svm and several other changes
Oct 16, 2020
167c87a
svm images setting vars for plotting
Oct 20, 2020
bb5ef0c
merge
Oct 20, 2020
6839262
reformat.py copied from master
Oct 20, 2020
70e9fbd
plotting codes added for svm images
Oct 22, 2020
d4365b2
svm images codes editws
Oct 23, 2020
ea9cd39
important edits to svm main function; making it clear what's being de…
Oct 23, 2020
e89a971
bug fix
Oct 24, 2020
d661187
svm: important bug fix to image index of previous flash
Oct 24, 2020
481fe8a
minor
Oct 24, 2020
fe9b963
bug fix
Oct 24, 2020
0fcff47
big fix; code improvement; script rename
Oct 27, 2020
03e988f
minor
Oct 27, 2020
8eed02d
edits to svm images
Oct 30, 2020
9736c9d
minor
Oct 30, 2020
9d26a83
bug fixes to svm main code; finding overlapping rows of trials and st…
Nov 3, 2020
c603029
svm code: linking stimulus and trials dfs; adding image labels to the…
Nov 6, 2020
4e1f812
svm edits
Nov 16, 2020
6533736
correlation: control data resampled as in single beam mesoscope data
Nov 20, 2020
56ee593
bug fix
Nov 20, 2020
c4275be
correlation analysis: resample data to resemble single beam mesoscope…
Nov 24, 2020
97e2052
svm: block by block analysis codes added
Nov 25, 2020
04c23b8
using initial spontaneous frames to classify omissions against
Dec 5, 2020
bf3055a
svm block by block analysis codes for visualization
Dec 22, 2020
98a91b0
Merge branch 'dev' into feature/clustering
Dec 22, 2020
adefd4c
use events for svm
Dec 23, 2020
4e56158
svm fun: bug fixed for checking for the existence of all classes in t…
Dec 24, 2020
774e864
edits
Dec 24, 2020
9853e41
Merge branch 'dev' into feature/clustering
Dec 24, 2020
c61657c
svm plots codes updated to work with both whole session and block by …
Jan 19, 2021
d9aab82
fixing legend
Jan 19, 2021
d375867
Merge branch 'master' into feature/clustering
Jan 19, 2021
f99bba8
plotting codes updated ; minor
Jan 20, 2021
3f5f694
minor
Jan 20, 2021
60657d3
svm engagement analysis
Feb 8, 2021
ef1aebf
Merge branch 'master' into feature/clustering
Feb 8, 2021
3046f31
Merge branch 'dev' into feature/clustering
Feb 8, 2021
2060cc2
svm engagement
Feb 9, 2021
dc15992
Merge branch 'dev' into feature/clustering
Feb 9, 2021
b7bdaaf
svm engagement ready for clusgter
Feb 9, 2021
edd6c19
updating correlation codes to take the March 2021 data release sessio…
Feb 11, 2021
4490b8c
Merge branch 'dev' into feature/clustering
Feb 11, 2021
f878fc4
minor
Feb 11, 2021
957ed5d
correlation analysis; data release sessions
Feb 12, 2021
a8ea6d4
bug fix
Feb 12, 2021
d1bae65
bug fix
Feb 12, 2021
bb234f5
bug fix
Feb 12, 2021
b931372
svm engagement running the remaining experiments of that very long se…
Feb 12, 2021
58787bc
bug fixes
Feb 13, 2021
6355cbe
bug fixes + using allen sdk for stimulus table
Feb 16, 2021
269cda9
Merge branch 'dev' into feature/clustering
Feb 16, 2021
9da6e42
edits
Feb 16, 2021
78c2ecb
bug fix
Feb 16, 2021
f860547
bug fix
Feb 16, 2021
5b8cc47
setting mouse history code made much cleaner
Feb 17, 2021
0180ea4
multiscope paper; data release sessions included
Feb 22, 2021
2c0cbfc
Merge branch 'dev' into feature/clustering
Feb 22, 2021
2f8dd31
svm engagement image decoding
Mar 5, 2021
c8fa323
Merge branch 'dev' into feature/clustering
Mar 5, 2021
5f4ba13
svm engagement divided trials; pupil; running
Mar 6, 2021
301b08c
bug fix
Mar 6, 2021
e9fa736
svm pupil engagement image selectivity figure codes updated to take d…
Mar 9, 2021
05f0f22
minor
Mar 9, 2021
53013be
correlation; control single beam data; debug
Mar 9, 2021
cbc785c
svm decoding change vs no change
Mar 25, 2021
d5426d5
bug fix
Mar 25, 2021
6b603b3
svm plots image change vs no change
Mar 25, 2021
ffa7798
Merge branch 'dev' into feature/clustering
Mar 25, 2021
756f3cc
correlating svm image change vs no change with behavioral strategy
Mar 26, 2021
4776e83
Merge branch 'dev' into feature/clustering
Apr 2, 2021
60c0e36
svm decode hit vs miss
Apr 3, 2021
1f08e0f
svm: adding the option for balanced trials
Apr 9, 2021
1b1d182
Merge branch 'dev' into feature/clustering
Apr 9, 2021
93093b7
bug fix
Apr 9, 2021
29360e1
svm: use balanced trials for training and testing datasets
Apr 12, 2021
c9b359b
Merge branch 'dev' into feature/clustering
Apr 12, 2021
78ce588
minor
Apr 12, 2021
64676b7
Merge branch 'summary_update' into feature/clustering
Apr 12, 2021
06cadf1
minor
Apr 12, 2021
1683991
minor
Apr 12, 2021
ac33958
minor
Apr 13, 2021
54fac50
bug
Apr 13, 2021
8b0c9a8
bug fix
Apr 13, 2021
758ae03
svm plots: sumamry across ophys stages
Apr 14, 2021
61e8961
stats code added for anova and tukey; also making stat bars in the plots
Apr 15, 2021
29ae393
edits
Apr 16, 2021
225f3fd
weird thing about bool(sys arg); removing it
Apr 17, 2021
77abc00
bug fix with sys.argv bool str int
Apr 17, 2021
8f15c00
svm : engagement added to trials df; cell specimen id added to df
Apr 24, 2021
025a75f
svm: run the analysis on only engaged times
Apr 24, 2021
24c456d
behavior strategy correlation with neural activity; scientifica svm a…
May 4, 2021
70620e8
only engaged in svm bug fixed
May 6, 2021
269436c
scientifica: hit miss decoding
Jun 9, 2021
9d9c657
svm scientifica visualization codes updated
Jun 12, 2021
9dade46
svm plotting: reorganizing codes + combining scientifica and mesoscop…
Jun 15, 2021
76a90ea
svm plots: pooling scientifica and mesoscope
Jun 17, 2021
fc54011
mesoscope: anova and stats for correlations
Jun 24, 2021
a0ee033
svm: baseline vs non baseline decoding incorporated into the svm imag…
Jul 7, 2021
788cfc6
slurm codes added
Jul 7, 2021
7ca72a7
bugs
Jul 7, 2021
1f7bff3
slurm params
Jul 8, 2021
36481be
test
Jul 8, 2021
f5eed7b
slurm debut
Jul 8, 2021
f2beed9
slurm test
Jul 8, 2021
4c333e0
slurm test
Jul 8, 2021
79f2f90
slurm: bug fix
Jul 8, 2021
32b9ad0
slurm: bug fix
Jul 8, 2021
50e0dca
slurm bug fix
Jul 8, 2021
511a838
slurm bug fix
Jul 8, 2021
f657969
slurm fix
Jul 8, 2021
06aa1c5
bug fix
Jul 8, 2021
474fc67
bug
Jul 8, 2021
8d9a853
bug
Jul 8, 2021
feda334
bug
Jul 8, 2021
fbe9b6d
bug
Jul 8, 2021
805def3
final slurm!
Jul 8, 2021
2ba0c01
bug
Jul 8, 2021
85b7faf
svm gray omit changes to baseline nobaseline
Jul 8, 2021
980e507
svm runs for the paper
Jul 9, 2021
e364796
svm paper figures
Jul 9, 2021
6fd6ec0
svm plots
Jul 12, 2021
c8232e6
svm baseline decoding debugged engagement
Jul 22, 2021
1989707
Merge branch 'master' into feature/clustering
Jul 22, 2021
43fd32f
experiments table sorting debug
Jul 22, 2021
775d1b9
svm next image from omissions debugging ; num classes <8 when using e…
Jul 23, 2021
f60ecc4
svm plots area comparison
Aug 4, 2021
7261f7c
Merge branch 'master' into feature/clustering
Aug 4, 2021
a143021
svm: using matched cells
Aug 12, 2021
219964e
bug fixed
Aug 12, 2021
f74befa
svm plotting update
Aug 18, 2021
88717ab
Merge branch 'master' into feature/clustering
farznaj Aug 18, 2021
1459694
minor
farznaj Sep 23, 2021
ba81fcd
Merge branch 'master' into feature/clustering
farznaj Sep 23, 2021
0c8d46e
cell matching for decoding started
farznaj Sep 24, 2021
d5775b7
Merge branch 'master' into feature/clustering
farznaj Sep 30, 2021
26682d6
using the final final dataset; nwb files on aws
farznaj Oct 2, 2021
0403c5b
Merge branch 'master' into feature/clustering
farznaj Oct 2, 2021
b9a4cd2
marina s notebooks
farznaj Oct 5, 2021
fec999f
marina s notebooks
farznaj Oct 5, 2021
69b9d54
stuff
farznaj Oct 8, 2021
51c17ef
stuff
farznaj Oct 12, 2021
4356a61
Merge branch 'master' into feature/clustering
farznaj Oct 12, 2021
c29005e
svm matched cells edits started
farznaj Oct 14, 2021
6a73690
Merge branch 'master' into feature/clustering
farznaj Oct 14, 2021
605eb38
svm matched cells 3 decoding experience levels
farznaj Oct 15, 2021
3d7e8db
corrections for task 1B
farznaj Oct 15, 2021
b78c2e4
bug
farznaj Oct 18, 2021
071e9cc
important bug fixed
farznaj Oct 19, 2021
0d404a0
bugs fixed for mesoscope data related to matched cells
farznaj Oct 20, 2021
9fa5006
container id and experience level added to svm file; additional edits…
farznaj Oct 22, 2021
d4c7ddd
important edits; plotting based on experience level; proper svm resul…
farznaj Oct 29, 2021
2b1a3f3
final: svm plotting codes for comparing experience levels for the paper
farznaj Oct 30, 2021
f892143
experience level visualization codes
farznaj Nov 1, 2021
a63288c
svm plots; pooled project codes; time course of decoding; interpolation
farznaj Nov 14, 2021
c0fea0f
clean anova tukey created for alex
farznaj Nov 16, 2021
a128ef3
further cleaning of the code for alex
farznaj Nov 16, 2021
4602fe8
further cleaning of the code for alex; again
farznaj Nov 16, 2021
83c2f99
anova tukey code turned to a clean function
farznaj Nov 16, 2021
e187917
further cleaning
farznaj Nov 16, 2021
1702b4f
further commenting
farznaj Nov 16, 2021
0d48757
further edits
farznaj Nov 16, 2021
07f9385
add tukey lines function added
farznaj Nov 16, 2021
5591df0
multiscope paper: noise correlation distributions
farznaj Nov 20, 2021
2fcbb53
full population decoding
farznaj Jan 4, 2022
c2bc414
test code to debug hpc
farznaj Jan 7, 2022
d8e1bde
further hpc debugging
farznaj Jan 7, 2022
b61dfc6
still debugging
farznaj Jan 7, 2022
53a426b
svm decoding traces, plots with shaded ste added; also svm code debug…
farznaj Jan 14, 2022
7d0dec6
further testing debugging
farznaj Jan 14, 2022
f3bbb12
codes added to make svm comparison of area and depth plots
farznaj Feb 19, 2022
2204aca
Merge branch 'master' into feature/clustering
farznaj Feb 22, 2022
b1dce7b
multiscope paper; reviewer comments; correlation heatmaps on the same…
farznaj Feb 25, 2022
ba23b2c
edits
farznaj Feb 28, 2022
5bebced
preparing decoding codes for paper repo
farznaj Feb 28, 2022
5e38011
Merge branch 'master' into origin/decoding
farznaj Dec 2, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -71,3 +71,5 @@ figures/
.vscode/

\.DS_Store

visual_behavior/clustering/multiscope_fn/....
3,055 changes: 3,055 additions & 0 deletions notebooks/200713_create_metrics_array_for_clustering.ipynb

Large diffs are not rendered by default.

500 changes: 281 additions & 219 deletions notebooks/200928_get_data_for_decoding.ipynb

Large diffs are not rendered by default.

Loading