12
Driving Collaboration in Calcium Imaging with NWB Ben Dichter Ripple U19, Soltesz Lab, Stanford University

Ripple U19, Soltesz Lab, Stanford University Ben Dichter ... · Behavior Stimuli Neurophysiology Data Sharing and Archiving Analysis and Visualization Experimental Metadata. NWB schema:

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Ripple U19, Soltesz Lab, Stanford University Ben Dichter ... · Behavior Stimuli Neurophysiology Data Sharing and Archiving Analysis and Visualization Experimental Metadata. NWB schema:

Driving Collaboration in Calcium Imaging with NWBBen DichterRipple U19, Soltesz Lab, Stanford University

Page 2: Ripple U19, Soltesz Lab, Stanford University Ben Dichter ... · Behavior Stimuli Neurophysiology Data Sharing and Archiving Analysis and Visualization Experimental Metadata. NWB schema:

Facilitating collaboration within a U19

Soltesz Lab(simulation)

Buzsaki Lab(electrophysiology)

Schnitzer Lab(optical physiology)

Losonczy Lab(optical physiology)

Data science tools:StandardsStorageAnalysis

Challenges:

- Different imaging modalities

- Different programming languages

- Different regions

Microcosm of data sharing in systems neuroscience

Page 3: Ripple U19, Soltesz Lab, Stanford University Ben Dichter ... · Behavior Stimuli Neurophysiology Data Sharing and Archiving Analysis and Visualization Experimental Metadata. NWB schema:

The same problems at a larger scale

Soltesz Lab(simulation)

Buzsaki Lab(electrophysiology)

Schnitzer Lab(optical physiology)

Losonczy Lab(optical physiology)

Ripple U19\

\

\

Data science tools:StandardsStorageAnalysis

\

Page 4: Ripple U19, Soltesz Lab, Stanford University Ben Dichter ... · Behavior Stimuli Neurophysiology Data Sharing and Archiving Analysis and Visualization Experimental Metadata. NWB schema:

Optical Physiology

Extracellular Electrophysiology

Intracellular Electrophysiology

Behavior

Stimuli

Neurophysiology Data

Sharing and Archiving

Analysis and Visualization

Experimental Metadata

Page 5: Ripple U19, Soltesz Lab, Stanford University Ben Dichter ... · Behavior Stimuli Neurophysiology Data Sharing and Archiving Analysis and Visualization Experimental Metadata. NWB schema:

NWB schema: data storage rules

I/O tools (PyNWB, MatNWB): rule enforcement

Analysis and visualization: utilizes rules

Ecosystem around NWB Standard

Page 6: Ripple U19, Soltesz Lab, Stanford University Ben Dichter ... · Behavior Stimuli Neurophysiology Data Sharing and Archiving Analysis and Visualization Experimental Metadata. NWB schema:

Standards: NWB for Calcium Imaging

- Standard for acquired images as well as processed intermediates (motion correction, ROIs, DF/F, deconvolved spikes)

- Support for 3D imaging, including 3D ROIs

- Flexible: supports multiple channels, planes, segmentation schemes, etc.

- Add new data types through extensions

- Interchangeable APIs supported in python and MATLAB

- NWBWidgets: Interactive visualization of data objects

Page 7: Ripple U19, Soltesz Lab, Stanford University Ben Dichter ... · Behavior Stimuli Neurophysiology Data Sharing and Archiving Analysis and Visualization Experimental Metadata. NWB schema:

Storage: Compression

- Data size becoming major bottleneck- Esp. SCAPE microscopy, at

2GB/sec- Advanced HDF5 I/O features allow for

chunking and compression- Optimization between size, write time,

read time portability- Light preprocessing can make a big

difference

Need to think about lossy compression like PCA

Page 8: Ripple U19, Soltesz Lab, Stanford University Ben Dichter ... · Behavior Stimuli Neurophysiology Data Sharing and Archiving Analysis and Visualization Experimental Metadata. NWB schema:

Storage: DANDI Archive

Working with DANDI team to host data publicly

- Infrastructure to support large data files

- Meta-data that facilitates searching

- Integrate visualization for exploration

Page 9: Ripple U19, Soltesz Lab, Stanford University Ben Dichter ... · Behavior Stimuli Neurophysiology Data Sharing and Archiving Analysis and Visualization Experimental Metadata. NWB schema:

Analysis: NWB Integration with CaImAn

- Calcium Imaging Analysis (CaImAn) is a popular pipeline for analysis of large-scale calcium imaging data

- We have worked with the CaImAn team to integrate with NWB

- Reads and writes acquired and processed data

- Imports into new QC GUI

Page 10: Ripple U19, Soltesz Lab, Stanford University Ben Dichter ... · Behavior Stimuli Neurophysiology Data Sharing and Archiving Analysis and Visualization Experimental Metadata. NWB schema:

Generalizing NWB support for optical physiology

Page 11: Ripple U19, Soltesz Lab, Stanford University Ben Dichter ... · Behavior Stimuli Neurophysiology Data Sharing and Archiving Analysis and Visualization Experimental Metadata. NWB schema:

Comparing spike sorters

Alessio P. Buccino, Cole L. Hurwitz, et al. bioRxiv. 2019.

Page 12: Ripple U19, Soltesz Lab, Stanford University Ben Dichter ... · Behavior Stimuli Neurophysiology Data Sharing and Archiving Analysis and Visualization Experimental Metadata. NWB schema:

Questions

- How can we decide what meta-data is essential across tools?

- What is the best way to connect tools, through a data format or through a common API?

- Can we come to an agreement about the phases of analysis and how different tools fit into them?

- How should we compare across tools?