Machine Learning SIG: Difference between revisions

From MEG Core
Jump to navigation Jump to search
Content added Content deleted
Line 23: Line 23:
###Filtering Issues<ref>[https://www.sciencedirect.com/science/article/pii/S0165027021000157] High-pass filtering artifacts in multivariate classification of neural time
###Filtering Issues<ref>[https://www.sciencedirect.com/science/article/pii/S0165027021000157] High-pass filtering artifacts in multivariate classification of neural time
series data</ref>
series data</ref>
##Temporal Generalization <ref> Characterizing the dynamics of mental representations: the temporal generalization method - J-R.King, S.Dehaene </ref>
##Realtime - Brain computer interface / neurofeedback
##Realtime - Brain computer interface / neurofeedback
#Subject classification
#Subject classification
Line 32: Line 33:
##What signals predict recovery from traumatic brain injury
##What signals predict recovery from traumatic brain injury
##What signals predict poor outcome for epilepsy surgery
##What signals predict poor outcome for epilepsy surgery
#Multimodal Integration <ref>[https://www.sciencedirect.com/science/article/pii/S0896627320305183] A M/EEG-fMRI Fusion Primer: Resolving Human Brain Responses in Space and Time: Radoslaw M.Cichy Aude Oliva </ref>
#Multimodal Integration
##Timing derived from MEG / localization from fMRI <ref>[https://www.nature.com/articles/nn.3635] Resolving human object recognition in space and time: Radoslaw Martin Cichy, Dimitrios Pantazis & Aude Oliva Nature Neuroscience volume 17, pages455–462 (2014)</ref>
##Timing derived from MEG / localization from fMRI <ref>[https://www.nature.com/articles/nn.3635] Resolving human object recognition in space and time: Radoslaw Martin Cichy, Dimitrios Pantazis & Aude Oliva Nature Neuroscience volume 17, pages455–462 (2014)</ref>
##Signal comparison between naturalistic viewing data MEG/fMRI
##Signal comparison between naturalistic viewing data MEG/fMRI
##Multimodal imaging classification <ref> [https://internal-journal.frontiersin.org/articles/10.3389/fnins.2016.00466/full] Multimodal Classification of Schizophrenia Patients with MEG and fMRI Data Using Static and Dynamic Connectivity Measures: Mustafa S. Cetin, Jon M. Houck, Barnaly Rashid, Oktay Agacoglu, Julia M. Stephen, Jing Sui, Jose Canive, Andy Mayer, Cheryl Aine, Juan R. Bustillo and Vince D. Calhoun </ref><ref> [https://www.sciencedirect.com/science/article/abs/pii/S1053811913006757] Using joint ICA to link function and structure using MEG and DTI in schizophrenia
##Combining DTI and MEG <ref> [https://www.sciencedirect.com/science/article/abs/pii/S1053811913006757] Using joint ICA to link function and structure using MEG and DTI in schizophrenia
J.M.Stephen, B.A.Coffman, R.E.Jung, J.R.Bustillo, C.J.Aine, V.D.Calhoun </ref>
J.M.Stephen, B.A.Coffman, R.E.Jung, J.R.Bustillo, C.J.Aine, V.D.Calhoun </ref>
##Multimodal imaging classification <ref> [https://internal-journal.frontiersin.org/articles/10.3389/fnins.2016.00466/full] Multimodal Classification of Schizophrenia Patients with MEG and fMRI Data Using Static and Dynamic Connectivity Measures: Mustafa S. Cetin, Jon M. Houck, Barnaly Rashid, Oktay Agacoglu, Julia M. Stephen, Jing Sui, Jose Canive, Andy Mayer, Cheryl Aine, Juan R. Bustillo and Vince D. Calhoun </ref>
#Signal classification
#Signal classification
##Artifact <ref>[https://www.sciencedirect.com/science/article/pii/S1053811921006777] MEGnet: Automatic ICA-based artifact removal for MEG using spatiotemporal convolutional neural networks
##Artifact <ref>[https://www.sciencedirect.com/science/article/pii/S1053811921006777] MEGnet: Automatic ICA-based artifact removal for MEG using spatiotemporal convolutional neural networks

Revision as of 10:37, 9 November 2021

Objectives

Advance general knowledge of machine learning techniques within the MEG community. Discuss journal articles, replicate techniques on NIH data, develop new ML techniques at NIH.

Format

  1. Specific Projects (Weekly)
    1. Code Review
    2. Project updates
    3. Question and Answer Clinic for users
  2. General (Monthly)
    1. Journal Club
    2. Hackathons – implement novel technique from JC with provided data
    3. Tutorial Workshops - instruct worked out examples with provided code/data
    4. General ML training
      1. Parameter tuning
      2. Model optimization
      3. Techniques
      4. Toolbox tutorials (Scikit-learn / keras)

Analysis Types

  1. Decoding
    1. Multivariate time series classification between conditions [1][2]
      1. Filtering Issues[3]
    2. Temporal Generalization [4]
    3. Realtime - Brain computer interface / neurofeedback
  2. Subject classification
    1. eg. Healthy Control vs Major Depressive Disorder
    2. What are the significant features (brain regions, Hz)
    3. Automated diagnosis of TBI from MEG low frequency signals [5]
  3. Prediction of future condition / Biomarkers
    1. What signals predict conversion from mild cognitive impairment to Alzheimer’s Disease [6] [7]
    2. What signals predict recovery from traumatic brain injury
    3. What signals predict poor outcome for epilepsy surgery
  4. Multimodal Integration [8]
    1. Timing derived from MEG / localization from fMRI [9]
    2. Signal comparison between naturalistic viewing data MEG/fMRI
    3. Combining DTI and MEG [10]
    4. Multimodal imaging classification [11]
  5. Signal classification
    1. Artifact [12] [13]
    2. Signal of interest – Spike detection for epilepsy [14] [15] [16]
    3. Signal/sequence predicts correct response
  6. Temporal learning models – RNN DL / markov model [17]
  7. Inferences from deep learning models
    1. CNN on images vs. CNN of brain responses to same images [18][19]

Preliminary Resources

General

SciKit Learn
Keras

MEG

MNE Python Decoding MNE Python Decoding at Source
RealTime MEG
Deep Learning Decoding

NIH

NIMH Machine Learning in Neuroimaging
NIH-AI
Biowulf Deep Learning Course
Biowulf DeepLearning Tools

Relevant Papers

Language Decoding

  1. [1] Encoding and Decoding Neuronal Dynamics: Methodological Framework to Uncover the Algorithms of Cognition
  2. [2] Decoding Dynamic Brain Patterns from Evoked Responses: A Tutorial on Multivariate Pattern Analysis Applied to Time Series Neuroimaging Data
  3. [3] High-pass filtering artifacts in multivariate classification of neural time series data
  4. Characterizing the dynamics of mental representations: the temporal generalization method - J-R.King, S.Dehaene
  5. [4] An automatic MEG low-frequency source imaging approach for detecting injuries in mild and moderate TBI patients with blast and non-blast causes
  6. [5] Aberrant MEG multi-frequency phase temporal synchronization predictsconversion from mild cognitive impairment-to-Alzheimer's disease: Sandra Pusil, Stavros I. Dimitriadis, María Eugenia López, Ernesto Pereda, Fernando Maestú
  7. [6] Deep-MEG: spatiotemporal CNN features and multiband ensemble classification for predicting the early signs of Alzheimer’s disease with magnetoencephalography: Antonio Giovannetti, Gianluca Susi, Paola Casti, Arianna Mencattini, Sandra Pusil, María Eugenia López, Corrado Di Natale & Eugenio Martinelli
  8. [7] A M/EEG-fMRI Fusion Primer: Resolving Human Brain Responses in Space and Time: Radoslaw M.Cichy Aude Oliva
  9. [8] Resolving human object recognition in space and time: Radoslaw Martin Cichy, Dimitrios Pantazis & Aude Oliva Nature Neuroscience volume 17, pages455–462 (2014)
  10. [9] Using joint ICA to link function and structure using MEG and DTI in schizophrenia J.M.Stephen, B.A.Coffman, R.E.Jung, J.R.Bustillo, C.J.Aine, V.D.Calhoun
  11. [10] Multimodal Classification of Schizophrenia Patients with MEG and fMRI Data Using Static and Dynamic Connectivity Measures: Mustafa S. Cetin, Jon M. Houck, Barnaly Rashid, Oktay Agacoglu, Julia M. Stephen, Jing Sui, Jose Canive, Andy Mayer, Cheryl Aine, Juan R. Bustillo and Vince D. Calhoun
  12. [11] MEGnet: Automatic ICA-based artifact removal for MEG using spatiotemporal convolutional neural networks Alex H.Treacher et al.
  13. [12] ICLabel: An automated electroencephalographic independent component classifier, dataset, and website: Luca Pion-Tonachini, Ken Kreutz-Delgado, Scott Makeig
  14. [13] EMS-Net: A Deep Learning Method for Autodetecting Epileptic Magnetoencephalography Spikes: Li Zheng, Pan Liao, Shen Luo, Jingwei Sheng, Pengfei Teng, Guoming Luan, Jia-Hong Gao
  15. [14] Automated Detection of Epileptic Biomarkers in Resting-State Interictal MEG Data: Miguel C. Soriano, Guiomar Niso, Jillian Clements, Silvia Ortín, Sira Carrasco, María Gudín, Claudio R. Mirasso and Ernesto Pereda
  16. [15] A Long Short-Term Memory neural network for the detection of epileptiform spikes and high frequency oscillations: A. V. Medvedev, G. I. Agoureeva & A. M. Murro
  17. [16] Task-Evoked Dynamic Network Analysis Through Hidden Markov Modeling: Andrew J. Quinn, Diego Vidaurre, Romesh Abeysuriya, Robert Becker,Anna C. Nobre1, and Mark W. Woolrich
  18. [17] Comparison of deep neural networks to spatio-temporal cortical dynamics of human visual object recognition reveals hierarchical correspondence: Radoslaw Martin Cichy 1,2 , Aditya Khosla 1 , Dimitrios Pantazis 3 , Antonio Torralba 1 & Aude Oliva 1
  19. [18] Performance-optimized hierarchical models only partially predict neural responses during perceptual decision making: Laura Gwilliams, Jean-Rémi King