Barak A. Pearlmutter Publications

External sources

Publication Types

Journal Papers and Major Conference Proceedings
Book Chapters
Other Conference Proceedings
Comments in Refereed Journals
Technical Reports
Abstracts
Publicly Available Software
Patents

Journal Papers and Major Conference Proceedings

Hang Liao, Barak A. Pearlmutter, Vamsi K. Potluru, and David P. Woodruff, Automatic Differentiation of Sketched Regression, AISTATS 2020.
Robert Kelly, Barak A. Pearlmutter, and Phil Maguire, Lock-Free Hopscotch Hashing, SIAM Symposium on Algorithmic Principles of Computer Systems 2020 (APOCS20), 8-Jan-2020, Salt Lake City, Utah, USA.
Tobias Burns, Barak A. Pearlmutter, and John B. McDonald, MouldingNet: Deep-learning for 3D Object Reconstruction, IMVIP 2019: Irish Machine Vision and Image Processing.
Oleksandr Manzyuk, Barak A. Pearlmutter, Alexey Andreyevich Radul, David R. Rush, and Jeffrey Mark Siskind, Perturbations confusion in forward automatic differentiation of higher-order functions, Journal of Functional Programming 29(e12):24, Sep 2019, doi:10.1017/S095679681900008X. Also arXiv:1211.4892.
Robert Kelly, Barak A. Pearlmutter, and Phil Maguire, Concurrent Robin Hood Hashing, in 22nd International Conference on Principles of Distributed Systems (OPODIS), pages 10:1–10:16, Hong Kong, China, Dec 17–19 2018, doi:10.4230/LIPIcs.OPODIS.2018.10. Also arXiv:1809.04339.
J. M. Siskind and B. A. Pearlmutter. Divide-and-conquer checkpointing for arbitrary programs with no user annotation. Optimization Methods and Software 33(04-06):1288-1330, 2018. Also arXiv:1708.06799v2. doi:10.1080/10556788.2018.1459621
A. G. Baydin, B. A. Pearlmutter, A. A. Radul, and J. M. Siskind. Automatic differentiation in machine learning: a survey. Journal of Machine Learning Research 18(153):1–43, 2018. Also arXiv:1502.05767.
S. Geeraert, C.-A. Lehalle, B. A. Pearlmutter, O. Pironneau, and A. Reghai. Mini-symposium on automatic differentiation and its applications in the financial industry. ESAIM: ProcS 59:56–75, 2017. Also arXiv:1703.02311 [q-fin.CP]. doi:10.1051/proc/201759056
C. Hamilton, S. D’Arcy, B. A. Pearlmutter, G. Crispino, E. C. Lalor, and B. J. Conlon. An investigation of feasibility and safety of bi-modal stimulation for the treatment of tinnitus: An open-label pilot study. Neuromodulation: Technology at the Neural Interface, June 2016. doi:10.1111/ner.12452
Jeffrey Mark Siskind and Barak A. Pearlmutter, Binomial Checkpointing for Arbitrary Programs with No User Annotation, Extended abstract presented at the 7th International Conference on Algorithmic Differentiation (AD), Oxford, UK, 12-15 September 2016. Also arXiv:1611.03410
Jeffrey Mark Siskind and Barak A. Pearlmutter, Efficient Implementation of a Higher-Order Language with Built-In AD, Extended abstract presented at the 7th International Conference on Algorithmic Differentiation (AD), Oxford, UK, 12-15 September 2016. Also arXiv:1611.03416
Atılım Güneş Baydin, Barak A. Pearlmutter, and Jeffrey Mark Siskind, DiffSharp: An AD Library for .NET Languages, Extended abstract presented at the 7th International Conference on Algorithmic Differentiation (AD), Oxford, UK, 12-15 September 2016. Also arXiv:1611.03423
Atılım Güneş Baydin, Barak A. Pearlmutter, and Jeffrey Mark Siskind, Tricks from Deep Learning, Extended abstract presented at the 7th International Conference on Algorithmic Differentiation (AD), Oxford, UK, 12-15 September 2016. Also arXiv:1611.03777
Robert Kelly, Barak A. Pearlmutter, and Jeffrey Mark Siskind, Evolving the Incremental Lambda Calculus into a Model of Forward AD, Extended abstract and poster presented at the 7th International Conference on Algorithmic Differentiation (AD), Oxford, UK, 12-15 September 2016. Also arXiv:1611.03429
C. Hamilton, B. A. Pearlmutter, G. Crispino, S. D'Arcy, E. C. Lalor, and B. J. Conlon. Impact of auditory and somatosensory multimodal neuromodulation on objective and subjective measures of permanent intractable tinnitus. 2015. In review.
C. Hamilton, S. D'Arcy, B. A. Pearlmutter, G. Crispino, E. C. Lalor, and B. J. Conlon. An investigation of feasibility and safety of bi-modal stimulation for the treatment of tinnitus: An open-label pilot study. Neuromodulation: Technology at the Neural Interface, June 2016. doi:10.1111/ner.12452
Oleksandr Manzyuk, Barak A. Pearlmutter, Alexey Andreyevich Radul, David R. Rush, and Jeffrey Mark Siskind, Confusion of Tagged Perturbations in Forward Automatic Differentiation of Higher-Order Functions, Higher Order and Symbolic Computation. To appear. Also see arXiv:1211.4892.
Andrei Barbu, Daniel Barrett, Wei Chen, Siddharth Narayanaswamy, Caiming Xiong, Jason J. Corso, Christiane D. Fellbaum, Catherine Hanson, Stephen Jose Hanson, Sebastien Helie, Evguenia Malaia, Barak A. Pearlmutter, Jeffrey Mark Siskind, Thomas Michael Talavage, and Ronnie B. Wilbur, Seeing is Worse than Believing: Reading People's Minds Better than Computer-Vision Methods Recognize Actions, European Conference on Computer Vision (ECCV) 2014. doi:10.1007/978-3-319-10602-1_40
Barak A. Pearlmutter and Conor J. Houghton, Dreams, mnemonics, and tuning for criticality, Behavioral and Brain Sciences 36(6):625-26, 2013. Open Peer Commentary on Sue Llewellyn, Such stuff as dreams are made on? Elaborative encoding, the ancient art of memory, and the hippocampus. doi:10.1017/S0140525X13001404
Míriam R. García, Barak A. Pearlmutter, Peter E. Wellstead, and Richard H. Middleton, A slow axon antidromic blockade hypothesis for tremor reduction via deep brain stimulation. PLOS ONE 8(9):e73456, 2013. doi:10.1371/journal.pone.0073456
Vince D. Calhoun, Vamsi K. Potluru, Ronald Phlypo, Rogers F. Silva, Barak A. Pearlmutter, Arvind Caprihan, Sergey M. Plis, and Tülay Adalı, Independent Component Analysis for Brain fMRI Does Indeed Select for Maximal Independence. PLOS ONE 8(8):e73309, 2013. doi:10.1371/journal.pone.0073309
Vamsi K. Potluru, Sergey M. Plis, Jonathan Le Roux, Barak A. Pearlmutter, Vince D. Calhoun, and Thomas P. Hayes, Block Coordinate Descent for Sparse NMF, 2013. In ICLR 2013 (First International Conference on Learning Representations), May 2-4, Scottsdale Arizona, USA. Also arXiv:1301.3527.
Alexey Radul, Barak A. Pearlmutter, and Jeffrey Mark Siskind, AD in Fortran, Part 2: Implementation via Prepreprocessor, Advances in Automatic Differentiation, Lecture Notes in Computational Science and Engineering, Springer, 2012. Also arXiv:1203.1450.
Míriam R. García, Mark Verwoerd, Barak A. Pearlmutter, Peter E. Wellstead, and Richard H. Middleton, Deep Brain Stimulation may Reduce Tremor by Preferential Blockade of Slower Axons via Antidromic Activation. In: Proceedings of the IEEE Conference on Decision and Control, December 2011, Orlando FL, pages 6481-6.
Ruairí de Fréin, S. T. Rickard, and B. A. Pearlmutter. Constructing time-frequency dictionaries for source separation via time-frequency masking and source localisation, 8th International Conference on Independent Component Analysis and Signal Separation (ICA-2009), Paraty, Brazil, Mar 2009. Springer-Verlag LNCS 5441, pages 573-80, doi:10.1007/978-3-642-00599-2_72.
Barak A. Pearlmutter and Conor J. Houghton, A New Hypothesis for Sleep: Tuning for Criticality. Neural Computation 21(6):1622-41, Jun 2009, doi:10.1162/neco.2009.05-08-787. (pdf, ps, djvu)
Jeffrey Mark Siskind and Barak A. Pearlmutter. Nesting forward-mode AD in a functional framework. Higher Order and Symbolic Computation 21(4):361-76, 2008, doi:10.1007/s10990-008-9037-1. (pdf, ps)
Paul D. O'Grady and Barak A. Pearlmutter. Discovering Speech Phones Using Convolutive Non-negative Matrix Factorisation with a Sparseness Constraint, Neurocomputing 72(1-3):88-101, Dec 2008, doi:10.1016/j.neucom.2008.01.033. (pdf, djvu)
Barak A. Pearlmutter and Jeffrey Mark Siskind. Using programming language theory to make AD sound and efficient. In Proceedings of the 5th International Conference on Automatic Differentiation, pages 79-90, Bonn, Germany, Aug 2008, doi:10.1007/978-3-540-68942-3_8. Springer-Verlag. (pdf)
Barak A. Pearlmutter and Jeffrey Mark Siskind. Reverse-Mode AD in a functional framework: Lambda the ultimate backpropagator. TOPLAS 30(2):1-36, Mar 2008, doi:10.1145/1330017.1330018. (pdf, ps)
Paul D. O'Grady and Barak A. Pearlmutter. The LOST Algorithm: Finding Lines and Separating Speech Mixtures, EURASIP Journal on Advances in Signal Processing, Article ID 784296, 17 pages, 2008, doi:10.1155/2008/784296. (pdf, djvu)
F. Matthews, B. A. Pearlmutter, T. E. Ward, C. Soraghan, and C. Markham. Hemodynamics for Brain-Computer Interfaces: Optical correlates of control signals. IEEE Signal Processing Magazine 25(1):87-94, Jan 2008, doi:10.1109/MSP.2007.909011. (pdf, djvu)
Edmund C. Lalor, Simon P. Kelly, Barak A. Pearlmutter, Richard B. Reilly, and John J. Foxe. Isolating endogenous visuo-spatial attentional effects using the novel visual-evoked spread spectrum analysis (VESPA) technique, European Journal of Neuroscience 26(12):3536-42, 2007. doi:10.1111/j.1460-9568.2007.05968.x (pdf, djvu)
Edmund C. Lalor, Sherlyn Yeap, Richard B. Reilly, Barak A. Pearlmutter, and John J. Foxe. Dissecting the cellular contributions to early visual sensory processing deficits in schizophrenia using the VESPA evoked response. Schizophrenia Research 98(1-3):256-64, Jan 2008. Epub: Nov 2007. doi:10.1016/j.schres.2007.09.037. (pdf)
Paul D. O'Grady and Barak A. Pearlmutter. Discovering convolutive speech phones using sparseness and nonnegativity, Seventh International Conference on Independent Component Analysis (ICA-2007), pages 520-7, London, UK, Sep 2007. Springer-Verlag LNCS 4666. (pdf, djvu)
Santiago Jaramillo and Barak A. Pearlmutter. Optimal coding predicts attentional modulation in neuronal systems. Neural Computation 19(5):1295-1312, 2007. doi:10.1162/neco.2007.19.5.1295 (preprint pdf, ps, djvu; reprint pdf)
Lucas C. Parra and Barak A. Pearlmutter. Illusory Percepts from Auditory Adaptation, Journal of the Acoustical Society of America 121(3):1632-41, March 2007. doi:10.1121/1.2431346 (pdf, ps, djvu)
Jeffrey Mark Siskind and Barak A. Pearlmutter. First-Class Nonstandard Interpretations by Opening Closures. In Proceedings of the 2007 Symposium on Principles of Programming Languages (POPL 2007), Nice France, pages 71-6, doi:10.1145/1190216.1190230, Jan 2007. (pdf, ps, djvu)
Barak A. Pearlmutter and Jeffrey Mark Siskind. Lazy Multivariate Higher-Order Forward-Mode AD. In Proceedings of the 2007 Symposium on Principles of Programming Languages (POPL 2007), Nice France, pages 155-60, doi:10.1145/1190215.1190242, Jan 2007. (pdf, ps, djvu)
Edmund C. Lalor, Barak A. Pearlmutter, John J. Foxe, Richard B. Reilly, and Gary McDarby. Spread-Spectrum Intensity Modulation for Rapid Estimation of a Visually Evoked Potential. NeuroImage 32:1549-61, 2006. (draft preprint: pdf, ps, djvu; actual preprint)
Hiroki Asari, Barak A. Pearlmutter, and Anthony M. Zador. Sparse Representations for the Cocktail Party Problem. Journal of Neuroscience 26(28):7477-90, 2006. doi:10.1523/JNEUROSCI.1563-06.2006 (reprint: pdf, djvu, preprint: pdf, ps, djvu)
Santiago Jaramillo and Barak A. Pearlmutter. Use your powers wisely: Resource allocation in parallel channels. In Proceedings of the IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2006), September 2006. doi:10.1109/MLSP.2006.275515 (pdf, ps, djvu)
Paul D. O'Grady and Barak A. Pearlmutter. Convolutive Non-Negative Matrix Factorisation with Sparseness Constraint. In Proceedings of the IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2006), September 2006. doi:10.1109/MLSP.2006.275588 (pdf, ps, djvu)
Barak A. Pearlmutter and Rasmus K. Olsson. Linear program differentiation for single-channel speech separation. In Proceedings of the IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2006), September 2006. doi:10.1109/MLSP.2006.275587 (pdf, ps, djvu)
Paul D. O'Grady, Barak A. Pearlmutter, and Scott T. Rickard. Survey of Sparse and Non-Sparse Methods in Source Separation. International Journal of Imaging Systems and Technology (IJIST) 15:18-33, 2005. Special issue on blind source separation and deconvolution in imaging and image processing. (pdf, djvu)
S. C. Jun and B. A. Pearlmutter. Fast Robust Subject-Independent Magnetoencephalographic Source Localization using an Artificial Neural Network. Human Brain Mapping 24(1):21-34, 2005. (pdf, ps, djvu)
Paul D. O'Grady and Barak A. Pearlmutter. Soft-LOST: EM on a Mixture of Oriented Lines. ICA2004, September 22-24, 2004, Granada, Spain, pages 430-436. (ps, pdf, djvu)
Barak A. Pearlmutter and Anthony M. Zador. Monaural Source Separation Using Spectral Cues. ICA2004, September 22-24, 2004, Granada, Spain, pages 478-485. (ps, pdf, djvu)
Sung Chan Jun and Barak A. Pearlmutter. Subject-Independent Magnetoencephalographic Source Localization by a Multilayer Perceptron. In Advances in Neural Information Processing Systems 16. MIT Press, 2004. (pdf, ps, djvu)
Santiago Jaramillo and Barak A. Pearlmutter. A normative model of attention: receptive field modulation. Neurocomputing 58-60:613-618, 2004. Also CNS*2003. (pdf, djvu)
Sung Chan Jun, Barak A. Pearlmutter, and Guido Nolte. MEG source localization using an MLP with a distributed output representation. IEEE Transactions on Biomedical Engineering 50(6):786-789, 2003. doi:10.1109/TBME.2003.812154 (ps, pdf, djvu)
Lucas Parra, Chris Alvino, Akaysha Tang, Barak Pearlmutter, Nick Yeung, Allen Osman, and Paul Sajda. Single-trial detection in EEG and MEG: Keeping it linear, Neurocomputing 52-54:177-183, June 2003. (pdf, djvu)
Guido Nolte, Till Sander, Andreas Lueschow, and Barak A. Pearlmutter. Nonlinear properties of human alpha rhythm. Submitted.
Barak A. Pearlmutter, with Akaysha C. Tang, Natalie A. Malaszenko, and Daniel B. Phung. Independent Components of Magnetoencephalography: Single-Trial Response Time Estimation. Neuroimage. Accepted August 2002. (ps, djvu, pdf)
Sung Chan Jun, Barak A. Pearlmutter, and Guido Nolte. Fast accurate MEG source localization using a MLP trained with real brain noise. Physics in Medicine and Biology 47(14):2547-2560, 2002. (ps, pdf, djvu)
Lucas Parra, Chris Alvino, Akaysha Tang, Barak Pearlmutter, Nick Yeung, Allen Osman, and Paul Sajda. Linear spatial integration for single trial detection in encephalography. NeuroImage 17(1):223-230, 2002. (pdf, djvu)
G. Nolte, T. Sander, A. Lueschow, and B. A. Pearlmutter. Nonlinear time series analysis of human alpha rhythm. BIOMAG-2002. (abstract, ps, pdf)
S. C. Jun, B. A. Pearlmutter, G. Nolte. Fast robust MEG source localization using MLPs. BIOMAG-2002. (abstract, ps, pdf)
Akaysha C. Tang, Barak A. Pearlmutter, Natalie A. Malaszenko, Dan B. Phung, and Bethany C. Reeb. Independent Components of Magnetoencephalography: Localization. Neural Computation 14(8):1827-1858, 2002. (preprint: pdf, ps, djvu, reprint: pdf, pdf-small, djvu)
Michael Zibulevsky, Pavel Kisilev, Yehoshua Y. Zeevi, and Barak A. Pearlmutter. Blind source separation via multinode sparse representation. In Advances in Neural Information Processing Systems 14. Morgan Kaufmann, 1049-1056, 2002. (pdf, ps, djvu)
Michael Zibulevsky and Barak A. Pearlmutter. Blind Source Separation by Sparse Decomposition in a Signal Dictionary. Neural Computation 13(4):863-882, 2001. (preprint: pdf, ps, djvu, reprint: pdf, djvu)
Akaysha C. Tang, Dan Phung, Barak A. Pearlmutter, and Robert Christner. Localization of Independent Components from Magnetoencephalography. ICA2000, pages 387-392. (pdf, ps)
Michael Zibulevsky and Barak A. Pearlmutter. Second Order Blind Source Separation by Recursive Splitting of Signal Subspaces. ICA2000, pages 489-491. (pdf, ps, djvu)
Michael Zibulevsky and Barak A. Pearlmutter. Blind separation of sources with sparse representations in a given signal dictionary. ICA2000, pages 181-186. (pdf, ps)
Akaysha C. Tang, Barak A. Pearlmutter, Michael Zibulevsky, Tim A. Hely, and Michael P. Weisend. An MEG study of response latency and variability in the human visual system during a visual-motor integration task. In Advances in Neural Information Processing Systems 12. Morgan Kaufmann, 185-191, 2000. (pdf, ps, djvu)
Gary W. Flake and Barak A. Pearlmutter. Differentiation functions of the Jacobian with respect to the weights. In Advances in Neural Information Processing Systems 12. Morgan Kaufmann, 435-441, 2000. (pdf, ps, djvu)
Akaysha C. Tang, Barak A. Pearlmutter, Michael Zibulevsky, and Scott A. Carter. Blind source separation of multichannel neuromagnetic responses. Neurocomputing 32-33:1115-1120, 2000. Also in Computational Neuroscience 1999. (pdf, ps, djvu)
C. Warrender and S. Forrest and B. A. Pearlmutter. Detecting intrusions using system calls: Alternative data models. 1999 IEEE Symposium on Security and Privacy. doi:10.1109/SECPRI.1999.766910 (pdf, ps)
Kevin J. Lang, Barak A. Pearlmutter, and Rodney A. Price. Results of the Abbadingo One DFA Learning Competition and a New Evidence-Driven State Merging Algorithm. In ICGI-98, Springer-Verlag, 1998. (pdf, ps, djvu)
Barak A. Pearlmutter and Lucas C. Parra. Maximum Likelihood Blind Source Separation: A Context-Sensitive Generalization of ICA. In Advances in Neural Information Processing Systems 9. MIT Press, 1997.
Barak A. Pearlmutter and Lucas C. Parra. A context-sensitive generalization of ICA. 1996 International Conference on Neural Information Processing. September 1996, Hong Kong. (pdf, ps, djvu)
Barak A. Pearlmutter. Doing the twist: Diagonal meshes are isomorphic to twisted toroidal meshes. IEEE Transactions on Computers 45(6), June 1996. doi:10.1109/12.506434 (pdf, ps, djvu)
Anthony M. Zador and Barak A. Pearlmutter. VC dimension of an integrate and fire neuron model. Neural Computation 8(3):611-624, 1996. (pdf, ps, djvu)
Anthony M. Zador and Barak A. Pearlmutter. VC dimension of an integrate and fire neuron model. In Ninth Conference on Computational Learning Theory, Desenzano del Garda, Italy, June 28-July 1, 1996. (pdf, ps)
Barak A. Pearlmutter. Garbage collection with pointers to single cells. Communications of the ACM 39(12):202-206, December 1996. Accepted Spring 1991. (pdf, local-pdf)
Barak A. Pearlmutter. Gradient calculation for dynamic recurrent neural networks: a survey. IEEE Transactions on Neural Networks 6(5):1212-1228, 1995. doi:10.1109/72.410363 (pdf, ps, djvu)
Barak A. Pearlmutter. Time-skew Hebb rule in a nonisopotential neuron. Neural Computation 7(4):706-712, 1995. (pdf, ps, djvu)
Barak A. Pearlmutter. Fast exact multiplication by the Hessian. Neural Computation 6(1):147-160, 1994. (pdf, ps, djvu)
Joe Kilian, Kevin J. Lang, and Barak A. Pearlmutter. Playing the matching-shoulders lob-pass game with logarithmic regret. In Seventh Annual ACM Workshop on Computational Learning Theory, pages 159-164, New Brunswick, NJ, July 1994. (pdf, ps, djvu)
Yann LeCun, Patrice Y. Simard, and Barak A. Pearlmutter. Automatic learning rate maximization by on-line estimation of the Hessian's eigenvectors. In Advances in Neural Information Processing Systems 5, pages 156-163. Morgan Kaufmann, 1993. (pdf, ps, djvu)
Barak A. Pearlmutter. Gradient descent: Second-order momentum and saturating error. In Advances in Neural Information Processing Systems 4, pages 887-894. Morgan Kaufmann, 1992. (pdf, ps, djvu)
Barak A. Pearlmutter and Ronald Rosenfeld. Chaitin-Kolmogorov complexity and generalization in neural networks. In Advances in Neural Information Processing Systems 3, pages 925-931. Morgan Kaufmann, 1991. (djvu)
Barak A. Pearlmutter. Two new learning procedures for recurrent networks. Neural Network Review 3(3):99-101, 1990.
Barak Pearlmutter. Learning state space trajectories in recurrent neural networks. Neural Computation 1(2):263-269, 1989. (pdf bitmap, djvu)
Kenneth Y. Goldberg and Barak A. Pearlmutter. Using a neural network to learn the dynamics of the CMU direct-drive arm II. In Advances in Neural Information Processing Systems I, pages 356-363. Morgan Kaufmann, 1989. (djvu)
Kevin J. Lang and Barak A. Pearlmutter. Oaklisp: an object-oriented dialect of Scheme. Lisp and Symbolic Computation 1(1):39-51, May 1988. (pdf, ps, djvu)
Kevin J. Lang and Barak A. Pearlmutter. Oaklisp: an object-oriented Scheme with first class types. In ACM Conference on Object-Oriented Systems, Programming, Languages and Applications, pages 30-37, September 1986. Special issue of SIGPLAN Notices. doi:10.1145/28697.28701 (pdf, djvu, CACM ref)

Book Chapters

Barak A. Pearlmutter and Helena Šmigoc, Nonnegative Factorisation of a Data Matrix as a Motivational Example for Basic Linear Algebra, doi:10.1007/978-3-319-66811-6_15, Chapter 15 in Challenges and Strategies in Teaching Linear Algebra, Sepideh Stewart, Christine Andrews-Larson, Avi Berman, and Michelle Zandieh (eds), Springer, 2017, ISBN 9783319668109. Also arXiv:1706.09699.
E. C. Lalor, B. A. Pearlmutter, and J. J. Foxe. Reverse Correlation and the VESPA Method. In T. C. Handy (editor), Brain Signal Analysis: Advances in Neuroelectric and Neuromagnetic Methods, chapter 1. MIT Press: Cambridge, MA. 2009. ISBN 978-0-262-01308-6.
H. Asari, R. K. Olsson, B. A. Pearlmutter, and A. M. Zador. Sparsification for monaural source separation. In S. Makino, T.-W. Lee, and H. Sawada (eds), Blind Speech Separation, chapter 14. Springer-Verlag, 2007. ISBN 978-1-4020-6478-4. (draft manuscript pdf, ps, djvu)
Yaroslav O. Halchenko, Stephen José Hanson and Barak A. Pearlmutter, Multimodal Integration: fMRI, MRI, EEG, MEG, chapter in Luigi Landini, Vincenzo Positano and Maria Filomena Santarelli (eds) Advanced Image Processing in Magnetic Resonance Imaging, pages 223-265, Dekker, book series on Signal Processing and Communications, ISBN 0824725425, 2005. (pdf, djvu)
A. C. Tang and B. A. Pearlmutter. Independent Components of Magnetoencephalography: Localization and Single-Trial Response Onset Detection. In Zhong Lin Lu and Lloyd Kaufman (eds), Magnetic Source Imaging of the Human Brain, which began as the proceedings of a festschrift in honor of Samuel Williamson in 2002. Lawrence Erlbaum and Associates, 2003. (unbutchered: ps, pdf, djvu) (published-butchered: pdf, djvu)
Akaysha C. Tang and Barak A. Pearlmutter. Independent Components of Magnetoencephalography: Localization. In Friedrich T. Sommer and Andrzej Wichert (eds), Exploratory Analysis and Data Modelling in Functional Neuroimaging, chapter 7, pages 129-162. MIT Press, 2002.
M. Zibulevsky, B. A. Pearlmutter, P. Bofill, and P. Kisilev. Blind source separation by sparse decomposition in a signal dictionary. In S. J. Roberts and R. M. Everson (eds), Independent Components Analysis: Principles and Practice, pages 181-208. Cambridge University Press, 2001. (pdf, ps)
Barak A. Pearlmutter and Anthony M. Zador. Sparse matrix methods for modeling single neurons. In Christof Koch (editor), Biophysics of Computation: Information Processing in Single Neurons. Oxford University Press, 1999.
Barak A. Pearlmutter and Kevin J. Lang. The Implementation of Oaklisp. In Peter Lee (editor), Topics in Advanced Language Implementation, pages 189-215. MIT Press, 1991. (djvu, pdf)

Other Conference Proceedings

Míriam R. García, Barak A. Pearlmutter, Peter E. Wellstead, Mark Verwoerd, and Richard H. Middleton. A slow axon antidromic blockade hypothesis for tremor reduction via Deep Brain Stimulation. In 16th Yale Workshop on Learning and Adaptive Systems, pages 1-6, New Haven, CT, USA, June 5-7 2013. (pdf, djvu)
Ruairí de Fréin, Scott Rickard, and Barak Pearlmutter. Sparse Multichannel Source Localisation and Separation. In IMA International Conference on Mathematics in Signal Processing, The Royal Agricultural College, Cirencester, UK, Dec. 2008.
C. Soraghan, F. Matthews, C. Markham, B. A. Pearlmutter, R. O'Neill, and T. E. Ward. A 12-channel, real- time near-infrared spectroscopy instrument for brain-computer interface applications. In 30th Annual International IEEE EMBS Conference, pages 5648-51, Vancouver, British Columbia, Canada, Aug. 20-24 2008. IEEE Press. (pdf)
F. Matthews, C. Soraghan, T. E. Ward, C. Markham, and B. A. Pearlmutter. Software platform for rapid prototyping of NIRS brain computer interfacing techniques. In 30th Annual International IEEE EMBS Conference, pages 4840-3, Vancouver, British Columbia, Canada, Aug. 20-24 2008. IEEE Press. (pdf)
E. C. Lalor, R. B. Reilly, B. A. Pearlmutter, and J. J. Foxe. A spectrum of colors: Investigating the temporal frequency characteristics of the human visual system using a system identification approach. Proc. IEEE Eng. Med. Biol. Soc., 1:3720-3, 2006. doi:10.1109/IEMBS.2006.259688 (pdf)
C. Soraghan, F. Matthews, D. Kelly, T. Ward, C. Markham, B. A. Pearlmutter, and R. O'Neill. A dual-channel optical brain-computer interface in a gaming environment. In Proc. 9th Int. Conf. Computer Games: AI, Animation, Mobile, Educational and Serious Games, pages 35-9, Dublin, Ireland, Nov. 2006.
Jeffrey Mark Siskind and Barak A. Pearlmutter. Perturbation Confusion and Referential Transparency: Correct Functional Implementation of Forward-Mode AD. Draft Proceedings of the 17th International Workshop on Implementation and Application of Functional Languages (IFL2005), Sep 19-21, 2005, Dublin Ireland. (pdf, ps, djvu)
Barak A. Pearlmutter and Hiroki Asari and Anthony M. Zador, Neuronal Predictions of Sparse Linear Representations. Forum Acusticum 2005, Aug 29-Sep 2, Budapest, Hungary, Distributed on CDROM at the conference. (pdf, djvu)
Roderick Murray-Smith and Barak A. Pearlmutter. Transformations of Gaussian Process Priors. In J. Winkler, N. Lawrence, and M. Niranjan, editors, Machine Learning Workshop, pages 110-125, 2005. Springer-Verlag LNAI 3635. (pdf, djvu)
Paul D. O'Grady and Barak A. Pearlmutter. Hard-LOST: Modified k-Means for Oriented Lines. ISSC-2004, Jun 30-Jul 2, 2004, Belfast, Northern Ireland, UK. (ps, pdf, djvu)
Jian Qing Shi, Roderick Murray-Smith, D. Mike Titterington and Barak A. Pearlmutter, Filtered Gaussian Processes for Learning with Large Data-Sets, Proceedings of Switching and Learning in Feedback Systems: European Summer School on Multi-Agent Control, Maynooth, Ireland, Sep 8-10, 2003. Springer-Verlag LNCS 3355. (web)
B. A. Pearlmutter and Vamsi K. Potluru. Sparse Separation: Principles and Tricks. Proc SPIE volume 5102, "Independent Component Analyses, Wavelets, and Neural Networks", April 2003, pages 1-4. (pdf, ps, djvu)
B. A. Pearlmutter and S. Jaramillo. Progress in Blind Separation of Magnetoencephalographic Data. Proc SPIE volume 5102, "Independent Component Analyses, Wavelets, and Neural Networks", April 2003, pages 129-134. (pdf, ps, djvu)
Lucas Parra, Chris Alvino, Akaysha Tang, Barak Pearlmutter, Nick Yeung, Allen Osman, and Paul Sajda. Linear spatial weighting for single trial detection in encephalography. Computational Neuroscience Meeting, Chicago, July 2002. (pdf, djvu)
Karen G. Haines, Barak A. Pearlmutter, John A. Moya, Kim Edlund, and Thomas P. Caudell. Visualizing communication between neurons in the Lamina Ganglionaris of Musca domestica. In International Joint Conference on Neural Networks 2000.
Anthony M. Zador and Barak A. Pearlmutter. The discriminative power of a dynamical model neuron. In Russel Greiner, Thomas Petsche, and Stephen José Hanson, editors, Computational Learning Theory and `Natural' Learning Systems, Volume IV: Making Learning Practical, Provincetown, MA, Sept 1993, pages 211-225. MIT Press, 1997.
Akaysha C. Tang, Chun X. Falk, Lawrence B. Cohen, Jian Y. Wu, Barak A. Pearlmutter, and Hans Peter Hoepp. Response reliability of the neuronal population of the aplysia abdominal ganglion during the gill-withdrawal reflex. In International Joint Conference on Neural Networks, Beijing, PRC, November 1992. IEEE Press.
Barak A. Pearlmutter. Temporally continuous vs. clocked networks. In Neural Networks in Robotics, pages 237-252. Kluwer Academic Publishers, October 23-25, 1991 1992. (ps, pdf, google books)
John B. Hampshire, II and Barak A. Pearlmutter. Equivalence proofs for multi-layer perceptron classifiers and the Bayesian discriminant function. In Connectionist Models: Proceedings of the 1990 Summer School, pages 159-172. Morgan Kaufmann, 1990. (ps, pdf, djvu)
Barak A. Pearlmutter. Learning state space trajectories in recurrent neural networks. In Proceedings of the 1988 Connectionist Models Summer School, pages 113-117. Morgan Kaufmann, 1989.
Barak A. Pearlmutter. Learning state space trajectories in recurrent neural networks. In International Joint Conference on Neural Networks, volume 2, pages 365-372, Washington DC, June 18-22 1989. IEEE Press.
Barak A. Pearlmutter and Geoffrey E. Hinton. G-maximization: an unsupervised learning procedure. In Snowbird Conference on Neural Networks for Computing, number 151 in AIP conference proceedings, pages 333-338. American Institute of Physics, 1986.

Comments in Refereed Journals

Barak A. Pearlmutter. Response to Brown's reply to Pearlmutter's comments on Tsai, Carnevale, and Brown. Network: Computation in Neural Systems, 1996. To appear?
Barak A. Pearlmutter. May we recommend Martinez-Gomez et al. (1994). Annals of Improbable Research, 1995.
Barak A. Pearlmutter. Comment on ``Hebbian learning is jointly controlled by electrotonic and input structure.'' Network: Computation in Neural Systems 5(3):425-426, August 1994.
Barak A. Pearlmutter. Comments on ``Dynamic programming approach to optimal weight selection in multilayer neural networks.'' IEEE Transactions on Neural Networks 3(6):1028, November 1992. doi:10.1109/72.165609 (pdf)

Technical Reports

Jeffrey Mark Siskind and Barak A. Pearlmutter, Divide-and-Conquer Checkpointing for Arbitrary Programs with No User Annotation, arXiv:1708.06799, 2017.
Atılım Güneş Baydin, Barak A. Pearlmutter, and Jeffrey Mark Siskind, DiffSharp: Automatic Differentiation Library, arXiv:1511.07727, 2015.
Atılım Güneş Baydin, Barak A. Pearlmutter, Alexey Andreyevich Radul, and Jeffrey Mark Siskind, Automatic differentiation in machine learning: a survey, arXiv:1502.05767, 2015.
Andrei Barbu, N. Siddharth, Caiming Xiong, Jason J. Corso, Christiane D. Fellbaum, Catherine Hanson, Stephen José Hanson, Sébastien Hélie, Evguenia Malaia, Barak A. Pearlmutter, Jeffrey Mark Siskind, Thomas Michael Talavage, and Ronnie B. Wilbur, The Compositional Nature of Event Representations in the Human Brain, arXiv:1505.06670, May 2015. (arXiv:1505.06670v1.pdf)
Atılım Güneş Baydin and Barak A. Pearlmutter, Automatic Differentiation of Algorithms for Machine Learning, arXiv:1404.7456, Apr 28, 2014. Also in Proceedings of the AutoML Workshop at the International Conference on Machine Learning (ICML), Beijing, China, June 21-26, 2014.
V. K. Potluru, J. LeRoux, B. A. Pearlmutter, J. R. Hershey, and M. E. Brand. Coordinate descent for mixed-norm NMF. Technical Report TR2013-130, Mitsubishi Electric Research Laboratories, Dec. 2013. At NIPS-2013 Workshop.
Andrei Barbu, N. Siddharth, Caiming Xiong, Jason J. Corso, Christiane D. Fellbaum, Catherine Hanson, Stephen José Hanson, Sébastien Hélie, Evguenia Malaia, Barak A. Pearlmutter, Jeffrey Mark Siskind, Thomas Michael Talavage, and Ronnie B. Wilbur, The Compositional Nature of Verb and Argument Representations in the Human Brain, arXiv:1306.2293, Jun 10, 2013.
Alexey Radul and Barak A. Pearlmutter and Jeffrey Mark Siskind, AD in Fortran, Part 1: Design, 2012, arXiv:1203.1448.
Jeffrey Mark Siskind and Barak A. Pearlmutter, Using Polyvariant Union-Free Flow Analysis to Compile a Higher-Order Functional-Programming Language with a First-Class Derivative Operator to Efficient Fortran-like Code, School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA, Jan 2008, TR-ECE-08-01.
Jeffrey Mark Siskind and Barak A. Pearlmutter, Putting the Automatic Back into AD: Part I, What's Wrong, School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA, Jan 2008, TR-ECE-08-02.
Barak A. Pearlmutter and Jeffrey Mark Siskind, Putting the Automatic Back into AD: Part II, Dynamic, Automatic, Nestable, and Fast, School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA, Jan 2008, TR-ECE-08-03
Barak A. Pearlmutter, Bounds on Query Convergence, arXiv:cs.LG/0511088, Nov 25, 2005.
R. Murray-Smith and Barak A. Pearlmutter, Transformations of Gaussian Process priors, DCS Technical Report TR-2003-149, Department of Computing Science, Glasgow University, June, 2003. (pdf)
Sung Chan Jun, Barak A. Pearlmutter, and Guido Nolte. Realtime MEG source localization with realistic noise. UNM TR-CS-2001-22. (pdf, ps)
P. Kisilev, M. Zibulevsky, Y. Y. Zeevi, and B. A. Pearlmutter. Multiresolution framework for blind source separation. 2000. (pdf, ps)
Michael Zibulevsky and Barak A. Pearlmutter. Blind Source Separation by Sparse Decomposition. University of New Mexico Technical Report No. CS99-1. Albuquerque, NM, July 1999. (pdf, ps)
Barak A. Pearlmutter, An Investigation of the Gradient Descent Process in Neural Networks, Technical Report CMU-CS-96-114, PhD Thesis, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, January 1996. (ps, pdf)
Barak A. Pearlmutter. Radar project results: March-September 1995. Technical Report SCR-96-TR-554, Siemens Corporate Research, Princeton, NJ, 1996.
Barak A. Pearlmutter and Scott T. Rickard, Jr. Linear compression of the strips database. Technical Report SCR-95-TR-537, Siemens Corporate Research, Princeton, NJ, 1995.
Barak A. Pearlmutter and Leonid Gurvits. Relating egomotion and image evolution. Technical Report SCR-95-TR-536, Siemens Corporate Research, Princeton, NJ, 1995. (pdf, ps)
Anthony M. Zador and Barak A. Pearlmutter. Efficient computation of sparse elements of the inverse of a sparse near-tridiagonal matrix with application to the nerve equation. Technical Report OGI-CSE-93-003, Oregon Graduate Institute of Science & Technology, Department of Computer Science and Engineering, Portland, OR, March 1993. (pdf, ps)
Barak A. Pearlmutter. Fast exact multiplication by the Hessian. Technical Report OGI-CSE 93-002, Oregon Graduate Institute of Science & Technology, Department of Computer Science and Engineering, Portland, OR, March 1993.
Barak A. Pearlmutter. Dynamic recurrent neural networks. Technical Report CMU-CS-90-196, Carnegie Mellon University School of Computer Science, Pittsburgh, PA, December 1990. (ps, pdf, djvu)
Kenneth Y. Goldberg and Barak A. Pearlmutter. Using a neural network to learn the dynamics of the CMU Direct-Drive Arm II. Technical Report CMU-CS-88-160, Carnegie Mellon University, 1988.
Barak A. Pearlmutter. Learning state space trajectories in recurrent neural networks. Technical Report CMU-CS-88-191, Department of Computer Science, Carnegie Mellon University, Pittsburgh, PA, 1988.

Abstracts

Mark Aksen, Sharif I. Kronemer, Jacob S. Prince, Z. Ding, Akshar Agarwal, Guy Wolf, Barak Pearlmutter, Ronald Coifman, Michael Pitts, and Hal Blumenfeld, Pupil dynamics as a covert measure of conscious perception in a visual no report paradigm, Poster at Society for Neuroscience Abstracts 48(789.12/JJJ22), 2018.
R. O'Neill, C. Hamilton, B. Pearlmutter, G. Crispino, S. Hughes, and B. Conlon, Impact of Acoustic and Tactile Multi-modal Neuromodulation on Objective and Subjective Measures of Permanent Intractable Tinnitus, Irish Journal of Medical Science 182:S518-9, 2013.
Míriam R. García, Barak A. Pearlmutter, Peter E. Wellstead, Mark Verwoerd, and Richard H. Middleton, A functional mechanism for deep brain stimulation in Parkinson's disease: The slow axon blockade hypothesis. Movement Disorders 27:491 (Suppl 1), 2012. doi:10.1002/mds.25051
Barak A. Pearlmutter and Conor J. Houghton, Tuning for Criticality: A New Hypothesis for Sleep. Poster at COSYNE 2007, Salt Lake City, Utah, USA, Feb 22-24, 2007. (pdf, ps, djvu)
Edmund C. Lalor, Richard B. Reilly, Barak A. Pearlmutter, and John J. Foxe, Investigating Multisensory Integration using Spread Spectrum Stimulation. Poster at 7th Annual Meeting of the International Multisensory Research Forum, School of Psychology/Institute of Neuroscience, University of Dublin Trinity College, June 18-21, 2006.
Santiago Jaramillo and Barak A. Pearlmutter, Exploring the attentional modulation of neural codes. Poster at Computational and Systems Neuroscience Workshop, March 2004, Cold Spring Harbor Laboratories. (pdf, djvu)
Barak A. Pearlmutter and Anthony M. Zador, Monaural Source Separation using Spectral Cues. Poster at Computational and Systems Neuroscience Workshop, March 2004, Cold Spring Harbor Laboratories. (pdf, djvu)
S. Jaramillo and B. A. Pearlmutter. A normative model of attention: receptive field modulation. Society for Neuroscience Abstracts 33(180.13), 2003. (poster: pdf, djvu)
B. A. Pearlmutter and S. Jaramillo. Brightness Illusions as Optimal Percepts. Society for Neuroscience Abstracts 33(698.13), 2003. (poster: pdf, djvu)
S. C. Jun, B. A. Pearlmutter, and G. Nolte. Fast Subject Independent Magnetoencephalographic (MEG) Source Localization using an Artificial Neural Network. Society for Neuroscience Abstracts 32, 2002. (pdf, ps, djvu)
Barak A. Pearlmutter. Algorithmic Differentiation, Functional Programming, and Iterate-to-Fixedpoint. The Learning Workshop. Snowbird Utah, April 2-5, 2002. (pdf, ps)
Santiago Jaramillo and Barak A. Pearlmutter and Akaysha C. Tang and Guido Nolte. Relationship Between the Phase of Alpha-Band Oscillation and Single-Trial Visually Evoked Responses. Society for Neuroscience Abstracts 31(821.1), 2001.
Sung Chan Jun, Barak A. Pearlmutter, and Guido Nolte. MEG source localization using an MLP. Inverse Problems in Engineering Symposium, June 14-16, 2001.
Lucas Parra, Akaysha Tang, Barak Pearlmutter, Zuohau Zhang, and Paul Sajda. Predicting motor commands using magnetoencephalography (MEG). Cognitive Neuroscience Annual Meeting, F-30, March 25-27, 2001.
A. C. Tang, D. B. Phung and B. A. Pearlmutter. Direct measurement of interhemispherical transfer time (IHTT) for natural somatosensory stimulation during voluntary movement using MEG and blind source separation. Society for Neuroscience Abstracts 30(9195), 2000.
D. B. Phung, A. C. Tang, B. A. Pearlmutter and R. Christner. Localization of MEG components recovered by blind source separation. Society for Neuroscience Abstracts 30(9196), 2000.
S. A. Carter, A. C. Tang, B. A. Pearlmutter, L. K. Anderson, C. J. Aine and R. Christner. Coactivation of visual and auditory pathways induces changes in the timing of evoked responses in populations of neurons: an MEG study. Society for Neuroscience Abstracts 30(9197), 2000.
Barak A. Pearlmutter and Monica Rogati. Learn to pay attention, young network! Snowbird Workshop on Machines that Learn, April 2000. Poster.
Barak A. Pearlmutter, Akaysha C. Tang, Michael Zibulevsky, Tim A. Hely, and Michael P. Weisend. An MEG study of response latency and variability in the human visual system during a visual-motor integration task. Society for Neuroscience Abstracts 29(766.8), 1999.
Lucas C. Parra and Barak A. Pearlmutter. Maximal information transfer in a spiking neuron. Society for Neuroscience Abstracts 21(480.7), 1995.
Lucas C. Parra and Barak A. Pearlmutter. Maximal information transfer in a spiking neuron. Snowbird Workshop on Neural Networks for Computing, April 1995. Poster.
Anthony M. Zador and Barak A. Pearlmutter. Efficient matrix methods in the analysis of electrotonic structure in single neurons. Snowbird Workshop on Neural Networks for Computing, April 1994.
Kevin J. Lang and Barak A. Pearlmutter. Playing the matching-shoulders lob-pass game with logarithmic regret. Snowbird Workshop on Neural Networks for Computing, April 1994. Poster.
Akaysha C. Tang, Chun X. Falk, Lawrence B. Cohen, Jian Y. Wu, Barak A. Pearlmutter, and Hans Peter Hoepp. Multicellular optical recording reveals neuronal population with broad spectrum of response probability. Society for Neuroscience Abstracts 18, 1992.
Barak A. Pearlmutter and Thomas H. Brown. Hebbian learning is jointly controlled by electrotonic and input structure. Society for Neuroscience Abstracts 18(567.23), 1992.
Barak A. Pearlmutter and Thomas H. Brown. Hebbian learning is jointly controlled by electrotonic and input structure. Poster at Snowbird Workshop on Neural Networks for Computing, April 1992.
Barak A. Pearlmutter. Generalization in perceptrons with noisy inputs. Poster at Computational Learning Theory and Natural Learning Systems workshop, September 1990.
Barak A. Pearlmutter. Redundancy and correctness. Poster at Snowbird Workshop on Neural Networks for Computing, April 1990.
Barak A. Pearlmutter. Learning state space trajectories in recurrent neural networks. Talk at Snowbird Workshop on Neural Networks for Computing, April 1989.

Publicly Available Software

Barak A. Pearlmutter and Kevin J. Lang. Oaklisp. Released under the GPL, 1986. Accompanied by extensive language and implementation manuals. Ports exist for Unix (most versions), Linux, AmigaDOS, MacOS, DOS, Windows, OS/2, CrayOS, and others. (Influenced Sun's Java effort and Apple's Dylan effort.)
Barak A. Pearlmutter. The CBP neural network simulator. Released under the GPL, available via ftp, 1987. Flexible and powerful NN simulator. Facilities for weight sharing, backpropagation, mean-field Boltzmann machines, recurrent backpropagation, continuous time backpropagation through time, learnable time constants. Advanced stochastic optimization features. Interfaces to a number of graphical network display programs. User community of a few dozen.
Barak A. Pearlmutter. Garbage collector for the Linux kernel. Released under the GPL, 1996. A special purpose mark-and-sweep garbage collector incorporated in Linux 2.0, and present in subsequent versions.

Patents

Jeffrey Mark Siskind and Barak A. Pearlmutter, Automatic derivative method for a computer programming language. US Patent 8,739,137 B2. May 27 2014.
Jeffrey Mark Siskind and Barak A. Pearlmutter. Map-Closure: A general purpose mechanism for nonstandard interpretation. US patent 8,281,299. Oct 2, 2012.
Barak A. Pearlmutter and Anthony M. Zador. Systems and methods for separating multiple sources using directional filtering. US Patent number 7,280,943. Oct 9, 2007.
Martin S. Glassman, Russel E. Gorr, Thomas R. Hancock, J. Stephen Judd, Carol L. Novak, Barak A. Pearlmutter, and Scott T. Rickard, Jr. Omnidirectional visual image detector and processor. US Patent number 6,262,760. July 17, 2001.
Martin S. Glassman, Russel E. Gorr, Thomas R. Hancock, J. Stephen Judd, Carol L. Novak, Barak A. Pearlmutter, and Scott T. Rickard, Jr. Omnidirectional visual image detector and processor. US Patent number 5,920,337. July 6, 1999.
J. Stephen Judd and Barak A. Pearlmutter. Low-profile horizon-sampling light sensor. US Patent number 5,612,533. March 18, 1997.

Barak A. Pearlmutter <barak@pearlmutter.net>