Applications of deep convolutional neural networks to digitized natural history collections

Eric Schuettpelz; Paul Frandsen; Rebecca Dikow; Abel Brown; Sylvia Orli; Melinda Peters; Adam Metallo; Vicki Funk; Laurence Dorr

doi:10.3897/BDJ.5.e21139

Gil Nelson, Shari Ellis (2019)
The history and impact of digitization and digital data mobilization on biodiversity research. Philosophical Transactions of the Royal Society B: Biological Sciences 374: 20170391.

DOI: 10.1098/rstb.2017.0391

Burhan Rashid Hussein, Owais Ahmed Malik, Wee-Hong Ong, Johan Willem Frederik Slik (2022)
Applications of computer vision and machine learning techniques for digitized herbarium specimens: A systematic literature review. Ecological Informatics 69: 101641.

DOI: 10.1016/j.ecoinf.2022.101641

Kathleen M. Pryer, Carlo Tomasi, Xiaohan Wang, Emily K. Meineke, Michael D. Windham (2020)
Using computer vision on herbarium specimen images to discriminate among closely related horsetails (Equisetum). Applications in Plant Sciences 8: .

DOI: 10.1002/aps3.11372

Pamela S. Soltis, Gil Nelson, Alina Zare, Emily K. Meineke (2020)
Plants meet machines: Prospects in machine learning for plant biology. Applications in Plant Sciences 8: .

DOI: 10.1002/aps3.11371

Jingjing Li, Xiaoyang Zheng, Ikumu Watanabe, Yoichi Ochiai (2024)
A systematic review of digital transformation technologies in museum exhibition. Computers in Human Behavior 161: 108407.

DOI: 10.1016/j.chb.2024.108407

Sohaib Younis, Claus Weiland, Robert Hoehndorf, Stefan Dressler, Thomas Hickler, Bernhard Seeger, Marco Schmidt (2018)
Taxon and trait recognition from digitized herbarium specimens using deep convolutional neural networks. Botany Letters 165: 377.

DOI: 10.1080/23818107.2018.1446357

Damon P. Little, Melissa Tulig, Kiat Chuan Tan, Yulong Liu, Serge Belongie, Christine Kaeser‐Chen, Fabián A. Michelangeli, Kiran Panesar, R.V. Guha, Barbara A. Ambrose (2020)
An algorithm competition for automatic species identification from herbarium specimens. Applications in Plant Sciences 8: .

DOI: 10.1002/aps3.11365

Giulia Albani Rocchetti, Chelsey Geralda Armstrong, Thomas Abeli, Simone Orsenigo, Caroline Jasper, Simon Joly, Anne Bruneau, Maria Zytaruk, Jana C. Vamosi (2021)
Reversing extinction trends: new uses of (old) herbarium specimens to accelerate conservation action on threatened species. New Phytologist 230: 433.

DOI: 10.1111/nph.17133

Jana Wäldchen, Patrick Mäder, Natalie Cooper (2018)
Machine learning for image based species identification. Methods in Ecology and Evolution 9: 2216.

DOI: 10.1111/2041-210X.13075

Anne Bruneau, Leonardo M. Borges, Robert Allkin, Ashley N. Egan, Manuel de la Estrella, Firouzeh Javadi, Bente Klitgaard, Joseph T. Miller, Daniel J. Murphy, Carole Sinou, Mohammad Vatanparast, Rong Zhang (2019)
Towards a new online species-information system for legumes. Australian Systematic Botany 32: 495.

DOI: 10.1071/SB19025

Brandon P Hedrick, J Mason Heberling, Emily K Meineke, Kathryn G Turner, Christopher J Grassa, Daniel S Park, Jonathan Kennedy, Julia A Clarke, Joseph A Cook, David C Blackburn, Scott V Edwards, Charles C Davis (2020)
Digitization and the Future of Natural History Collections. BioScience 70: 243.

DOI: 10.1093/biosci/biz163

Qiuran Wang, Tommaso Barbariol, Gian Antonio Susto, Bianca Bonato, Silvia Guerra, Umberto Castiello (2023)
Classifying Circumnutation in Pea Plants via Supervised Machine Learning. Plants 12: 965.

DOI: 10.3390/plants12040965

Zachary Shamblin, Pamela Puppo (2024)
Developing a 3D Digitization Protocol at the Marshall University Herbarium Using Free, Open-source 3D Reconstruction Software. Castanea 88: .

DOI: 10.2179/0008-7475.88.2.191

Neil S. Cobb, Lawrence F. Gall, Jennifer M. Zaspel, Nicolas J. Dowdy, Lindsie M. McCabe, Akito Y. Kawahara (2019)
Assessment of North American arthropod collections: prospects and challenges for addressing biodiversity research. PeerJ 7: e8086.

DOI: 10.7717/peerj.8086

Edward J. Spagnuolo, Peter Wilf, Thomas Serre (2022)
Decoding family‐level features for modern and fossil leaves from computer‐vision heat maps. American Journal of Botany 109: 768.

DOI: 10.1002/ajb2.1842

Meghan A. Balk, John Bradley, M. Maruf, Bahadir Altintaş, Yasin Bakiş, Henry L. Bart, David Breen, Christopher R. Florian, Jane Greenberg, Anuj Karpatne, Kevin Karnani, Paula Mabee, Joel Pepper, Dom Jebbia, Thibault Tabarin, Xiaojun Wang, Hilmar Lapp (2024)
A FAIR and modular image‐based workflow for knowledge discovery in the emerging field of imageomics. Methods in Ecology and Evolution 15: 1129.

DOI: 10.1111/2041-210X.14327

Michael Greeff, Max Caspers, Vincent Kalkman, Luc Willemse, Barry Sunderland, Olaf Bánki, Laurens Hogeweg (2022)
Sharing taxonomic expertise between natural history collections using image recognition. Research Ideas and Outcomes 8: .

DOI: 10.3897/rio.8.e79187

Rebecca Dikow, Corey DiPietro, Michael Trizna, Hanna BredenbeckCorp, Madeline Bursell, Jenna Ekwealor, Richard Hodel, Nilda Lopez, William Mattingly, Jeremy Munro, Richard Naples, Candace Oubre, Drew Robarge, Sara Snyder, Jennifer Spillane, Melinda Jane Tomerlin, Luis Villanueva, Alexander White (2023)
Developing responsible AI practices at the Smithsonian Institution. Research Ideas and Outcomes 9: .

DOI: 10.3897/rio.9.e113334

Hjalte M. R. Mann, Alexandros Iosifidis, Jane U. Jepsen, Jeffrey M. Welker, Maarten J. J. E. Loonen, Toke T. Høye, Marcus Rowcliffe, Xuehua Liu (2022)
Automatic flower detection and phenology monitoring using time‐lapse cameras and deep learning. Remote Sensing in Ecology and Conservation 8: 765.

DOI: 10.1002/rse2.275

Simon Wills, Charlie J. Underwood, Paul M. Barrett, Stephan Lautenschlager (2021)
Learning to see the wood for the trees: machine learning, decision trees, and the classification of isolated theropod teeth. Palaeontology 64: 75.

DOI: 10.1111/pala.12512

Vicki A. Funk (2018)
Collections‐based science in the 21st Century. Journal of Systematics and Evolution 56: 175.

DOI: 10.1111/jse.12315

Justin Kitzes, Rachael Blake, Sara Bombaci, Melissa Chapman, Sandra M. Duran, Tao Huang, Maxwell B. Joseph, Samuel Lapp, Sergio Marconi, William K. Oestreich, Tessa A. Rhinehart, Anna K. Schweiger, Yiluan Song, Thilina Surasinghe, Di Yang, Kelsey Yule (2021)
Expanding NEON biodiversity surveys with new instrumentation and machine learning approaches. Ecosphere 12: .

DOI: 10.1002/ecs2.3795

Lei Duan, Li‐Na Han, Bin‐Bin Liu, Artem Leostrin, AJ Harris, Lin Wang, Emine Arslan, Kuddisi Ertuğrul, Mikhail Knyazev, Elena Hantemirova, Jun Wen, Hong‐Feng Chen (2023)
Species delimitation of the liquorice tribe (Leguminosae: Glycyrrhizeae) based on phylogenomic and machine learning analyses. Journal of Systematics and Evolution 61: 22.

DOI: 10.1111/jse.12902

Alexander E. White, Rebecca B. Dikow, Makinnon Baugh, Abigail Jenkins, Paul B. Frandsen (2020)
Generating segmentation masks of herbarium specimens and a data set for training segmentation models using deep learning. Applications in Plant Sciences 8: .

DOI: 10.1002/aps3.11352

Emily K. Meineke, Carlo Tomasi, Song Yuan, Kathleen M. Pryer (2020)
Applying machine learning to investigate long‐term insect–plant interactions preserved on digitized herbarium specimens. Applications in Plant Sciences 8: .

DOI: 10.1002/aps3.11369

Jessica L. Allen, R. Troy McMullin, Erin A. Tripp, James C. Lendemer (2019)
Lichen conservation in North America: a review of current practices and research in Canada and the United States. Biodiversity and Conservation 28: 3103.

DOI: 10.1007/s10531-019-01827-3

Quentin Groom, Mathias Dillen, Wouter Addink, Arturo H. Ariño, Christian Bölling, Pierre Bonnet, Lorenzo Cecchi, Elizabeth R. Ellwood, Rui Figueira, Pierre-Yves Gagnier, Olwen Grace, Anton Güntsch, Helen Hardy, Pieter Huybrechts, Roger Hyam, Alexis Joly, Vamsi Krishna Kommineni, Isabel Larridon, Laurence Livermore, Ricardo Jorge Lopes, Sofie Meeus, Jeremy Miller, Kenzo Milleville, Renato Panda, Marc Pignal, Jorrit Poelen, Blagoj Ristevski, Tim Robertson, Ana Rufino, Joaquim Santos, Maarten Schermer, Ben Scott, Katja Seltmann, Heliana Teixeira, Maarten Trekels, Jitendra Gaikwad (2023)
Envisaging a global infrastructure to exploit the potential of digitised collections. Biodiversity Data Journal 11: .

DOI: 10.3897/BDJ.11.e109439

Shelley A. James, Pamela S. Soltis, Lee Belbin, Arthur D. Chapman, Gil Nelson, Deborah L. Paul, Matthew Collins (2018)
Herbarium data: Global biodiversity and societal botanical needs for novel research. Applications in Plant Sciences 6: .

DOI: 10.1002/aps3.1024

J Mason Heberling, L Alan Prather, Stephen J Tonsor (2019)
The Changing Uses of Herbarium Data in an Era of Global Change: An Overview Using Automated Content Analysis. BioScience 69: 812.

DOI: 10.1093/biosci/biz094

Mathias Dillen, Quentin Groom, Simon Chagnoux, Anton Güntsch, Alex Hardisty, Elspeth Haston, Laurence Livermore, Veljo Runnel, Leif Schulman, Luc Willemse, Zhengzhe Wu, Sarah Phillips (2019)
A benchmark dataset of herbarium specimen images with label data. Biodiversity Data Journal 7: .

DOI: 10.3897/BDJ.7.e31817

Abraham Nieva de la Hidalga, Paul Rosin, Xianfang Sun, Ann Bogaerts, Niko De Meeter, Sofie De Smedt, Maarten Strack van Schijndel, Paul Van Wambeke, Quentin Groom (2020)
Designing an Herbarium Digitisation Workflow with Built-In Image Quality Management. Biodiversity Data Journal 8: .

DOI: 10.3897/BDJ.8.e47051

Riccardo de Lutio, John Y. Park, Kimberly A. Watson, Stefano D'Aronco, Jan D. Wegner, Jan J. Wieringa, Melissa Tulig, Richard L. Pyle, Timothy J. Gallaher, Gillian Brown, Gordon Guymer, Andrew Franks, Dhahara Ranatunga, Yumiko Baba, Serge J. Belongie, Fabián A. Michelangeli, Barbara A. Ambrose, Damon P. Little (2022)
The Herbarium 2021 Half–Earth Challenge Dataset and Machine Learning Competition. Frontiers in Plant Science 12: .

DOI: 10.3389/fpls.2021.787127

Max Caspers, Luc Willemse, Eulàlia Gassó Miracle, Erik J. van Nieukerken (2019)
Butterflies in bags: permanent storage of Lepidoptera in glassine envelopes. Nota Lepidopterologica 42: 1.

DOI: 10.3897/nl.42.28654

Alexander J. Robillard, Michael G. Trizna, Morgan Ruiz‐Tafur, Edgard Leonardo Dávila Panduro, C. David de Santana, Alexander E. White, Rebecca B. Dikow, Jessica L. Deichmann (2023)
Application of a deep learning image classifier for identification of Amazonian fishes. Ecology and Evolution 13: .

DOI: 10.1002/ece3.9987

Matthew Collins, Gaurav Yeole, Paul Frandsen, Rebecca Dikow, Sylvia Orli, Renato Figueiredo (2018)
A Pipeline for Deep Learning with Specimen Images in iDigBio - Applying and Generalizing an Examination of Mercury Use in Preparing Herbarium Specimens . Biodiversity Information Science and Standards 2: e25699.

DOI: 10.3897/biss.2.25699

Geovanni Figueroa-Mata, Erick Mata-Montero (2020)
Using a Convolutional Siamese Network for Image-Based Plant Species Identification with Small Datasets. Biomimetics 5: 8.

DOI: 10.3390/biomimetics5010008

Marek L. Borowiec, Rebecca B. Dikow, Paul B. Frandsen, Alexander McKeeken, Gabriele Valentini, Alexander E. White (2022)
Deep learning as a tool for ecology and evolution. Methods in Ecology and Evolution 13: 1640.

DOI: 10.1111/2041-210X.13901

Holger Volland (2019)
Der digitale Kulturbetrieb. Chapter 6: 113.

DOI: 10.1007/978-3-658-24030-1_6