Computer Science > Emerging Technologies
[Submitted on 23 Aug 2018 (v1), revised 26 Jan 2019 (this version, v2), latest version 11 Sep 2020 (v5)]
Title:Insect cyborgs: Bio-mimetic feature generators improve machine learning accuracy on limited data
View PDFAbstract:Machine learning (ML) classifiers always benefit from more informative input features. We seek to auto-generate stronger feature sets in order to address the difficulty that ML methods often experience given limited training data. A wide range of biological neural nets (BNNs) excel at fast learning, implying that they are adept at extracting informative features. We can thus look to BNNs for possible tools to improve performance of ML methods in this low-data regime. The insect olfactory network, though simple, learns new odors very rapidly, by means of three key elements:
A competitive inhibition layer (Antennal Lobe, AL); a high-dimensional sparse plastic layer (Mushroom Body, MB); and Hebbian updates of synaptic weights. In this work, we deploy a computational model of the insect AL-MB as an automatic feature generator, attached as a front-end pre-processor so that its Readout Neurons provide new features, derived from the original features, for use by standard ML classifiers. We find that these ``insect cyborgs'', i.e. classifiers that are part-insect model and part-ML method, have significantly better performance than baseline ML methods alone on a vectorized MNIST dataset. Relative Test set accuracy improves by an average of 6% to 33% depending on baseline ML accuracy, while relative reduction in Test set error reaches more than 50% for higher baseline accuracy ML models. The two basic structures in the AL-MB, a competitive inhibition layer and a high-dimensional sparse layer, coupled with Hebbian plasticity, act as effective, automated feature generators that substantially improve ML classification in the test case we examine.
Submission history
From: Charles Delahunt [view email][v1] Thu, 23 Aug 2018 05:01:05 UTC (346 KB)
[v2] Sat, 26 Jan 2019 22:11:48 UTC (328 KB)
[v3] Tue, 16 Apr 2019 18:21:02 UTC (271 KB)
[v4] Fri, 6 Dec 2019 00:49:17 UTC (308 KB)
[v5] Fri, 11 Sep 2020 22:19:39 UTC (353 KB)
Current browse context:
cs.ET
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
Connected Papers (What is Connected Papers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.