A star-nose-like tactile-olfactory bionic sensing array for robust object recognition in non-visual environments.

Λεπτομέρειες βιβλιογραφικής εγγραφής
Τίτλος: A star-nose-like tactile-olfactory bionic sensing array for robust object recognition in non-visual environments.
Συγγραφείς: Liu M; State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, 200050, China.; School of Graduate Study, University of Chinese Academy of Sciences, Beijing, 100049, China., Zhang Y; State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, 200050, China.; School of Graduate Study, University of Chinese Academy of Sciences, Beijing, 100049, China., Wang J; State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, 200050, China.; School of Graduate Study, University of Chinese Academy of Sciences, Beijing, 100049, China., Qin N; State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, 200050, China., Yang H; State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, 200050, China.; School of Graduate Study, University of Chinese Academy of Sciences, Beijing, 100049, China., Sun K; State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, 200050, China.; School of Graduate Study, University of Chinese Academy of Sciences, Beijing, 100049, China., Hao J; Institute of Automation, Chinese Academy of Sciences, Beijing, 100049, China., Shu L; Institute of Automation, Chinese Academy of Sciences, Beijing, 100049, China., Liu J; Institute of Automation, Chinese Academy of Sciences, Beijing, 100049, China., Chen Q; Shanghai Fire Research Institute of MEM, Shanghai, 200003, China., Zhang P; Suzhou Huiwen Nanotechnology Co., Ltd, Suzhou, 215004, China., Tao TH; State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, 200050, China. tiger@mail.sim.ac.cn.; School of Graduate Study, University of Chinese Academy of Sciences, Beijing, 100049, China. tiger@mail.sim.ac.cn.; Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing, 100049, China. tiger@mail.sim.ac.cn.; 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, 200050, China. tiger@mail.sim.ac.cn.; School of Physical Science and Technology, ShanghaiTech University, Shanghai, 200031, China. tiger@mail.sim.ac.cn.; Institute of Brain-Intelligence Technology, Zhangjiang Laboratory, Shanghai, 200031, China. tiger@mail.sim.ac.cn.; Shanghai Research Center for Brain Science and Brain-Inspired Intelligence, Shanghai, 200031, China. tiger@mail.sim.ac.cn.; Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, 200031, China. tiger@mail.sim.ac.cn.
Πηγή: Nature communications [Nat Commun] 2022 Jan 10; Vol. 13 (1), pp. 79. Date of Electronic Publication: 2022 Jan 10.
Τύπος έκδοσης: Journal Article; Research Support, Non-U.S. Gov't
Γλώσσα: English
Στοιχεία περιοδικού: Publisher: Nature Pub. Group Country of Publication: England NLM ID: 101528555 Publication Model: Electronic Cited Medium: Internet ISSN: 2041-1723 (Electronic) Linking ISSN: 20411723 NLM ISO Abbreviation: Nat Commun Subsets: MEDLINE
Imprint Name(s): Original Publication: [London] : Nature Pub. Group
Ιατρικοί όροι (MeSH): Electronic Nose* , Machine Learning* , Pattern Recognition, Physiological*, Pattern Recognition, Automated/*methods, Moles/anatomy & histology ; Moles/physiology ; Odorants/analysis ; Animals ; Fires ; Humans ; Simulation Training
Περίληψη: Object recognition is among the basic survival skills of human beings and other animals. To date, artificial intelligence (AI) assisted high-performance object recognition is primarily visual-based, empowered by the rapid development of sensing and computational capabilities. Here, we report a tactile-olfactory sensing array, which was inspired by the natural sense-fusion system of star-nose mole, and can permit real-time acquisition of the local topography, stiffness, and odor of a variety of objects without visual input. The tactile-olfactory information is processed by a bioinspired olfactory-tactile associated machine-learning algorithm, essentially mimicking the biological fusion procedures in the neural system of the star-nose mole. Aiming to achieve human identification during rescue missions in challenging environments such as dark or buried scenarios, our tactile-olfactory intelligent sensing system could classify 11 typical objects with an accuracy of 96.9% in a simulated rescue scenario at a fire department test site. The tactile-olfactory bionic sensing system required no visual input and showed superior tolerance to environmental interference, highlighting its great potential for robust object recognition in difficult environments where other methods fall short.
(© 2022. The Author(s).)
References: Nat Commun. 2022 Jan 10;13(1):79. (PMID: 35013205)
Nature. 2015 May 28;521(7553):436-44. (PMID: 26017442)
Nature. 2019 May;569(7758):698-702. (PMID: 31142856)
Comput Methods Programs Biomed. 2020 Sep;193:105479. (PMID: 32388066)
Sci Robot. 2018 Jun 27;3(19):. (PMID: 33141688)
Nature. 2015 Apr 30;520(7549):633-9. (PMID: 25896325)
Nanoscale. 2016 Jan 21;8(3):1430-6. (PMID: 26673658)
Nat Commun. 2019 Oct 30;10(1):4934. (PMID: 31666525)
Curr Opin Neurobiol. 2016 Oct;40:31-37. (PMID: 27344253)
Nat Methods. 2021 Feb;18(2):194-202. (PMID: 33479522)
ACS Appl Mater Interfaces. 2014 Sep 10;6(17):14975-80. (PMID: 25139871)
Sci Robot. 2020 Dec 16;5(49):. (PMID: 33328298)
ACS Appl Mater Interfaces. 2016 Apr 6;8(13):8652-61. (PMID: 26967662)
Cell. 2009 Oct 2;139(1):45-59. (PMID: 19804753)
IEEE Trans Image Process. 2010 Jun;19(6):1635-50. (PMID: 20172829)
Nanotechnology. 2015 Jul 10;26(27):275501. (PMID: 26066907)
Adv Mater. 2017 Feb;29(5):. (PMID: 27885730)
Nat Neurosci. 2001 Apr;4(4):353-4. (PMID: 11276222)
Sensors (Basel). 2011;11(3):2580-91. (PMID: 22163756)
Brain Struct Funct. 2015 Mar;220(2):955-77. (PMID: 24384580)
Nat Rev Neurosci. 2009 Mar;10(3):186-98. (PMID: 19190637)
Adv Mater. 2020 Apr;32(14):e1907043. (PMID: 31995260)
J Comp Neurol. 1995 Jan 23;351(4):549-67. (PMID: 7721983)
Sci Robot. 2019 Jan 30;4(26):. (PMID: 33137760)
ACS Appl Mater Interfaces. 2014 Aug 13;6(15):12429-35. (PMID: 25058566)
Entry Date(s): Date Created: 20220111 Date Completed: 20220126 Latest Revision: 20240405
Update Code: 20260130
PubMed Central ID: PMC8748716
DOI: 10.1038/s41467-021-27672-z
PMID: 35013205
Βάση Δεδομένων: MEDLINE
FullText Links:
  – Type: other
    Url: https://resolver.ebsco.com:443/public/rma-ftfapi/ejs/direct?AccessToken=46F187CA817460CB1AEF&Show=Object
Text:
  Availability: 0
CustomLinks:
  – Url: https://dx.doi.org/doi:10.1038/s41467-021-27672-z
    Name: EDS - Springer Nature Journals (s7799221)
    Category: fullText
    Text: View record at Springer
Header DbId: cmedm
DbLabel: MEDLINE
An: 35013205
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: A star-nose-like tactile-olfactory bionic sensing array for robust object recognition in non-visual environments.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AU" term="%22Liu+M%22">Liu M</searchLink>; State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, 200050, China.; School of Graduate Study, University of Chinese Academy of Sciences, Beijing, 100049, China.<br /><searchLink fieldCode="AU" term="%22Zhang+Y%22">Zhang Y</searchLink>; State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, 200050, China.; School of Graduate Study, University of Chinese Academy of Sciences, Beijing, 100049, China.<br /><searchLink fieldCode="AU" term="%22Wang+J%22">Wang J</searchLink>; State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, 200050, China.; School of Graduate Study, University of Chinese Academy of Sciences, Beijing, 100049, China.<br /><searchLink fieldCode="AU" term="%22Qin+N%22">Qin N</searchLink>; State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, 200050, China.<br /><searchLink fieldCode="AU" term="%22Yang+H%22">Yang H</searchLink>; State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, 200050, China.; School of Graduate Study, University of Chinese Academy of Sciences, Beijing, 100049, China.<br /><searchLink fieldCode="AU" term="%22Sun+K%22">Sun K</searchLink>; State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, 200050, China.; School of Graduate Study, University of Chinese Academy of Sciences, Beijing, 100049, China.<br /><searchLink fieldCode="AU" term="%22Hao+J%22">Hao J</searchLink>; Institute of Automation, Chinese Academy of Sciences, Beijing, 100049, China.<br /><searchLink fieldCode="AU" term="%22Shu+L%22">Shu L</searchLink>; Institute of Automation, Chinese Academy of Sciences, Beijing, 100049, China.<br /><searchLink fieldCode="AU" term="%22Liu+J%22">Liu J</searchLink>; Institute of Automation, Chinese Academy of Sciences, Beijing, 100049, China.<br /><searchLink fieldCode="AU" term="%22Chen+Q%22">Chen Q</searchLink>; Shanghai Fire Research Institute of MEM, Shanghai, 200003, China.<br /><searchLink fieldCode="AU" term="%22Zhang+P%22">Zhang P</searchLink>; Suzhou Huiwen Nanotechnology Co., Ltd, Suzhou, 215004, China.<br /><searchLink fieldCode="AU" term="%22Tao+TH%22">Tao TH</searchLink>; State Key Laboratory of Transducer Technology, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, 200050, China. tiger@mail.sim.ac.cn.; School of Graduate Study, University of Chinese Academy of Sciences, Beijing, 100049, China. tiger@mail.sim.ac.cn.; Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing, 100049, China. tiger@mail.sim.ac.cn.; 2020 X-Lab, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, 200050, China. tiger@mail.sim.ac.cn.; School of Physical Science and Technology, ShanghaiTech University, Shanghai, 200031, China. tiger@mail.sim.ac.cn.; Institute of Brain-Intelligence Technology, Zhangjiang Laboratory, Shanghai, 200031, China. tiger@mail.sim.ac.cn.; Shanghai Research Center for Brain Science and Brain-Inspired Intelligence, Shanghai, 200031, China. tiger@mail.sim.ac.cn.; Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai, 200031, China. tiger@mail.sim.ac.cn.
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22101528555%22">Nature communications</searchLink> [Nat Commun] 2022 Jan 10; Vol. 13 (1), pp. 79. <i>Date of Electronic Publication: </i>2022 Jan 10.
– Name: TypePub
  Label: Publication Type
  Group: TypPub
  Data: Journal Article; Research Support, Non-U.S. Gov't
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: TitleSource
  Label: Journal Info
  Group: Src
  Data: <i>Publisher: </i><searchLink fieldCode="PB" term="%22Nature+Pub%2E+Group%22">Nature Pub. Group </searchLink><i>Country of Publication: </i>England <i>NLM ID: </i>101528555 <i>Publication Model: </i>Electronic <i>Cited Medium: </i>Internet <i>ISSN: </i>2041-1723 (Electronic) <i>Linking ISSN: </i><searchLink fieldCode="IS" term="%2220411723%22">20411723 </searchLink><i>NLM ISO Abbreviation: </i>Nat Commun <i>Subsets: </i>MEDLINE
– Name: PublisherInfo
  Label: Imprint Name(s)
  Group: PubInfo
  Data: <i>Original Publication</i>: [London] : Nature Pub. Group
– Name: SubjectMESH
  Label: MeSH Terms
  Group: Su
  Data: <searchLink fieldCode="MM" term="%22Electronic+Nose%22">Electronic Nose*</searchLink> <br /><searchLink fieldCode="MM" term="%22Machine+Learning%22">Machine Learning*</searchLink> <br /><searchLink fieldCode="MM" term="%22Pattern+Recognition%2C+Physiological%22">Pattern Recognition, Physiological*</searchLink><br /><searchLink fieldCode="MM" term="%22Pattern+Recognition%2C+Automated%22">Pattern Recognition, Automated</searchLink>/<searchLink fieldCode="MM" term="%22Pattern+Recognition%2C+Automated+methods%22">*methods</searchLink><br /><searchLink fieldCode="MH" term="%22Moles%22">Moles</searchLink>/<searchLink fieldCode="MH" term="%22Moles+anatomy+%26+histology%22">anatomy & histology</searchLink> ; <searchLink fieldCode="MH" term="%22Moles%22">Moles</searchLink>/<searchLink fieldCode="MH" term="%22Moles+physiology%22">physiology</searchLink> ; <searchLink fieldCode="MH" term="%22Odorants%22">Odorants</searchLink>/<searchLink fieldCode="MH" term="%22Odorants+analysis%22">analysis</searchLink> ; <searchLink fieldCode="MH" term="%22Animals%22">Animals</searchLink> ; <searchLink fieldCode="MH" term="%22Fires%22">Fires</searchLink> ; <searchLink fieldCode="MH" term="%22Humans%22">Humans</searchLink> ; <searchLink fieldCode="MH" term="%22Simulation+Training%22">Simulation Training</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Object recognition is among the basic survival skills of human beings and other animals. To date, artificial intelligence (AI) assisted high-performance object recognition is primarily visual-based, empowered by the rapid development of sensing and computational capabilities. Here, we report a tactile-olfactory sensing array, which was inspired by the natural sense-fusion system of star-nose mole, and can permit real-time acquisition of the local topography, stiffness, and odor of a variety of objects without visual input. The tactile-olfactory information is processed by a bioinspired olfactory-tactile associated machine-learning algorithm, essentially mimicking the biological fusion procedures in the neural system of the star-nose mole. Aiming to achieve human identification during rescue missions in challenging environments such as dark or buried scenarios, our tactile-olfactory intelligent sensing system could classify 11 typical objects with an accuracy of 96.9% in a simulated rescue scenario at a fire department test site. The tactile-olfactory bionic sensing system required no visual input and showed superior tolerance to environmental interference, highlighting its great potential for robust object recognition in difficult environments where other methods fall short.<br /> (© 2022. The Author(s).)
– Name: Ref
  Label: References
  Group: RefInfo
  Data: Nat Commun. 2022 Jan 10;13(1):79. (PMID: <searchLink fieldCode="PM" term="%2235013205%22">35013205)</searchLink><br />Nature. 2015 May 28;521(7553):436-44. (PMID: <searchLink fieldCode="PM" term="%2226017442%22">26017442)</searchLink><br />Nature. 2019 May;569(7758):698-702. (PMID: <searchLink fieldCode="PM" term="%2231142856%22">31142856)</searchLink><br />Comput Methods Programs Biomed. 2020 Sep;193:105479. (PMID: <searchLink fieldCode="PM" term="%2232388066%22">32388066)</searchLink><br />Sci Robot. 2018 Jun 27;3(19):. (PMID: <searchLink fieldCode="PM" term="%2233141688%22">33141688)</searchLink><br />Nature. 2015 Apr 30;520(7549):633-9. (PMID: <searchLink fieldCode="PM" term="%2225896325%22">25896325)</searchLink><br />Nanoscale. 2016 Jan 21;8(3):1430-6. (PMID: <searchLink fieldCode="PM" term="%2226673658%22">26673658)</searchLink><br />Nat Commun. 2019 Oct 30;10(1):4934. (PMID: <searchLink fieldCode="PM" term="%2231666525%22">31666525)</searchLink><br />Curr Opin Neurobiol. 2016 Oct;40:31-37. (PMID: <searchLink fieldCode="PM" term="%2227344253%22">27344253)</searchLink><br />Nat Methods. 2021 Feb;18(2):194-202. (PMID: <searchLink fieldCode="PM" term="%2233479522%22">33479522)</searchLink><br />ACS Appl Mater Interfaces. 2014 Sep 10;6(17):14975-80. (PMID: <searchLink fieldCode="PM" term="%2225139871%22">25139871)</searchLink><br />Sci Robot. 2020 Dec 16;5(49):. (PMID: <searchLink fieldCode="PM" term="%2233328298%22">33328298)</searchLink><br />ACS Appl Mater Interfaces. 2016 Apr 6;8(13):8652-61. (PMID: <searchLink fieldCode="PM" term="%2226967662%22">26967662)</searchLink><br />Cell. 2009 Oct 2;139(1):45-59. (PMID: <searchLink fieldCode="PM" term="%2219804753%22">19804753)</searchLink><br />IEEE Trans Image Process. 2010 Jun;19(6):1635-50. (PMID: <searchLink fieldCode="PM" term="%2220172829%22">20172829)</searchLink><br />Nanotechnology. 2015 Jul 10;26(27):275501. (PMID: <searchLink fieldCode="PM" term="%2226066907%22">26066907)</searchLink><br />Adv Mater. 2017 Feb;29(5):. (PMID: <searchLink fieldCode="PM" term="%2227885730%22">27885730)</searchLink><br />Nat Neurosci. 2001 Apr;4(4):353-4. (PMID: <searchLink fieldCode="PM" term="%2211276222%22">11276222)</searchLink><br />Sensors (Basel). 2011;11(3):2580-91. (PMID: <searchLink fieldCode="PM" term="%2222163756%22">22163756)</searchLink><br />Brain Struct Funct. 2015 Mar;220(2):955-77. (PMID: <searchLink fieldCode="PM" term="%2224384580%22">24384580)</searchLink><br />Nat Rev Neurosci. 2009 Mar;10(3):186-98. (PMID: <searchLink fieldCode="PM" term="%2219190637%22">19190637)</searchLink><br />Adv Mater. 2020 Apr;32(14):e1907043. (PMID: <searchLink fieldCode="PM" term="%2231995260%22">31995260)</searchLink><br />J Comp Neurol. 1995 Jan 23;351(4):549-67. (PMID: <searchLink fieldCode="PM" term="%227721983%22">7721983)</searchLink><br />Sci Robot. 2019 Jan 30;4(26):. (PMID: <searchLink fieldCode="PM" term="%2233137760%22">33137760)</searchLink><br />ACS Appl Mater Interfaces. 2014 Aug 13;6(15):12429-35. (PMID: <searchLink fieldCode="PM" term="%2225058566%22">25058566)</searchLink>
– Name: DateEntry
  Label: Entry Date(s)
  Group: Date
  Data: <i>Date Created: </i>20220111 <i>Date Completed: </i>20220126 <i>Latest Revision: </i>20240405
– Name: DateUpdate
  Label: Update Code
  Group: Date
  Data: 20260130
– Name: PubmedCentralID
  Label: PubMed Central ID
  Group: ID
  Data: PMC8748716
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1038/s41467-021-27672-z
– Name: AN
  Label: PMID
  Group: ID
  Data: 35013205
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=cmedm&AN=35013205
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1038/s41467-021-27672-z
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        StartPage: 79
    Subjects:
      – SubjectFull: Moles anatomy & histology
        Type: general
      – SubjectFull: Moles physiology
        Type: general
      – SubjectFull: Odorants analysis
        Type: general
      – SubjectFull: Animals
        Type: general
      – SubjectFull: Fires
        Type: general
      – SubjectFull: Humans
        Type: general
      – SubjectFull: Simulation Training
        Type: general
      – SubjectFull: Electronic Nose
        Type: general
      – SubjectFull: Machine Learning
        Type: general
      – SubjectFull: Pattern Recognition, Physiological
        Type: general
      – SubjectFull: Pattern Recognition, Automated methods
        Type: general
    Titles:
      – TitleFull: A star-nose-like tactile-olfactory bionic sensing array for robust object recognition in non-visual environments.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Liu M
      – PersonEntity:
          Name:
            NameFull: Zhang Y
      – PersonEntity:
          Name:
            NameFull: Wang J
      – PersonEntity:
          Name:
            NameFull: Qin N
      – PersonEntity:
          Name:
            NameFull: Yang H
      – PersonEntity:
          Name:
            NameFull: Sun K
      – PersonEntity:
          Name:
            NameFull: Hao J
      – PersonEntity:
          Name:
            NameFull: Shu L
      – PersonEntity:
          Name:
            NameFull: Liu J
      – PersonEntity:
          Name:
            NameFull: Chen Q
      – PersonEntity:
          Name:
            NameFull: Zhang P
      – PersonEntity:
          Name:
            NameFull: Tao TH
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 10
              M: 01
              Text: 2022 Jan 10
              Type: published
              Y: 2022
          Identifiers:
            – Type: issn-electronic
              Value: 2041-1723
          Numbering:
            – Type: volume
              Value: 13
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Nature communications
              Type: main
ResultId 1