Abstract
Automatic venipuncture robots are expected to replace manual venipuncture methods owing to their high control precision, steady operation, and measurable perception. However, the lack of perception of the venipuncture status in the human body leads to an increased risk and failure rate, which further restricts the development of such robots. To address this, we propose a humanoid venipuncture method guided by a biomechanical model to imitate human sensations and feedback. This method intends to perceive the venipuncture status and improve the performance of the venipuncture robot. First, this study establishes a biomechanical venipuncture model, which thoroughly considers the elastic deformation, cutting, and friction of tissues and can be applied to different venipuncture conditions. Then, venipuncture simulations and in vitro phantom experiments are performed under various settings to analyze and validate the model. Finally, to evaluate the robotic humanoid venipuncture method, we apply the method to a self-developed six-degree-of-freedom venipuncture robot via rabbit ear veins with a success rate of approximately 90%. This work demonstrates that the humanoid venipuncture method based on the biomechanical model is practical and rapid in processing simple information in venipuncture robots.
Keywords: Biomechanical model, Force feedback, Status perception, Venipuncture robot
Biographies
Tianbao He
received the B.S. degree in Mechanical Engineering from Harbin Institute of Technology, Harbin, China, in 2018. He is currently pursuing the Ph.D. degree with the State Key Laboratory of Robotics and System, Harbin Institute of Technology. His research interests include venous perception and autonomous decision-making for the venipuncture robot.
Chuangqiang Guo
received the B.S. and M.S. degrees from the Harbin University of Science and Technology, Harbin, China, in 2005 and 2008, respectively, and the Ph.D.degree from Harbin Institute of Technology (HIT), Harbin, China, in 2012, all in mechanical engineering. He is currently an Associate Research Fellow with the State Key Laboratory of Robotics and Systems, HIT. His research interests include the design and control technologies of ac motor drive and robotic systems.
Hansong Liu
received the B.S. degree in Automation from Northeastern University, Shenyang, China, in 2020. He is currently pursuing the Master’s degree with the State Key Laboratory of Robotics and System, Harbin Institute of Technology. His research interests include the design of sensing and control systems for the venipuncture robot.
Li Jiang
received the B.S. degree in optical instrumentation from Tsinghua University, Beijing, China, in 1993, and the Ph.D. degree in mechanical engineering from the Harbin Institute of Technology, Harbin, China, in 2001. He is currently a Professor with the State Key Laboratory of Robotics and System, Harbin Institute of Technology. His research interests include the robotic hand, prostheses, medical robot, sensors and control algorithms.
Author Contributions
Tianbao He and Li Jiang conceived and designed the study. Tianbao He and Hansong Liu performed the experiments. Tianbao He wrote the paper. Tianbao He, Li Jiang, and Chuangqiang Guo reviewed and edited the manuscript. All authors read and approved the manuscript.
Funding
This work was supported by the National Natural Science Foundation of China (U1813209), Self-Planned Task (NO. SKLRS202112B) of State Key Laboratory of Robotics and System (HIT).
Code or Data Availability
Not applicable.
Declarations
Conflicts of Interest
We declare that we have no financial and personal relationships with other people or organizations that can inappropriately influence our work. There is no professional or other personal interest of any nature or kind in any product, service, or company that could be construed as influencing the position presented in or the review of the manuscript entitled.
Ethics Approval
This study did not cause harm to the subjects, and the subjects were well fed and cared for. We consulted extensively with the IRB that our study did not need ethical approval.
Consent to Participate
Not applicable.
Consent for Publication
Not applicable.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.De Boer, T., Steinbuch, M., Neerken, S., Kharin, A.: Laboratory study on needle–tissue interaction: towards the development of an instrument for automatic venipuncture. J. Mech. Med. Biol. 07, 325–335 (2007). 10.1142/S0219519407002297
- 2.Zeng S, Yan X. Effect of compositive nursing measures on pedi-atric infusion compliance and comfort. Chin. J. Med. Guide. 2017;19:88–90. [Google Scholar]
- 3.Douissard J, Hagen ME, Morel P. The da Vinci surgical system. In: Domene CE, Kim KC, Vilallonga Puy R, Volpe P, editors. Bariatric robotic surgery: a comprehensive guide. Cham: Springer International Publishing; 2019. pp. 13–27. [Google Scholar]
- 4.Zhang W, Zhang Y, Liu Y. Design and control of a bionic needle puncture robot. The International Journal of Medical Robotics and Computer Assisted. Surgery. 2021;17:e2200. doi: 10.1002/rcs.2200. [DOI] [PubMed] [Google Scholar]
- 5.He T, Guo C, Ren H, Jiang L. Research progress of venipuncture robot. J. Mech. Eng. 2021;57:1–10. [Google Scholar]
- 6.Qi, W., Su, H.: A cybertwin based multimodal network for ECG patterns monitoring using deep learning. IEEE Trans. Industr. Inform. 1–1 (2022). 10.1109/TII.2022.3159583
- 7.Su, H., Qi, W., Chen, J., Zhang, D.: Fuzzy approximation-based task-space control of robot manipulators with remote center of motion constraint. IEEE Trans. Fuzzy Syst. 1–1 (2022). 10.1109/TFUZZ.2022.3157075
- 8.Su H, Hu Y, Karimi HR, Knoll A, Ferrigno G, De Momi E. Improved recurrent neural network-based manipulator control with remote center of motion constraints: Experimental results. Neural Netw. 2020;131:291–299. doi: 10.1016/j.neunet.2020.07.033. [DOI] [PubMed] [Google Scholar]
- 9.Hu, Y., Su, H., Chen, G., Ferrigno, G., De Momi, E., Knoll, A.: hierarchical optimization control of redundant manipulator for robot-assisted minimally invasive surgery. In: 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). pp. 2929–2934 (2020)
- 10.Hu Y, Li J, Chen Y, Wang Q, Chi C, Zhang H, Gao Q, Lan Y, Li Z, Mu Z, Sun Z, Knoll A. Design and control of a highly redundant rigid-flexible coupling robot to assist the COVID-19 oropharyngeal-swab sampling. IEEE Robot. Autom. Lett. 2022;7:1856–1863. doi: 10.1109/LRA.2021.3062336. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Qiao Z, Li Y, Wu Z, Kou J. Automatic Puncture System Based on NIR Image and Ultrasonic Image. MATEC Web Conf. 2017;108:15002. doi: 10.1051/matecconf/201710815002. [DOI] [Google Scholar]
- 12.Balter ML, Chen AI, Maguire TJ, Yarmush ML. The system design and evaluation of a 7-DOF image-guided venipuncture robot. IEEE Trans. Robot. 2015;31:1044–1053. doi: 10.1109/TRO.2015.2452776. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Harris, R.J., Grove, C., Mygatt, J.B.: Autonomous intravenous needle
- 14.Curtis SJ, Craig WR, Logue E, Vandermeer B, Hanson A, Klassen T. Ultrasound or near-infrared vascular imaging to guide peripheral intravenous catheterization in children: a pragmatic randomized controlled trial. CMAJ. 2015;187:563–570. doi: 10.1503/cmaj.141012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Dong, J.: Design and experiment of the prototype of venous blood drawing robot, https://kns.cnki.net/KCMS/detail/detail.aspx?dbcode=CMFD&dbname=CMFD202001&filename=1019649245.nh&v=, (2019)
- 16.Perry T. Profile: Veebot [Resources_Start-ups] IEEE Spectr. 2013;50:23–23. doi: 10.1109/MSPEC.2013.6565554. [DOI] [Google Scholar]
- 17.Mwikirize, C., Nosher, J.L., Hacihaliloglu, I.: Convolution neural networks for real-time needle detection and localization in 2D ultrasound. Int J CARS. 13, 647–657 (2018). 10/gdkb74 [DOI] [PubMed]
- 18.Cheng, Z., Davies, B.L., Caldwell, D.G., Mattos, L.S.: A venipuncture detection system for robot-assisted intravenous catheterization. In: 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob). pp. 80–86. IEEE, Singapore, Singapore (2016)
- 19.Kim A, Kim, Park C. Lock-in amplifier-based impedance detection of tissue type using a monopolar injection needle. Sensors. 2019;19:4614. doi: 10.3390/s19214614. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Hyink S, Whittemore JC, Mitchell A, Reed A. Diagnostic accuracy of tissue impedance measurement interpretation for correct veress needle placement in feline cadavers: tissue impedance measurement interpretation for veress needle placement in cats. Vet. Surg. 2013;42:623–628. doi: 10.1111/j.1532-950X.2013.01098.x. [DOI] [PubMed] [Google Scholar]
- 21.Abbasi MA, Kim H, Chinnadayyala SR, Park KD, Cho S. Real-time impedance detection of intra-articular space in a porcine model using a monopolar injection needle. Sensors. 2020;20:4625. doi: 10.3390/s20164625. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Saito H, Mitsubayashi K, Togawa T. Detection of needle puncture to blood vessel by using electric conductivity of blood for automatic blood sampling. Sensors Actuators A Phys. 2006;125:446–450. doi: 10.1016/j.sna.2005.06.012. [DOI] [Google Scholar]
- 23.Al-Harosh, M.B., Shchukin, S.I.: Peripheral vein detection using electrical impedance method. 5 (2017)
- 24.AL-Harosh, M.B., Shchukin, S.I. Numerical modeling of the electrical impedance method of peripheral veins localization. In: Jaffray DA, editor. World Congress on Medical Physics and Biomedical Engineering, June 7-12, 2015, Toronto, Canada. Cham: Springer International Publishing; 2015. pp. 1683–1686. [Google Scholar]
- 25.Fontana, M., Fabio, S., Marcheschi, S., Bergamasco, M.: Haptic Hand Exoskeleton for Precision Grasp Simulation. Journal of Mechanisms and Robotics. 5, 041014 (2013). 10/gkgb2t
- 26.Wyke, M.: The effect of brain lesions in the performance of an arm-hand precision task. Neuropsychologia. 6, 125–134 (1968). 10/b9njsc
- 27.Su H, Qi W, Hu Y, Karimi HR, Ferrigno G, Momi ED. An incremental learning framework for human-like redundancy optimization of anthropomorphic manipulators. IEEE Trans. Industr. Inform. 2022;18:1864–1872. doi: 10.1109/TII.2020.3036693. [DOI] [Google Scholar]
- 28.Su, H., Zhang, J., Fu, J., Ovur, S.E., Qi, W., Li, G., Hu, Y., Li, Z.: Sensor fusion-based anthropomorphic control of under-actuated bionic hand in dynamic environment. In: 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). pp. 2722–2727 (2021)
- 29.Nagchaudhuri, A., Garg, D.P.: Adaptive control and impedance control for dual robotic arms manipulating a common heavy load. In: 2001 IEEE/ASME International Conference on Advanced Intelligent Mechatronics. Proceedings (Cat. No.01TH8556). pp. 683–688. IEEE, Como, Italy (2001)
- 30.Cortesão, R., Dominici, M.: Robot force control on a beating heart. IEEE/ASME Transactions on Mechatronics. 22, 1736–1743 (2017). 10/gbtjmt
- 31.Osa, T., Sugita, N., Mitsuishi, M.: Online trajectory planning and force control for automation of surgical tasks. IEEE Transactions on Automation Science and Engineering. 15, 675–691 (2018). 10/gdcphx
- 32.Jiang, S., Li, P., Yu, Y., Liu, J., Yang, Z.: Experimental study of needle–tissue interaction forces: Effect of needle geometries, insertion methods and tissue characteristics. Journal of Biomechanics. 47, 3344–3353 (2014). 10/f6m2jm [DOI] [PubMed]
- 33.Barnett, A.C., Lee, Y.-S., Moore, J.Z.: Fracture mechanics model of needle cutting tissue. J. Manuf. Sci. Eng. 138 (2015). 10.1115/1.4030374
- 34.Okamura AM, Simone C, O'Leary MD. Force modeling for needle insertion into soft tissue. IEEE Trans. Biomed. Eng. 2004;51:1707–1716. doi: 10.1109/TBME.2004.831542. [DOI] [PubMed] [Google Scholar]
- 35.Su, H., Fischer, G.S.: A 3-axis optical force/torque sensor for prostate needle placement in Magnetic resonance imaging environments. In: 2009 IEEE International Conference on Technologies for Practical Robot Applications. pp. 5–9. IEEE, Woburn, MA, USA (2009)
- 36.Su, Z.: Force modeling for needle insertion into soft tissue and measurement of needle deflection
- 37.Fukushima, Y., Naemura, K.: Estimation of the friction force during the needle insertion using the disturbance observer and the recursive least square. Robomech J. 1, 14 (2014). 10/gn9qzm
- 38.Gordon, A., Kim, I., Barnett, A.C., Moore, J.Z.: Needle insertion force model for haptic simulation. In: Volume 2: Materials; biomanufacturing; properties, applications and systems; sustainable manufacturing. p. V002T03A003. American Society of Mechanical Engineers, Charlotte, North Carolina, USA (2015)
- 39.Datla NV, Konh B, Honarvar M, Podder TK, Dicker AP, Yu Y, Hutapea P. A model to predict deflection of bevel-tipped active needle advancing in soft tissue. Med. Eng. Phys. 2014;36:285–293. doi: 10.1016/j.medengphy.2013.11.006. [DOI] [PubMed] [Google Scholar]
- 40.Li, Z., Li, M., Wei, J., Su, B., Pan, C., Kuang, S., Zhou, L.: A robotic system for investigation on mis-alignment force of needle and vein needle insertion into blood vessel. In: 2017 2nd Asia-Pacific Conference on Intelligent Robot Systems (ACIRS). pp. 280–283. IEEE, Wuhan, China (2017)
- 41.Kobayashi Y, Hamano R, Watanabe H, Hong J, Toyoda K, Hashizume M, Fujie MG. Use of puncture force measurement to investigate the conditions of blood vessel needle insertion. Med. Eng. Phys. 2013;35:684–689. doi: 10.1016/j.medengphy.2012.12.003. [DOI] [PubMed] [Google Scholar]
- 42.Sneddon, I.N.: The relation between load and penetration in the axisymmetric boussinesq problem for a punch of arbitrary profile. International Journal of Engineering Science. 3, 47–57 (1965). 10/c445s9
- 43.Han, H.: Research on the friction and cutting model of bev-el-tip flexible needle insertion, https://kns.cnki.net/KCMS/detail/detail.aspx?dbcode=CMFD&dbname=CMFD201401&filename=1013036480.nh&v=, (2012)
- 44.Asadian, A., Kermani, M.R., Patel, R.V.: A compact dynamic force model for needle-tissue interaction. In: 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology. pp. 2292–2295. IEEE. Buenos Aires. (2010) [DOI] [PubMed]
- 45.Lv, R., Li, T., Huang, X.: Study on tribological behavior of NBR under variable velocity. China Synthetic Rubber Industry. 101–103 (2002)
- 46.Yankelevsky, D.Z., Eisenberger, M., Adin, M.A.: Analysis of beams on nonlinear winkler foundation. Computers & Structures. 31, 287–292 (1989). 10/bn49np
- 47.Yeoh OH. Some forms of the strain energy function for rubber. Rubber Chem. Technol. 1993;66:754–771. doi: 10.5254/1.3538343. [DOI] [Google Scholar]
- 48.Ren, H.: Research on perception and control of full-automatic venipuncture robot, https://kns.cnki.net/KCMS/detail/detail.aspx?dbcode=CMFD&dbname=CMFD202101&filename=1020400374.nh&v=, (2020)
- 49.He, T., Guo, C., Jiang, L., Liu, H.: Automatic venous segmentation in venipuncture robot using deep learning. In: 2021 IEEE International Conference on Real-time Computing and Robotics (RCAR). pp. 614–619 (2021)
- 50.Kobayashi, Y., Sato, T., Fujie, M.G.: Modeling of friction force based on relative velocity between liver tissue and needle for needle insertion simulation. In: 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society. pp. 5274–5278. IEEE, Minneapolis, MN (2009) [DOI] [PubMed]
- 51.Okuno, D., Togawa, T., Saito, H., Tsuchiya, K.: Development of an automatic blood sampling system: control of the puncturing needle by measuring forces. In: Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286). pp. 1811–1812. IEEE, Hong Kong, China (1998)
- 52.Casanova F, Carney PR, Sarntinoranont M. In vivo evaluation of needle force and friction stress during insertion at varying insertion speed into the brain. J. Neurosci. Methods. 2014;237:79–89. doi: 10.1016/j.jneumeth.2014.08.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Lee, J., Jeon, W., Lee, B., Pineau, J., Kim, K.-E.: OptiDICE: offline policy optimization via stationary distribution correction estimation. In: Proceedings of the 38th International Conference on Machine Learning. pp. 6120–6130. PMLR (2021)
- 54.Meng B, Wang Y, Mao J, Liu J, Xu G, Dai J. Using SoC online correction method based on parameter identification to optimize the operation range of NI-MH battery for electric boat. Energies. 2018;11:586. doi: 10.3390/en11030586. [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Not applicable.
