Technische Universität München
New algorithm for classification of skin lesions - Deep learning algorithm with improved diagnostic accuracy
TECHNICAL UNIVERSITY OF MUNICH
Corporate Communications Center
phone: +49 89 289 10808 - email: presse@tum.de - web: www.tum.de
This text on the web: https://www.tum.de/en/about-tum/news/press-releases/details/37139
Picture: https://mediatum.ub.tum.de/1638729
NEWS RELEASE
New algorithm for classification of skin lesions
Deep learning algorithm with improved diagnostic accuracy
Dermatologists typically classify skin lesions based on multiple data sources. Algorithms that fuse the information together can support this classification. An international research team has now developed an algorithm that classifies skin lesions more accurately than previous algorithms by using an improved data fusion process.
Many people worldwide suffer from skin diseases. For diagnosis, physicians often combine multiple information sources. These include, for instance, clinical images, microscopic images and meta-data such as the age and gender of the patient. Deep learning algorithms can support the classification of skin lesions by fusing all the information together and evaluating it. Several such algorithms are already being developed. However, to apply these learning algorithms in the clinic, they need to be further improved to achieve higher diagnostic accuracy.
New data fusion method improves diagnostic accuracy
A research team led by PD Dr. Tobias Lasser from the Munich Institute of Biomedical Engineering (MIBE) at the Technical University of Munich (TUM) has now developed a new learning algorithm - FusionM4Net - that displays higher average diagnostic accuracy than previous algorithms. The code for FusionM4Net is freely available (https://ciip.in.tum.de/software.html). The new algorithm uses a so-called multi-modal multi-stage data fusion process for multi-label skin lesion classification.
• Multi-modal: The learning algorithm includes three different types of data: Clinical images, microscopic images of the suspicious skin lesion, and patient metadata.
• Multi-label: The researchers trained the algorithm for multi-label skin classification, i.e. it can differentiate between five different categories of skin lesions.
• Multi-stage: The new algorithm first fuses together the available image data and then the patient’s metadata. This two-stage process allows image data and metadata to be weighted in the algorithm's decision-making process. This distinguishes FusionM4Net considerably from previous algorithms in this field, which merge all data at once.
To evaluate the diagnostic accuracy of an algorithm, it can be compared to the best existing classification for the used dataset, for which the value 100 percent is assigned. The average diagnostic accuracy of FusionM4Net improved to 78.5 percent through the multi-stage fusion process, outperforming all other state-of-the-art algorithms with which it was compared.
Working towards clinical application
To foster reproducibility, a publicly available dataset was used to train the algorithm. However, in dermatology, datasets are not standardized everywhere. Depending on the clinic, different types of images and patient information may be available. Thus, for actual clinical deployment, the algorithm must be able to handle the type of data that is available at each specific clinic.
Together with the Department of Dermatology and Allergology at the University Hospital of LMU Munich, the research team is working intensely on making the algorithm operational for future clinical routine. To this end, the team is currently integrating numerous datasets that have been standardized for this clinic.
“Future routine clinical use of algorithms with high diagnostic accuracy might help ensure that rare diseases are also detected by less experienced physicians and it might mitigate decisions affected by stress or fatigue”, says PD Dr. Tobias Lasser. Thus, learning algorithms could help improve the overall level of medical care.
Publication:
Peng Tang, Xintong Yan, Yang Nan, Shao Xiang, Sebastian Krammer, Tobias Lasser. FusionM4Net: A multi-stage multi-modal learning algorithm for multi-label skin lesion classification. Medical Image Analysis, November 22, 2021. DOI: 10.1016/j.media.2021.102307
https://doi.org/10.1016/j.media.2021.102307
More information:
• The raw code of FusionM4Net is publicly available at https://ciip.in.tum.de/software.html.
• The Department of Dermatology and Allergology at the University Hospital of the LMU Munich and the company Avelios Medical GmbH in Munich are partners of TUM in this research project.
• The research project is partially funded by the German Federal Ministry of Health. The China Scholarship Council funds a research scholarship for one of the authors.
• PD Dr. Tobias Lasser is a Principal Investigator at the Munich Institute of Biomedical Engineering (MIBE). MIBE is an Integrative Research Institute within the Technical University of Munich (TUM) in Germany. At MIBE, researchers specializing in medicine, the natural sciences, and engineering join forces to develop new methods for diagnosing, preventing and treating diseases and to work on technologies that compensate for physical disabilities. The activities cover the whole development process – beginning with the study of basic scientific principles and ending with their application in new medical devices, medicines, and software programs.
Contact:
PD Dr. Tobias Lasser
Technical University of Munich
Munich Institute of Biomedical Engineering (MIBE)
Phone: +49 89 289 10807
lasser@in.tum.de
https://www.bioengineering.tum.de/en/
The Technical University of Munich (TUM) is one of Europe’s leading research universities, with more than 600 professors, 48,000 students, and 11,000 academic and non-academic staff. Its focus areas are the engineering sciences, natural sciences, life sciences and medicine, combined with economic and social sciences. TUM acts as an entrepreneurial university that promotes talents and creates value for society. In that it profits from having strong partners in science and industry. It is represented worldwide with the TUM Asia campus in Singapore as well as offices in Beijing, Brussels, Mumbai, San Francisco, and São Paulo. Nobel Prize winners and inventors such as Rudolf Diesel, Carl von Linde, and Rudolf Mößbauer have done research at TUM. In 2006, 2012, and 2019 it won recognition as a German "Excellence University." In international rankings, TUM regularly places among the best universities in Germany.