Rib Fracture Detection with Dual-Attention Enhanced U-Net

Zhou, Zhengyin; Fu, Zhihui; Jia, Juncheng; Lv, Jun

doi:https://doi.org/10.1155/2022/8945423

Computational and Mathematical Methods in Medicine

On this page

Abstract Introduction Materials and Methods Results and Discussion Discussion Conclusions Data Availability Conflicts of Interest Authors’ Contributions Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2022 | Article ID 8945423 | https://doi.org/10.1155/2022/8945423

Rib Fracture Detection with Dual-Attention Enhanced U-Net

Zhengyin Zhou,¹Zhihui Fu,²Juncheng Jia,¹and Jun Lv³

Academic Editor: Kuruva Lakshmanna

Received28 Mar 2022

Revised24 Jul 2022

Accepted02 Aug 2022

Published18 Aug 2022

Abstract

Rib fractures are common injuries caused by chest trauma, which may cause serious consequences. It is essential to diagnose rib fractures accurately. Low-dose thoracic computed tomography (CT) is commonly used for rib fracture diagnosis, and convolutional neural network- (CNN-) based methods have assisted doctors in rib fracture diagnosis in recent years. However, due to the lack of rib fracture data and the irregular, various shape of rib fractures, it is difficult for CNN-based methods to extract rib fracture features. As a result, they cannot achieve satisfying results in terms of accuracy and sensitivity in detecting rib fractures. Inspired by the attention mechanism, we proposed the CFSG U-Net for rib fracture detection. The CSFG U-Net uses the U-Net architecture and is enhanced by a dual-attention module, including a channel-wise fusion attention module (CFAM) and a spatial-wise group attention module (SGAM). CFAM uses the channel attention mechanism to reweight the feature map along the channel dimension and refine the U-Net’s skip connections. SGAM uses the group technique to generate spatial attention to adjust feature maps in the spatial dimension, which allows the spatial attention module to capture more fine-grained semantic information. To evaluate the effectiveness of our proposed methods, we established a rib fracture dataset in our research. The experimental results on our dataset show that the maximum sensitivity of our proposed method is 89.58%, and the average FROC score is 81.28%, which outperforms the existing rib fracture detection methods and attention modules.

1. Introduction

Rib fractures are associated with significant morbidity and are detected in at least 10% of all injured patients [1], with patients frequently requiring admission to the intensive care unit (ICU) and mortality rates as high as 33% [2]. To avoid serious consequences, accurate detection of rib fractures is important. Low-dose thoracic computed tomography (CT) scans are commonly used in the assessment and auxiliary diagnosis of rib fractures [3, 4], but missed diagnoses are common. Studies have shown that the sensitivity of diagnosis of rib fractures is only about 60% on initial chest CT evaluations [5], and missed diagnosis may cause severe medical accidents. Moreover, it is time-consuming for radiologists to find and locate rib fractures in numerous CT slices.

Artificial intelligence (AI) has recently made remarkable progress. It is widely used in medical data analysis, such as detection of diabetic retinopathy [6], classification of neonates cry [7], and analysis of electroencephalogram (EEG) signals [8]. The detection of rib fracture can be regarded as a computer vision task. Deep convolutional neural networks (CNNs) are used to extract the features hard to find by human beings and achieve the state-of-the-art performance in many computer vision tasks [9–13]. As for computer-aided diagnosis, CNNs are widely used for segmentation, detection, and classification of lesions in medical images, such as lung nodule detection and classification [14–16], brain tumor segmentation [17–19], breast cancer detection and classification [20–22], which demonstrate their extraordinary ability to outperform medical professionals.

Motivated by the successful application of CNNs in computer-aided diagnosis, several initial attempts have been made to design rib fracture detection algorithms based on CNNs in recent years. For instance, Chen et al. [23] presented a spatial coherence-based rib fracture detection method to detect rib fractures. They first gave a novel feature extraction method to extract the rib regions from CT slices. Then, for each rib region, they applied a spatial coherence convolutional neural network to recognize rib fractures. Zhou et al. [24] used Faster R-CNN [25], a two-stage region-based object detection model, to locate and classify rib fractures in 2D CT slices. Jin et al. [26] proposed a 3D CNN network called FracNet, based on U-Net [27], to segment the rib fracture region from a single cut patch. Then, they applied a sliding window mechanism for the whole 3D CT volume to detect rib fractures. Meng et al. [28] proposed a fully automated rib fracture detection pipeline consisting of five stages: rib segmentation, vertebra detection, rib labeling, rib fracture detection, and rib fracture classification. In the rib fracture detection stage, the proposed model VRB-net was used to locate the fracture and output the probability map, which is based on the V-Net structure and includes a ResNet module (R-module) and a bottleneck ResNet module (B-module). These works use 2D or 3D CNNs to detect rib fractures and have achieved good results. But there is still research space of improving the CNN network’s ability to get a better result in rib fracture detection tasks. There are still some problems with rib fracture detection using CNN networks. On the one hand, it is challenging to collect rib fracture data due to obstacles such as privacy ethics and data labeling cost, which lead to limited training data. On the other hand, some of the rib fracture regions are not apparent compared with the normal rib regions. With the narrow shape of ribs and various irregular fracture structures, rib fractures can be easily confused with normal ribs in CT images and misdiagnosed. These issues limit the performance of CNN models. Table 1 lists the relevant works and the challenges they face.

The attention mechanism has been widely studied recently in various AI areas. The idea of the attention mechanism is to focus on essential information and quickly obtain the most effective information, which can help the CNN network learn more fine-grained information from the samples to improve the feature extraction ability. Inspired by the attention mechanism, we proposed a U-Net-based rib fracture detection algorithm for automatic and accurate rib fracture detection called CFSG U-Net. To improve the detection performance in our algorithm, we proposed a dual-attention mechanism to help the network learn rib fracture features from limited data, which includes a channel-wise fusion attention module (CFAM) and a spatial-wise group attention module (SGAM). CFAM focuses on the channel relationship in CNNs, and adaptively redistributes the weights of features along the channel dimension. Besides, we also use CFAM to refine the U-Net’s skip connections. The study has shown a semantic gap between low-level and high-level features merged in U-Net’s long skip connections [29, 30], which hurts the network’s performance. CFAM is used to adjust these two sets of features before convolutional blocks merge them to help them fuse effectively. SGAM focuses on spatial information and adjusts the weights along the spatial dimension. Commonly spatial attention in [31, 32] uses average-pooling or max-pooling to aggregate channel-wise information, which may lose fine-grained information and cannot fully characterize the various semantic information of the feature map. To solve this problem, we divide feature maps into several groups. Each group generates channel-wise statistics individually to learn spatial attention maps, allowing spatial attention to capturing more fine-grained semantic information.

To verify the performance of our proposed method, we established a dataset of rib fractures from the local hospital’s patients, including 3134 rib fracture annotations for 818 CT images.

The contributions of this paper are summarized as follows: (i)We propose the CFSG U-Net for automatic rib fracture detection, which is enhanced by our proposed novel dual-attention mechanism including CFAM and SGAM(ii)We established a rib fracture dataset, including 3134 rib fracture annotations for 818 CT images(iii)Our proposed method achieves a sensitivity of 89.58%, and the average FROC score is 81.28% on our dataset, which outperforms the state-of-the-art methods.

2. Materials and Methods

2.1. Ethics

All procedures involving human participants in this retrospective study were approved by the ethics committee of Suzhou TCM Hospital Affiliated to the Nanjing University of Chinese Medicine. The requirement for informed consent was waived according to the ethical standards of the institutional review board.

2.2. Materials

A total of 818 patients participated in this study. We collected 818 CT images of patients with chest trauma between March 2017 to April 2019 from the hospital’s picture archiving and communication systems (PACS). There are 511 male and 307 female patients, with an average age of 57. All CT scans were acquired from a CT machine with a voltage of 270 kV and a current of 200-300 mA, stored in digital imaging and communications in medicine (DICOM) format. The scan thickness was 1.25-5 mm.

Three experienced musculoskeletal radiologists completed the annotation of CT images. Two have more than five years of experience in musculoskeletal CT imaging diagnosis, and the senior one has more than ten years of experience. Firstly, all CT images were checked by two junior doctors, combined with the perspectives of the coronal, sagittal, and horizontal planes, to find out and locate the rib fractures and mark them with 3D masks. The results of the initial annotation were reviewed by the senior radiologist and confirmed the final ground truth. All CT images were annotated by ITK-SNAP [33], and the labels were exported in neuroimaging informatics technology initiative (NIFTI) format. Finally, 3134 annotations were acquired. An example of the annotation can be seen in Figure 1.

(a)

(b)

(c)

The dataset was randomly divided into three parts, including the training set, validation set, and test set with a ratio of 7 : 1 : 2. We trained the model on the training set and adjusted the hyperparameters on the validation set to obtain the model with the best performance. Finally, we tested the model’s actual performance on the test set.

2.3. Data Preprocessing

In addition to the bone region, chest CT contains information about other tissues. Such redundant information may negatively impact prediction accuracy and detection speed. Removing these redundant tissues is an intuitive way to avoid such negative impacts. For this purpose, we use a series of morphological operations to extract the bone regions in the CT image and then normalize the results to obtain the final input data for the neural network. The overall procedure is illustrated in Figure 2.

(a)

(b)

(c)

(d)

(e)

(f)

(g)

(h)

The original image is shown in Figure 2(a). If we extract the largest connected components directly after binarizing the image using a certain threshold to obtain the bone region, some ribs may be lost, especially for the eleventh and twelfth ribs. Therefore, we remove small connected components and apply dilation operations before extracting the largest connected components.

First, we select the threshold of 180 HU to binarize the image to capture the high-intensity bone region (Figure 2(b)). After that, the connected components include bone regions and other redundant tissues and noise. If we make a dilation operation immediately, these distracting components will be mixed with the bone areas. Therefore, before the dilation operation, we remove the connected components smaller than 4000 mm³ in volume (Figure 2(c)). The surrounding areas of bone tissues, including cortical and bone marrow, are important for diagnosing rib fractures, but the mask cannot completely cover these areas after binarization. Therefore, we make a morphological dilation operation to expand the regions and fill small holes (Figure 2(d)). After all the above operations, we extract the largest connected components to obtain the bone region mask we need (Figure 2(e)). Finally, we multiply the bone region mask with the original image, all parts within the mask retain the original information, while everything outside the mask is filled with -300 . The extracted bone region can be seen in Figure 2(f).

To make the bone clear, we adjust the CT image to the bone window, the window width is 1200, and the window level is 300. Finally, we use min-max normalization to transform the data to the range . The formula for min-max normalization is as follows:

The final output of preprocessing can be seen in Figures 2(g) and 2(h).

2.4. Proposed Neural Network Structure

Our proposed CFSG U-Net uses the encoder-decoder structure based on U-Net, a widely used architecture for medical image segmentation. The detailed design of our proposed network is shown in Figure 3.

In the encoder path, CSFG U-Net gradually downsamples and doubles the number of channels. In contrast, in the decoder path, the resolution is restored step by step with transpose convolution, and the number of channels is reduced by convolution; skip connections are used to introduce the fine-grained information of low-level features to help the feature map restore the resolution.

The encoder block includes convolutional layers, batch normalization, and ReLU activation function. Moreover, the residual connections proposed by He et al. [34] are introduced to extract more accurate rib fracture features. Recent work [35, 36] has shown that convolution may lose information, while residual connections can help deliver contextual information, improve segmentation accuracy, and accelerate the convergence speed. After that, max-pooling layers are used to downsample the feature maps.

In the decoder block, we propose a channel-wise fusion attention module (CFAM) to reweight the feature map along the channel dimension and refine the U-Net’s skip connections. The CFAM considers the interchannel relationship between low-level and high-level features and uses the attention mechanism to adjust these two sets of features before fusing them. Inspired by the group technique, we introduce a spatial-wise group attention module (SGAM), which can learn spatial attention maps in a group manner. The attention map of each group attends to a specific semantic feature, which can reserve more spatial structural information and help the spatial attention module capture more fine-grained semantic information.

In the decoder block, the low-level features from the encoder path and the high-level features from the decoder path are refined by CFAM and then fused by a convolution block. After that, the SGAM is used to refine the features spatially. At last, a convolution block is used to learn features and help the network adapt to the attention mechanism. Residual connection is also used to fine-tune the features.

2.5. Channel-Wise Fusion Attention Module

The overall architecture of CFAM is illustrated in Figure 4(a). CFAM is a channel attention module that strengthens useful feature responses and suppresses unimportant feature responses by adjusting the relationship along the channel dimension. But unlike the classic channel attention like SE block and ECA block, our CFAM takes full account of the structure of U-Net. CFAM not only uses channel attention to adjust the channels’ weights for a single feature map but also considers the interchannel relationship between the low-level and high-level features merged by the U-Net’s skip connection. Studies have shown a semantic gap between two sets of features merged in U-Net’s skip connections [29, 30]. The low-level features have more fine-grained information, while the high-level features have more semantic information. Convolution cannot integrate them well. To address this issue, CFAM calculates the relationship between the low-level and high-level features and adjusts their channels’ weights simultaneously to help these levels of two feature maps fuse better.

(a)

(b)

CFAM uses global average pooling (GAP) and 1D convolution to capture the interchannel relationship of two sets of features to be merged in a long skip connection. Two channel attention maps are generated to refine the corresponding two sets of features before they are merged by a convolution block.

Denote one of the low-level features before downsampling in the encoder-block as , and the corresponding high-level features after the transpose convolution in decoder-block as , where , , , and are the number of channels, the length, the width, and the height of the feature map. First of all, we use global average pooling (GAP) to aggregate spatial information and generate the corresponding spatial statistics as follows: where represents the voxel value at position of a single channel in the feature map with .

As demonstrated in [33], to capture interchannel relationships, avoiding dimensionality reduction is important, and local cross-channel interaction is helpful. So, we concatenate and in the channel dimension, and perform 1D convolution with kernel size followed by a sigmoid activation to generate the channel attention map for the low-level features and for the high-level features. Finally, the refined low-level features and the refined high-level features can be obtained by: where denotes the sigmoid function mapping the feature values into the range of and denotes the standard 1D convolution with kernel size .

2.6. Spatial-Wise Group Attention Module

For computer vision tasks, spatial attention is also important, so we proposed SGAM to gain spatial attention to refine the feature map in the spatial dimension. Previous works [31, 32] use average-pooling or max-pooling to aggregate channel-wise information, which cannot fully characterize the various semantic information of the feature map. The rib fracture regions are often not apparent compared with the normal rib regions and usually with various irregular shapes, so obtaining more fine-grained semantic information can enhance the CNN network’s ability for feature extraction. Studies shows that group convolution can learn better feature representation than standard convolution [37]. Inspired by this, SGAM divides feature maps into several groups and simultaneously learns an attention map for each group. Each attention map focuses on a specific semantic subfeature, making SGAM to gain more fine-grained semantic information than previous works.

The detailed architecture of SGAM is illustrated in Figure 4(b). First of all, for a feature map , we divide it into groups along the channel dimension: . After that, for each feature group , we use convolution to obtain the channel statistics . where denotes a standard 3D pointwise convolution.

Then, a standard convolution followed by a sigmoid activation function is performed to generate 3D spatial attention map for each group. The final refined feature group can be computed by: where denotes a standard 3D convolution with the kernel size of .

2.7. Loss Function

Since the rib fracture region is much smaller than the background, which will make the prediction of the network more biased towards the background, we use the dice loss to solve this problem. However, Dice loss is unstable in the training process, so the weighted binary cross-entropy (WBCE) loss is also introduced to address this issue.

Let denote the domain of all voxels of a sample patch with length , width , and height . is the voxel of the prediction result for a sample with domain , and is the corresponding ground truth.

The Dice loss can be defined as:

The weighted BCE loss can be defined as: where is the weight of positive voxels, which is set to 5 in our experiments.

The final loss function is defined as:

2.8. Implementation Details

Due to the limitation of GPU memory, the cropped 3D patches are used as the input of the network. To balance the positive and negative samples, in the training stage, 60% of the data are positive, containing at least one rib fracture, and 40% of the data are randomly sampled negative samples containing tissues without any rib fractures. Data augmentation methods including random rotation, affine, and flip are used for all samples.

In the inference stage, we use a sliding window with a window size of and a step of 48 to scan the whole CT image and omit the background area without any tissues. To obtain the final result, we compute the connected component after binarizing the segmentation map using the threshold 0.4 and take the average segmentation scores of the connected component as the final detection confidence. To reduce false positives (FP), all detection proposals with volume less than 300 voxels are removed.

The CFSG U-Net is implemented in Pytorch. The kernel size of CFAM in the decoder blocks is set to 5 and the group number of SGAM is set to 4, which achieves the best results in our experiments. We initialize our model using the method introduced in [38] and train the model on two NVIDIA V100 32 GB GPUs with the batch size of 16 for 100 epochs. Adam optimizer with , , , an initial learning rate of , the momentum of 0.9, and weight decay of are used for the training.

3. Results and Discussion

3.1. Results of Rib Fracture Segmentation

We first report the segmentation results of the CSFG U-Net, as shown in Figure 5; there are three true-positive results included. The ground truth is labelled by the yellow line, and the segmentation result is labelled by the red line.

(a)

(b)

(c)

Because the rib fracture area is small and narrow, and the boundary between the fracture region and the normal region is not very obvious, the dice between the segmentation result and the corresponding ground truth is not exceptionally high compared with other segmentation tasks. Due to these reasons, we did not include the quantitative segmentation result in the evaluation of our method.

3.2. Results of Rib Fracture Detection

As demonstrated in [26], we consider a detection is true positive if the between any annotations. The free-response receiver-operating characteristic (FROC), which considers the sensitivity and the average number of false-positive per scan (FPs/scan), is used to evaluate the performance of models. The sensitivities are measured at five key rates, including 1/2, 1, 2, 4, and 8 FPs per scan. And the average sensitivity of these five particular rates is also used to have an overview of FROC analysis.

To verify the effectiveness of our proposed CSFG U-Net, we compare our method with several cutting-edge rib fracture detection methods proposed in recent years include FracNet [26] and VRBNet [28], which use the 3D settings. And we also compare our method with several commonly used U-Net-based deep neural networks for medical image segmentation, including 3D U-Net [39], MutiResUnet [29], Attention U-Net [40], and ResUNet [41]. Except for the differences of the CNN model, the other experimental settings of different methods are the same.

The results of the experiments are shown in Table 2. It can be seen from the results that, compared with the existing rib fracture detection models and other segmentation networks of U-Net architecture, our method achieves the highest average FPs 81.28%, which illustrates the effectiveness of our proposed network on the task of rib fracture detection.

To verify the effectiveness of the attention module we proposed, our method is also compared with several other attention modules including SE [42], CBAM [31], and ECA [43], as shown in Table 3. Here, we refer to the backbone of CFSG U-Net without CFAM and SGAM as ResUNet, which is proposed in [41]. We apply the compared attention modules in the decoder path of ResUNet as in our proposed CFSG U-Net. According to the results, the attention modules we proposed demonstrate better performance, indicating that in the U-Net architecture, our attention module can effectively help the network learn rib fracture features.

3.3. Ablation Studies

To justify the effectiveness of our proposed components, we conduct several ablation experiments with the leave-one-out method. The results are shown in Table 4.

To verify the effect of CFAM, we compare the performance of the whole CFSG U-Net model and the model after removing CFAM. It can be found that the model with CFAM can obtain a higher recall score, especially with low FPs/scan rates.

At the same time, to verify the effectiveness of the SGAM module, we design two experiments. In the first experiment, we remove the SGAM module from CFSG U-Net. In the second experiment, we set the number of SGAM groups to 1, equivalent to generating spatial attention without grouping. It can be seen through experiments that spatial attention can indeed improve the performance of the CNN module, and learning multiple groups of spatial attention can help the spatial attention module generate finer attention maps and reserve more fine-grained information, thereby improving the model’s ability to learn rib fracture features.

4. Discussion

In this study, we built a deep learning model to aid in the diagnosis of rib fractures. In the experimental results, our model achieves an average sensitivity of 81.28% and a maximum sensitivity of 89.58%, which show that our method can detect rib fractures effectively and outperform the existing works. Before our work, several works used CNN to detect rib fractures but did not fully tap the potential of the CNN network. In our work, we propose a dual-attention module including CFAM and SGAM to improve the feature extraction ability of the CNN network to enhance its sensitivity and accuracy in the rib fracture detection task. We carried out several comparative and ablation experiments to test the effect of our proposed dual-attention module. Compared with other attention modules, our dual-attention module achieved the best results. At the same time, in the ablation experiments, we verified the effectiveness of CFAM and SGAM. The joint action of CFAM and SGAM improved the ability of the CNN network to detect rib fractures.

However, our work still has some limitations. First of all, our data only comes from a hospital, and the sample source is not very wide, so the model’s versatility needs to be improved. In addition, in terms of data labeling, on the one hand, our data are labeled by different radiologists; it is hard to establish the labeling gold standard. On the other hand, the boundary of fractures is not obvious. These two reasons will introduce noisy labels, which may have an adverse effect on the voxel-level segmentation task. Finally, although our algorithm has obtained the highest sensitivity, it is hard to suppress false positives in a single-stage detection framework. The false-positive cases can be seen in Figures 6(a)–6(c). Several reasons cause the false positives. For instance, the rib with uneven bone mineral density can be easily misdiagnosed, and the area around the vertebra and costochondral joint might also be misdiagnosed in some CT scans.

(a)

(b)

(c)

5. Conclusions

In this work, to improve the ability of CNN to detect rib, we propose a novel rib fracture detection model called CFSG U-Net. Inspired by the attention mechanism of CNNs in recent years, we propose CFAM to refine features in channel perspective and SGAM to refine the semantic information in the spatial. We apply these two modules in the decoder block to reassign the weights in the channel and spatial dimensions to help the network learn rib fracture features from limited data.

To verify the effectiveness of our proposed method, we cooperated with the local hospital and established a rib fracture dataset, including 3134 rib fracture annotations for 818 CT images. And then, we conducted a series of experiments on this dataset, and the results show that the maximum sensitivity of our proposed method is 89.58%, and the average FROC score is 81.28%; these results outperformed the existing rib fracture detection system. Moreover, the ablation experiment results show that the proposed CFAM and SGAM modules surpass other attention modules in the rib fracture detection task, proving their effectiveness.

In the future, we will strengthen our work mainly from three aspects to further improve our method. Firstly, we will collect more rib fracture data and conduct multicenter research to enhance the versatility of our algorithm. In addition, we will explore how to reduce the adverse effect of noisy labels. Finally, we will continue exploring how to improve our rib fracture detection algorithm’s performance in reducing false positives.

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declared that there was no conflict of interest.

Authors’ Contributions

Zhengyin Zhou and Zhihui Fu contributed equally to this work.

Acknowledgments

This research was funded by the Suzhou Science and Technology Bureau (SYSD2019152), Collaborative Innovation Center of Novel Software Technology and Industrialization, and Project Funded by the Priority Academic Program Development of Jiangsu Higher Education Institutions.

References

P. D. Piennette, S. E. Morris, and T. Northern, “Current review of analgesia and regional anesthesia practices for rib fracture and chest wall trauma,” Current Anesthesiology Reports, pp. 1–10, 2022.
View at: Publisher Site | Google Scholar
E. Gerakopoulos, L. Walker, D. Melling, S. Scott, and S. Scott, “Surgical management of multiple rib fractures reduces the hospital length of stay and the mortality rate in major trauma patients: a comparative study in a UK major trauma center,” Journal of Orthopaedic Trauma, vol. 33, no. 1, pp. 9–14, 2019.
View at: Publisher Site | Google Scholar
B. Zhang, C. Jia, R. Wu et al., “Improving rib fracture detection accuracy and reading efficiency with deep learning-based detection software: a clinical evaluation,” The British Journal of Radiology, vol. 94, no. 1118, p. 20200870, 2021.
View at: Publisher Site | Google Scholar
C. B. Pomeranz, C. A. Barrera, and S. E. Servaes, “Value of chest CT over skeletal surveys in detection of rib fractures in pediatric patients,” Clinical Imaging, vol. 82, pp. 103–109, 2022.
View at: Publisher Site | Google Scholar
S. Cho, Y. Sung, and M. Kim, “Missed rib fractures on evaluation of initial chest ct for trauma patients: pattern analysis and diagnostic value of coronal multiplanar reconstruction images with multidetector row ct,” The British Journal of Radiology, vol. 85, no. 1018, pp. e845–e850, 2012.
View at: Publisher Site | Google Scholar
N. Gundluru, D. S. Rajput, K. Lakshmanna et al., “Enhancement of detection of diabetic retinopathy using Harris hawks optimization with deep learning model,” Computational Intelligence and Neuroscience, vol. 2022, Article ID 8512469, 13 pages, 2022.
View at: Publisher Site | Google Scholar
C.-Y. Chang, S. Bhattacharya, P. Raj Vincent, K. Lakshmanna, and K. Srinivasan, “An efficient classification of neonates cry using extreme gradient boosting- assisted grouped-support-vector network,” Journal of Healthcare Engineering, vol. 2021, Article ID 7517313, 14 pages, 2021.
View at: Publisher Site | Google Scholar
J.-S. Huang, Y. Li, B.-Q. Chen, C. Lin, and B. Yao, “An intelligent eeg classification methodology based on sparse representation enhanced deep learning networks,” Frontiers in Neuroscience, vol. 14, p. 808, 2020.
View at: Publisher Site | Google Scholar
Z. Ge, S. Liu, F. Wang, Z. Li, and J. Sun, “Yolox: exceeding yolo series in 2021,” 2021, https://arxiv.org/abs/2107.08430.
View at: Google Scholar
D. Bolya, C. Zhou, F. Xiao, and Y. J. Lee, “Yolact: real-time instance segmentation,” in 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 9157–9166, Seoul, Korea (South), October 2019.
View at: Publisher Site | Google Scholar
N. K. Mishra, M. Dutta, and S. K. Singh, “Multiscale parallel deep CNN (mpdCNN) architecture for the real low- resolution face recognition for surveillance,” Image and Vision Computing, vol. 115, article 104290, 2021.
View at: Publisher Site | Google Scholar
K. He, X. Zhang, S. Ren, and J. Sun, “Identity mappings in deep residual networks,” European Conference on Computer Vision, Springer, pp. 630–645, 2016.
View at: Google Scholar
J. Deng, S. Shi, P. Li, W. Zhou, Y. Zhang, and H. Li, “Voxel r-cnn: towards high performance voxel-based 3d object detection,” Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 2, pp. 1201–1209, 2021.
View at: Google Scholar
Y. Su, D. Li, and X. Chen, “Lung nodule detection based on faster R-CNN framework,” Computer Methods and Programs in Biomedicine, vol. 200, article 105866, 2021.
View at: Publisher Site | Google Scholar
D. Gu, G. Liu, and Z. Xue, “On the performance of lung nodule detection, segmentation and classification,” Computerized Medical Imaging and Graphics, vol. 89, article 101886, 2021.
View at: Publisher Site | Google Scholar
X. Luo, T. Song, G. Wang et al., “SCPM-Net: an anchor-free 3D lung nodule detection network using sphere representation and center points matching,” Medical Image Analysis, vol. 75, article 102287, 2022.
View at: Publisher Site | Google Scholar
A. Myronenko, “3D MRI brain tumor segmentation using autoencoder regularization,” International MICCAI Brain lesion Workshop, Springer, pp. 311–320, 2018.
View at: Google Scholar
F. Isensee, P. F. Jäger, P. M. Full, P. Vollmuth, and K. H. Maier Hein, “nnu-net for brain tumor segmentation,” International MICCAI Brainlesion Workshop, Springer, pp. 118–132, 2020.
View at: Google Scholar
R. Ranjbarzadeh, A. Bagherian Kasgari, S. Jafarzadeh Ghoushchi, S. Anari, M. Naseri, and M. Bendechache, “Brain tumor segmentation based on deep learning and an attention mechanism using MRI multi-modalities brain images,” Scientific Reports, vol. 11, no. 1, p. 10930, 2021.
View at: Publisher Site | Google Scholar
S. A. Alanazi, M. M. Kamruzzaman, M. N. Islam Sarker et al., “Boosting breast cancer detection using convolutional neural network,” Journal of Healthcare Engineering, vol. 2021, Article ID 5528622, 11 pages, 2021.
View at: Publisher Site | Google Scholar
W. Lotter, A. R. Diab, B. Haslam et al., “Robust breast cancer detection in mammography and digital breast tomosynthesis using an annotation-efficient deep learning approach,” Nature Medicine, vol. 27, no. 2, pp. 244–249, 2021.
View at: Publisher Site | Google Scholar
S. S. Chakravarthy and H. Rajaguru, “Automatic detection and classification of mammograms using improved extreme learning machine with deep learning,” IRBM, vol. 43, no. 1, pp. 49–61, 2022.
View at: Publisher Site | Google Scholar
M. Chen, P. Du, and J. Zhao, “Scrfd: spatial coherence based rib fracture detection,” in Proceedings of the 2018 5th International Conference on Biomedical and Bioinformatics Engineering - ICBBE '18, pp. 105–109, Okinawa, Japan, 2018.
View at: Google Scholar
Q.-Q. Zhou, J. Wang, W. Tang et al., “Automatic detection and classification of rib fractures on thoracic ct using convolutional neural network: accuracy and feasibility,” Korean Journal of Radiology, vol. 21, no. 7, pp. 869–879, 2020.
View at: Publisher Site | Google Scholar
S. Ren, K. He, R. Girshick, and J. Sun, “Faster r-cnn: towards real-time object detection with region proposal networks,” Advances in Neural Information Processing Systems, vol. 28, pp. 91–99, 2015.
View at: Google Scholar
L. Jin, J. Yang, K. Kuang et al., “Deep-learning-assisted detection and segmentation of rib fractures from CT scans: development and validation of FracNet,” eBioMedicine, vol. 62, article 103106, 2020.
View at: Publisher Site | Google Scholar
O. Ronneberger, P. Fischer, and T. Brox, “U-net: convolutional networks for biomedical image segmentation,” International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer, pp. 234–241, 2015.
View at: Google Scholar
X. H. Meng, D. J. Wu, Z. Wang et al., “A fully automated rib fracture detection system on chest ct images and its impact on radiologist performance,” Skeletal Radiology, vol. 50, no. 9, pp. 1821–1828, 2021.
View at: Publisher Site | Google Scholar
N. Ibtehaz and M. S. Rahman, “MultiResUNet: rethinking the U-Net architecture for multimodal biomedical image segmentation,” Neural Networks, vol. 121, pp. 74–87, 2020.
View at: Publisher Site | Google Scholar
H. Wang, P. Cao, J. Wang, and O. R. Zaiane, “UCTransNet: rethinking the skip connections in u-net from a channel-wise perspective with transformer,” Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, no. 3, pp. 2441–2449, 2022.
View at: Publisher Site | Google Scholar
S. Woo, J. Park, J.-Y. Lee, and I. S. Kweon, “Cbam: convolutional block attention module,” in Proceedings of the European conference on computer vision (ECCV), pp. 3–19, Munich, Germany, 2018.
View at: Google Scholar
J. Park, S. Woo, J.-Y. Lee, and I. S. Kweon, “Bam: bottleneck attention module,” 2018, https://arxiv.org/abs/1807.06514.
View at: Google Scholar
P. A. Yushkevich, J. Piven, H. Cody Hazlett et al., “User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability,” NeuroImage, vol. 31, no. 3, pp. 1116–1128, 2006.
View at: Publisher Site | Google Scholar
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778, Las Vegas, NV, USA, June 2016.
View at: Publisher Site | Google Scholar
M. Drozdzal, E. Vorontsov, G. Chartrand, S. Kadoury, and C. Pal, “The importance of skip connections in biomedical image segmentation,” Deep Learning and Data Labeling for Medical Applications, Springer, pp. 179–187, 2016.
View at: Publisher Site | Google Scholar
S. Jégou, M. Drozdzal, D. Vazquez, A. Romero, and Y. Bengio, “The one hundred layers tiramisu: fully convolutional densenets for semantic segmentation,” in 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 11–19, Honolulu, HI, USA, July 2017.
View at: Publisher Site | Google Scholar
A. Krizhevsky, I. Sutskever, and G. Hinton, “Imagenet classification with deep convolutional neural networks,” Advances in Neural Information Processing Systems, vol. 25, no. 2, 2012.
View at: Google Scholar
K. He, X. Zhang, S. Ren, and J. Sun, “Delving deep into rectifiers: surpassing human-level performance on imagenet classification,” in 2015 IEEE International Conference on Computer Vision (ICCV), pp. 1026–1034, Santiago, Chile, December 2015.
View at: Publisher Site | Google Scholar
Ö. Çiçek, A. Abdulkadir, S. S. Lienkamp, T. Brox, and O. Ronneberger, “3d u-net: learning dense volumetric segmentation from sparse annotation,” International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer, pp. 424–432, 2016.
View at: Google Scholar
O. Oktay, J. Schlemper, L. Le Folgoc et al., “Attention u-net: learning where to look for the pancreas,” 2018, https://arxiv.org/abs/1804.03999.
View at: Google Scholar
X. Xiao, S. Lian, Z. Luo, and S. Li, “Weighted res-unet for high-quality retina vessel segmentation,” in 2018 9th International Conference on Information Technology in Medicine and Education (ITME), pp. 327–331, Hangzhou, China, October 2018.
View at: Publisher Site | Google Scholar
J. Hu, L. Shen, and G. Sun, “Squeeze-and-excitation networks,” in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7132–7141, Salt Lake City, UT, USA, June 2018.
View at: Publisher Site | Google Scholar
Q. Wang, B. Wu, P. Zhu, P. Li, and Q. Hu, “Eca-net: efficient channel attention for deep convolutional neural networks,” in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, June 2020.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2022 Zhengyin Zhou et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies