Skip to main content

Chest X-Ray Analysis of Tuberculosis by Deep Learning with Segmentation and Augmentation

In this paper, the authors explore the efficiency of lung segmentation, lossless and lossy data augmentation in  computer-aided diagnosis (CADx) of tuberculosis using deep convolutional neural networks applied to a small and not well-balanced Chest X-ray (CXR) dataset.

Dataset

Shenzhen Hospital (SH) dataset of CXR images was acquired from Shenzhen No. 3 People's Hospital in Shenzhen, China. It contains normal and abnormal CXR images with marks of tuberculosis.

Methodology

Based on previous literature, attempts to perform training for such small CXR datasets without any pre-processing failed to see good results. So the authors attempted segmenting the lung images before being inputted to the model. This gave demonstrated a more successful training and an increase in prediction accuracy.

To perform lung segmentation, i.e. to cut the left and right lung fields from the lung parts in standard CXRs, manually prepared masks were used.

The dataset was split into 8:1:1 parts for training, validation and test parts respectively. Images were rescaled by 1./255 and resized to 2048×2048 and distributed among training, validation and test parts. The model was trained on 
  1. Segmented SH dataset
  2. Segmented SH dataset with lossless data augmentation
  3. Segmented SH dataset with lossy data augmentation

Segmented Dataset

Training on this dataset observed overfitting due to the small size of the dataset. This is reduced by data augmentation methods discussed in the next two sub sections.

Lossless Data Augmentation

The lossless data augmentation for 2D images included the following transformations: mirror-like reflections (left-right and up-down) and rotations by 90n degrees, where n = 1,2,3. This allowed to increase the size of the whole dataset by 8 times obtain the more realistic results on accuracy and loss during training and validation.

Lossy Data Augmentation

Lossy data augmentation for these 2D images included rotations by 5 degrees. This augmentation is in addition to the data augmentation steps taken during lossless data augmentation.

Conclusion

Lossless data augmentation of the segmented dataset leads to the lowest validation loss (without overfitting) and nearly the same accuracy (within the limits of standard deviation) in comparison to the original and other pre-processed datasets after lossy data augmentation. In conclusion, besides the more complex deep CNNs and bigger datasets, the better progress of CADx for the small and not well-balanced datasets even could be obtained by better segmentation, data augmentation, dataset stratification, and exclusion of non-evident outliers.

Comments

Popular Posts

TX-CNN: DETECTING TUBERCULOSIS IN CHEST X-RAY IMAGES USING CONVOLUTIONAL NEURAL NETWORK

In this paper , the authors propose a method to classify tuberculosis from chest X-ray images using Convolutional Neural Networks (CNN). They achieve a classification accuracy of 85.68%. They attribute the effectiveness of their approach to shuffle sampling with cross-validation while training the network. Methodology Convolutional Neural Network This has been the ultimate tool for researchers and engineers for computer vision tasks. It has been widely used for many general purpose image and video related tasks. There are many great resources to learn about them. I will link a few of them at the end of this post. In this paper, the authors study the famous AlexNet and GoogLeNet architectures in classifying tuberculosis images. A CNN model usually consists of convolutional layers, pooling layers and fully connected layers. Each layer is connected to the previous layers via kernels or filters. A CNN model learns parameters of the kernel to represent global and local features ...

A non-local algorithm for image denoising

Published in   2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, this paper introduces two main ideas Method noise Non-local (NL) means algorithm to denoise images Method noise It is defined as the difference between the original (noisy) image and its denoised version. Some of the intuitions that can be drawn by analysing method noise are Zero method noise means perfect denoising (complete removal of noise without lose of image data). If a denoising method performed well, the method noise must look like a noise and should contain as little structure as possible from the original image The authors then discuss the method noise properties for different denoising filters. They are derived based on the filter properties. We will not be going in detail for each filter as the properties of the filters are known facts. The paper explains those properties using the intuitions of method noise. NL-means idea Denoised value at...

4D Panoptic LiDAR Segmentation (4D-PLS)

Introduction In the realm of computer vision, LiDAR segmentation remains a challenging area. Often, we have to rely on the downscaling of scans, followed by individual detections and temporal associations. The recently published paper, "4D Panoptic LiDAR Segmentation (4D-PLS)", seeks to address these challenges with an innovative approach and techniques, offering a fresh perspective on LiDAR segmentation. LiDAR Segmentation: Challenges and Opportunities LiDAR segmentation, specifically sequence segmentation, is a task with substantial hurdles. Due to memory constraints, scans must be downscaled, even for a single scan. This results in detection being performed on individual scans, and then followed by temporal association. It's a piecemeal approach that lacks efficiency and accuracy.  A New Take: The 4D-PLS Framework This is where the 4D-PLS approach comes into play. Drawing inspiration from space-time, the authors developed a system to overlap 4D volumes, assigning seman...