3D computer technology addresses body-image issues of breast reconstruction

A decision support system is being designed to help breast cancer patients choose reconstruction options that meet their quality-of-life concerns.
25 July 2013
Clement S. Sun, Mia K. Markey, Fatima A. Merchant, Krishnaswamy Ravi-Chandar, Michelle C. Fingeret and Gregory P. Reece

In the United States, one in eight women can expect to be diagnosed with breast cancer within her lifetime. Treatment of breast cancer often involves mastectomy, the surgical removal of the breast(s). Women at heightened risk may also elect to undergo mastectomy to reduce the chances of developing breast cancer. Many women who undergo a mastectomy have concerns about their body image—i.e., how they view their appearance and the overall functioning of their body. The goal of breast reconstruction is to recreate the appearance of the patient's breasts in a way that restores her body image.

Breast reconstruction typically requires multiple procedures over time to obtain a final result. Many women are candidates for more than one form of breast reconstruction, such as reconstruction using either an implant or some of the patient's own tissue (autologous reconstruction). There are a large number of factors a woman must consider when making her treatment decisions, including time, cost, and body-image preferences. For a woman to make optimal decisions about breast reconstruction, she needs some very specific information to understand her surgical options and how her preferences, including her appearance after the surgery, can best be met. This article describes our approach to quantifying a patient's appearance via imaging and 3D modeling techniques.1–11 We note, however, that developing a greater understanding of patient preferences in terms of quality-of-life measures such as body image12 and modeling the decision-making process for breast reconstruction13 are equally important aspects of our research program.

To extract relevant information about appearance changes, we analyzed both 2D and 3D surface images to quantify the appearance of the female breast and any changes it undergoes, and to develop patient-specific mechanistic models to predict realistic outcomes. Imaging in 2D that consists of clinical photographs with a standardized background and poses is currently the customary practice for documenting surgical outcomes. We achieved the 3D surface imaging via a stereophotography system from 3dMD, a medical imaging company in Atlanta, GA. We find 3D surface imaging of the breast14 advantageous both because it enables us to measure properties such as curvature and volume that are more difficult to assess from 2D imaging and because 3D measurements retain their validity despite changes in the subject's pose.15

We computed measurements of breast morphology such as symmetry2,5,8 using distances between fiducial points—natural markers in the image that orient to specific areas—including the nipples, the sternal notch, and the umbilicus. We considered a range of aesthetic properties, not simply measures of symmetry and volume.16 For example, we have introduced measures of ptosis1, 3 (the drape of the breast), scarring,6 and curvature.9, 10 With such measurements, we can investigate surgical options that include different types of mastectomies6 and reconstruction procedures.9,10 Our goal is to streamline our analyses through techniques such as development of algorithms that automatically align images to a defined orientation4 and locate fiducial points.5, 7,11 For example, we have developed accurate methods for fiducial point localization using 3D surface-curvature analysis coupled with 2D texture analysis (see Figure 1).


Figure 1. Surface-curvature analysis produces automated identification of the sternal notch (S), nipples (N), and umbilicus (U). These fiducial points can be used to calculate quantitative measures such as symmetry. Figure prepared by Manas Kawale.

A key next step in our research is assessing changes in breast morphology over the course of reconstruction. To conduct longitudinal analyses, it is critical to register 3D images taken at different time points. Toward this goal, we have developed a semi-automated algorithm for registration of multiple images taken over time based on the assumption that the skeleton is relatively stable and thus the transformation can be treated as rigid.17

In a highly innovative component of our current work, we are developing a physics-based, patient-specific biomechanical model that uses the 3D geometry obtained via 3D surface imaging combined with the material properties of the breast to predict breast reconstruction post-operative results (see Figure 2). This represents a new approach because there are few previous studies on the physical properties of the human breast such as skin thickness and deformation18 or pectoral muscle thickness and curvature.19


Figure 2. 3D images of breasts with subject (a) standing upright and (b) lying supine. Finite element analysis can be used to quantify changes in breast shape, such as those occurring with the subject's position as shown in this example (c). Other methods can be used to quantify changes in skin texture and coloration. Figure prepared by Hamed Khatam.

Our progress in developing methods for measuring breast morphology and creating a patient-specific 3D prediction model will enable us to provide highly valuable quantitative feedback. Through the integration of breast aesthetics, body-image measurements, and biomechanical modeling into a decision-analysis framework, we hope to more fully inform both patient and surgeon of possible outcomes. Ultimately, our goal is to design a decision support system to help breast cancer survivors understand their likely appearance changes following breast reconstruction and enable them to choose a reconstruction strategy that will result in maximum psychosocial adjustment.

The authors gratefully acknowledge the support of the National Institutes of Health (Grant R01CA143190) and the American Cancer Society (Grant RSGPB-09-157-01-CPPB).


Clement S. Sun, Mia K. Markey
Department of Biomedical Engineering
The University of Texas at Austin
Austin, TX

Clement S. Sun is a doctoral candidate in the Department of Biomedical Engineering and a medical student at The University of Texas Medical Branch focused on breast reconstruction decision-making. He has bachelor's and master's degrees in electrical engineering from the University of Washington.

Mia K. Markey is an associate professor of biomedical engineering and Engineering Foundation endowed faculty fellow in engineering as well as adjunct associate professor of imaging physics at The University of Texas MD Anderson Cancer Center.

Fatima A. Merchant
Department of Engineering Technology
University of Houston
Houston, TX

Fatima A. Merchant is an assistant professor with joint appointments in computer science, electrical and computer engineering, and biomedical engineering. Her research interests are in the areas of tissue engineering, computational cytogenetics, and multidimensional imaging and image analysis.

Krishnaswamy Ravi-Chandar
Department of Aerospace Engineering and Engineering Mechanics
The University of Texas at Austin
Austin, TX

K. Ravi-Chandar is a professor of aerospace engineering and engineering mechanics and was previously a professor at the University of Houston. He is also associate director of the Center for Mechanics of Solids, Structures, and Materials and editor of the International Journal of Fracture.

Michelle C. Fingeret
Department of Behavioral Science
The University of Texas MD Anderson Cancer Center
Houston, TX

Michelle C. Fingeret is an assistant professor with joint appointments in the Departments of Plastic Surgery and Head and Neck Surgery. She is a licensed psychologist and has developed an innovative line of research centering on body-image issues for oncology patients.

Gregory P. Reece
Department of Plastic Surgery
The University of Texas MD Anderson Cancer Center
Houston, TX

Gregory P. Reece earned his BS in zoology from McNeese State University and his MD from Louisiana State Medical School. As a professor in the Department of Plastic Surgery, his primary research interest is the application of imaging technology to facilitate surgery and to quantify outcomes after reconstructive surgery.


References:
1. M. S. Kim, G. P. Reece, E. K. Beahm, M. J. Miller, E. N. Atkinson, M. K. Markey, Objective assessment of aesthetic outcomes of breast cancer treatment: measuring ptosis from clinical photographs, Comput. Biol. Med. 37, p. 49-59, 2007.
2. M. Dabeer, M. Kyrish, M. S. Kim, P. G. Reyes, N. Udpa, G. P. Reece, M. K. Markey, Toward decision support for breast reconstruction: automated calculation of symmetry measure on clinical photographs, Am. Med. Inf. Assoc. Annu. Symp., p. 1045, 2008.
3. E. Kim, J. Lee, E. Beahm, M. Crosby, G. P. Reece, M. K. Markey, Automated calculation of ptosis on clinical photographs, Biomed. Eng. Soc. Annu. Meeting, 2010.
4. A. Bose, S. K. Shah, G. P. Reece, M. A. Crosby, E. K. Beahm, M. C. Fingeret, M. K. Markey, F. A. Merchant, Automated spatial alignment of 3D torso images, Conf. Proc. IEEE Eng. Med. Biol. Soc., p. 8455-8458, 2011. doi:10.1109/IEMBS.2011.6092086
5. M. Dabeer, E. Kim, G. P. Reece, F. A. Merchant, M. A. Crosby, E. K. Beahm, M. K. Markey, Automated calculation of symmetry measure on clinical photographs, J. Eval. Clin. Pract. 17, p. 1129-1136, 2011. doi:10.1111/j.1365-2753.2010.01477.x
6. M. S. Kim, W. N. Rodney, G. P. Reece, E. K. Beahm, M. A. Crosby, M. K. Markey, Quantifying the aesthetic outcomes of breast cancer treatment: assessment of surgical scars from clinical photographs, J. Eval. Clin. Pract. 17, p. 1075-1082, 2011. doi:10.1111/j.1365-2753.2010.01476.x
7. J. Lee, G. S. Muralidhar, G. P. Reece, M. K. Markey, A shape constrained parametric active contour model for breast contour detection, Conf. Proc. IEEE Eng. Med. Biol. Soc., p. 4450-4453, 2012. doi:10.1109/EMBC.2012.6346954
8. C. S. Sun, K. Fan, G. P. Reece, M. A. Crosby, E. K. Beahm, M. C. Fingeret, M. K. Markey, Quantifying breast aesthetics from clinical photographs: symmetry of lateral extents (SOLE), Biomed. Eng. Soc. Annu. Meeting, 2012.
9. J. Lee, S. Chen, G. P. Reece, M. Crosby, E. Beahm, M. K. Markey, A novel quantitative measure of breast curvature based on catenary, IEEE Trans. Biomed. Eng. 59, p. 1115-1124, 2012. doi:10.1109/TBME.2012.2184541
10. J. Lee, G. P. Reece, M. K. Markey, Breast curvature of the upper and lower breast mound: 3D analysis of patients who underwent breast reconstruction, 3rd Int'l Conf. on 3D Body Scanning Technol., p. 171-179, 2012.
11. M. M. Kawale, G. P. Reece, E. K. Beahm, M. A. Crosby, M. C. Fingeret, M. K. Markey, F. A. Merchant, Automated identification of fiducial points in 3D torso images, Biomed. Eng. Comp. Biol. 5, p. 57-68, 2013.
12. M. C. Fingeret, S. W. Nipomnick, M. A. Crosby, G. P. Reece, Developing a theoretical framework to illustrate associations among patient satisfaction, body image and quality of life for women undergoing breast reconstruction, Cancer Treat. Rev. 39(6), p. 673-681, 2013.
13. C. S. Sun, D. Wang, J. Lee, G. P. Reece, M. C. Fingeret, M. A. Crosby, E. K. Beahm, M. K. Markey, Towards a decision basis of breast reconstruction: defining the alternatives, Am. Med. Inf. Assoc. Annu. Symp. , p. 1178, 2011.
14. J. Lee, M. Kawale, F. A. Merchant, J. Weston, M. C. Fingeret, D. Ladewig, G. P. Reece, M. A. Crosby, E. K. Beahm, M. K. Markey, Validation of stereophotogrammetry of the human torso, Breast Cancer: Basic Clin. Res. 5, p. 15-25, 2011. doi:10.4137/BCBCR.S6352
15. M. Kawale, J. Lee, S. Y. Leung, M. C. Fingeret, G. P. Reece, M. A. Crosby, E. K. Beahm, M. K. Markey, F. A. Merchant, 3D symmetry measure invariant to subject pose during image acquisition, Breast Cancer: Basic Clin. Res. 5, p. 131-142, 2011. doi:10.4137/BCBCR.S7140
16. M. S. Kim, J. C. Sbalchiero, G. P. Reece, M. J. Miller, E. K. Beahm, M. K. Markey, Assessment of breast aesthetics, Plast. Reconstr. Surg. 121, p. 186e-194e, 2008.
17. L. Zhao, S. K. Shah, G. P. Reece, M. A. Crosby, E. K. Beahm, M. C. Fingeret, M. K. Markey, F. A. Merchant, Semi-automated registration of 3D torso images from breast reconstruction surgery, 3rd Int'l Conf. on 3D Body Scanning Technol., p. 179-189, 2012.
18. H. Khatam, M. C. Fingeret, G. P. Reece, M. K. Markey, K. Ravi-Chander, Measurement of skin deformation of the breast associated with position change through 3D digital image correlation, Biomed. Eng. Soc. Annu. Meeting , 2013. In press.
19. N. Kumaraswamy, H. Khatam, G. P. Reece, M. K. Markey, K. Ravi-Chander, A methodology to determine geometry and boundary conditions for breast FEM simulations, Biomed. Eng. Soc. Annu. Meeting, 2012.
PREMIUM CONTENT
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research