Skip to main content
Intellect

Trading cuts for clicks: new BYU software performs 'virtual surgery'

Surgeons could instantly extract patient's 3-D anatomy without incisions

A new software tool developed by computer scientists at Brigham Young University will allow surgeons to instantly visualize any part of a patient's anatomy by extracting a 3-D computer image from an MRI, CT scan or similar data with just a few clicks of the mouse. Click to see video.

The tool, dubbed "Live Surface" by its creators BYU professor William Barrett and graduate student Chris Armstrong, also has special-effects applications – in similar fashion it can be used to extract a single actor's performance or inanimate objects from video clips. Click to see video.

"The main goal in developing Live Surface was to give the physician a powerful, practical tool that can be used interactively," said Barrett, explaining that existing software and techniques that are used to give doctors a look at a patient's anatomy are either too simplistic or take too long to be of immediate use. "A program like this has to be incredibly fast and very interactive, or else it's very frustrating for the user, who currently has to go get a sandwich and come back before he has what he wants."

Live Surface has the additional benefit of allowing users to easily isolate "tricky" anatomy such as soft tissue – blood vessels, hearts and muscles – that a lot of other techniques can't readily extract, said Barrett. Click to see video.

"The hard stuff (meaning bones) is easy to see using traditional methods, but even there, the simpler techniques sometimes overestimate, underestimate, or fuse joints, whereas Live Surface neatly and accurately separates them," said Barrett. "Our program also provides more robust isolation of soft tissue, which is quite a breakthrough." Click to see video.

The BYU software works by extracting information from data collected in 3-D volumes – CT scans, MRIs or 3-D ultrasounds. With a click and drag of the mouse, a user identifies the object he wishes to extract. Next, he identifies those portions of the data that surround the object. Immediately, the desired object is extracted from the data. Click to see video.

"This is the object I want, and this is not the object I want. And in less than half a second, it pulls the object you want out of the data," said Armstrong, who will present the computer science research behind Live Surface at the International Workshop on Volume Graphics July 31 in Boston. "It's really that simple."

The program works in a rapid manner because it extracts the object using a hierarchical algorithm, or set of mathematical rules, that tells the computer to eliminate irrelevant information in broad, coarse cuts. Once the bulk of unwanted data is gone, the computer is free to make more refined calculations more quickly.

"It's how you might envision cutting a toothpick out of a redwood tree," said Armstrong. "You'd start with a chain saw and make very big cuts at first. By the end you'd use a knife to delicately shape the toothpick. Instead of 'cuts' our program intelligently identifies shapes. As you refine more and more, that shape becomes more exact."

After a surgeon had extracted a 3-D image of a person's heart or brain, for example, the image could then be projected onto the patient's body, fitted to create a road map for the surgeon as he operated. Additionally, doctors could use the tool to make better diagnoses after visualizing a patient's organs from multiple angles or do a better job of locating cancerous tumors.

Research for the software was partially funded by Adobe, makers of the popular image-editing program Photoshop. Barrett's lab has had a long-running relationship with Adobe – Live Surface builds on Barrett's development of Intelligent Scissors, a program that allows users to quickly pull 2-D objects out of images. The program, renamed "magnetic lasso," was incorporated into 5.0 and subsequent versions of Photoshop and is used by millions of designers, artists and photographers.

BYU's Technology Transfer Office recently applied for a patent on Live Surface. Parties interested in knowing more about licensing opportunities may contact Burt Knudson at (801) 422-3676.

Related Articles

data-content-type="article"

Forum: Dr. Francis Collins

January 27, 2026
“Faith and reason are hand-in-hand ways that we find answers.”
overrideBackgroundColorOrImage= overrideTextColor= promoTextAlignment= overrideCardHideSection=false overrideCardHideByline=false overrideCardHideDescription=false overridebuttonBgColor= overrideButtonText= promoTextAlignment=
data-content-type="article"

Treating addiction with immunotherapy: BYU study links alcohol use and the immune system

January 15, 2026
A new interdisciplinary study from BYU, opens an angle of neuroimmune research that could potentially lead to better medical treatments for individuals with alcohol use disorder. This collaborative research involved 13 students and four professors across three departments in the College of Life Sciences and the College of Family, Home, and Social Sciences.

overrideBackgroundColorOrImage= overrideTextColor= promoTextAlignment= overrideCardHideSection=false overrideCardHideByline=false overrideCardHideDescription=false overridebuttonBgColor= overrideButtonText= promoTextAlignment=
data-content-type="article"

How loud is life behind the glass? BYU study measures sound in shark tanks

January 13, 2026
Sharks at the Loveland Living Planet Aquarium in Draper, Utah, glide silently behind glass walls — but just how silent is their world? A team of BYU researchers set out to discover how much of the aquarium’s daily bustle filters into the shark tank, and whether that noise is affecting the animals who call it home.
overrideBackgroundColorOrImage= overrideTextColor= promoTextAlignment= overrideCardHideSection=false overrideCardHideByline=false overrideCardHideDescription=false overridebuttonBgColor= overrideButtonText= promoTextAlignment=
overrideBackgroundColorOrImage= overrideTextColor= promoTextAlignment= overrideCardHideSection=false overrideCardHideByline=false overrideCardHideDescription=false overridebuttonBgColor= overrideButtonText=