Skip to main content
Intellect

Trading cuts for clicks: new BYU software performs 'virtual surgery'

Surgeons could instantly extract patient's 3-D anatomy without incisions

A new software tool developed by computer scientists at Brigham Young University will allow surgeons to instantly visualize any part of a patient's anatomy by extracting a 3-D computer image from an MRI, CT scan or similar data with just a few clicks of the mouse. Click to see video.

The tool, dubbed "Live Surface" by its creators BYU professor William Barrett and graduate student Chris Armstrong, also has special-effects applications – in similar fashion it can be used to extract a single actor's performance or inanimate objects from video clips. Click to see video.

"The main goal in developing Live Surface was to give the physician a powerful, practical tool that can be used interactively," said Barrett, explaining that existing software and techniques that are used to give doctors a look at a patient's anatomy are either too simplistic or take too long to be of immediate use. "A program like this has to be incredibly fast and very interactive, or else it's very frustrating for the user, who currently has to go get a sandwich and come back before he has what he wants."

Live Surface has the additional benefit of allowing users to easily isolate "tricky" anatomy such as soft tissue – blood vessels, hearts and muscles – that a lot of other techniques can't readily extract, said Barrett. Click to see video.

"The hard stuff (meaning bones) is easy to see using traditional methods, but even there, the simpler techniques sometimes overestimate, underestimate, or fuse joints, whereas Live Surface neatly and accurately separates them," said Barrett. "Our program also provides more robust isolation of soft tissue, which is quite a breakthrough." Click to see video.

The BYU software works by extracting information from data collected in 3-D volumes – CT scans, MRIs or 3-D ultrasounds. With a click and drag of the mouse, a user identifies the object he wishes to extract. Next, he identifies those portions of the data that surround the object. Immediately, the desired object is extracted from the data. Click to see video.

"This is the object I want, and this is not the object I want. And in less than half a second, it pulls the object you want out of the data," said Armstrong, who will present the computer science research behind Live Surface at the International Workshop on Volume Graphics July 31 in Boston. "It's really that simple."

The program works in a rapid manner because it extracts the object using a hierarchical algorithm, or set of mathematical rules, that tells the computer to eliminate irrelevant information in broad, coarse cuts. Once the bulk of unwanted data is gone, the computer is free to make more refined calculations more quickly.

"It's how you might envision cutting a toothpick out of a redwood tree," said Armstrong. "You'd start with a chain saw and make very big cuts at first. By the end you'd use a knife to delicately shape the toothpick. Instead of 'cuts' our program intelligently identifies shapes. As you refine more and more, that shape becomes more exact."

After a surgeon had extracted a 3-D image of a person's heart or brain, for example, the image could then be projected onto the patient's body, fitted to create a road map for the surgeon as he operated. Additionally, doctors could use the tool to make better diagnoses after visualizing a patient's organs from multiple angles or do a better job of locating cancerous tumors.

Research for the software was partially funded by Adobe, makers of the popular image-editing program Photoshop. Barrett's lab has had a long-running relationship with Adobe – Live Surface builds on Barrett's development of Intelligent Scissors, a program that allows users to quickly pull 2-D objects out of images. The program, renamed "magnetic lasso," was incorporated into 5.0 and subsequent versions of Photoshop and is used by millions of designers, artists and photographers.

BYU's Technology Transfer Office recently applied for a patent on Live Surface. Parties interested in knowing more about licensing opportunities may contact Burt Knudson at (801) 422-3676.

Related Articles

data-content-type="article"

Learning to write in the Age of AI: BYU professor offers optimistic advice for educators

August 31, 2026
In a Q&A, BYU English professor and coordinator of University Writing Meridith Reed shares how educators can still teach students how to write well while navigating the impact of AI.
overrideBackgroundColorOrImage= overrideTextColor= promoTextAlignment= overrideCardHideSection=false overrideCardHideByline=false overrideCardHideDescription=false overridebuttonBgColor= overrideButtonText= promoTextAlignment=
data-content-type="article"

Cougs Care returns with expanded service opportunities for 2026 BYU football season

August 20, 2026
BYU fans and alumni will serve communities at home and on the road through food, literacy and sports equipment drives supporting local nonprofit organizations.
overrideBackgroundColorOrImage= overrideTextColor= promoTextAlignment= overrideCardHideSection=false overrideCardHideByline=false overrideCardHideDescription=false overridebuttonBgColor= overrideButtonText= promoTextAlignment=
data-content-type="article"

New Utah law protects student privacy after BYU research found K-12 apps were collecting and sharing data

August 18, 2026
In an August 2025 investigation report prepared for the Utah State Board of Education (USBE), BYU information systems professors Mark Keith and Justin Giboney found major leaks in student digital footprints. Such privacy violations leave children vulnerable to unauthorized profiling, commercial exploitation, and safety concerns, including potential exposure to harmful online content.
overrideBackgroundColorOrImage= overrideTextColor= promoTextAlignment= overrideCardHideSection=false overrideCardHideByline=false overrideCardHideDescription=false overridebuttonBgColor= overrideButtonText= promoTextAlignment=
overrideBackgroundColorOrImage= overrideTextColor= promoTextAlignment= overrideCardHideSection=false overrideCardHideByline=false overrideCardHideDescription=false overridebuttonBgColor= overrideButtonText=