Taking their heart is just a quicker way of saying, taking out the shitty parts of their personality. The end goal is to make them turn themselves in, and watch the system that protected them tear them all apart.

[You can remove lots of other things too, with varying results up to and including death, but the Thieves very specifically focused on the shitty parts.]