Ok- you've abandoned the concert violinist, and you are expanding the tort case to a thought experiment.
Uncharted waters.
A couple of wrinkles to add to your thought experiment to increase the analogy to abortion.
Change the man to a young child, or even a baby, someone upon whom the mother has a substantial physical advantage. Have the rapist bar the door as he leaves, preventing easy removal of the child.
The woman could force the door, but not without risk of injury, since she lacks the proper tools to open the door.
She then calls her neighbour to force the door open, using a wrench. The neighbour then tosses the child out into the snow. The mother pays the neighbour for his trouble and for the use of the wrench.
Given these changes, does the mother still have a right to remove the non-threatening child from her house, even though he entered without consent, and ate from her refrigerator?
Uncharted waters.

A couple of wrinkles to add to your thought experiment to increase the analogy to abortion.
Change the man to a young child, or even a baby, someone upon whom the mother has a substantial physical advantage. Have the rapist bar the door as he leaves, preventing easy removal of the child.
The woman could force the door, but not without risk of injury, since she lacks the proper tools to open the door.
She then calls her neighbour to force the door open, using a wrench. The neighbour then tosses the child out into the snow. The mother pays the neighbour for his trouble and for the use of the wrench.
Given these changes, does the mother still have a right to remove the non-threatening child from her house, even though he entered without consent, and ate from her refrigerator?
Comment