Well as you said in the OP:
"she would otherwise live a relatively comfortable if secluded existence"
For someone like Annie who wiped out entire towns that would not be justice. Maybe killing her would be to extreme and that idea of handing her over to the fairy's does sound pretty good though.