Agreed pull him out. They will not technically release toxins - but will tax your bio load with ammonia and nitrite, and if pieces hit the fan you will need to clean and do a big water change.
sorry for your loss.
I would wait a few months before replacing it - if it was a bacterial infection let it run out its course, than try again.