I have one on my iPhone 4. It was fine at first but became a bit slow after I updated to iOS 7. For example, the sounds are 1 to 2 seconds slower than the actual game. Or it may be a bit laggy during gameplay. I don't think it's too much of a problem though.
As for deleting them, you're able to delete the emulator or rom files whenever you want to.