Removing an email account does not delete it forever. It's still accessible from other devices. Alternative options include disabling the account or hiding new email alerts. This article explains how ...
You can swipe to delete messages in the iPhone's Mail app, but you'll need to enable this option in Settings.