Do I need to keep my check after it's deposited

No. It’s not required, but it is a good idea to hold onto it for a short time.

This gives you a backup in case there’s an issue with the deposit or it needs to be reviewed.