Can I edit or delete custom categories?

Yes. You can edit or delete custom categories in your settings.

Go to Activity (in the app: More → Activity) → Settings → Custom categories, then select any category to edit or delete it.