To delete Tax Rates, go to Management Portal > Settings cog  > Accounts > Tax rates then select which tax rate you want to delete then check the box of the particular tax. Then go to select action and select Delete.