To delete Tax Rates, in the Web Portal go to the Settings cog  > Accounts > Tax rates > select the checkbox for the Tax Rate that you want to delete. Click on the Action dropdown and select Delete, and then select Go.