I was working on a visual web part that was causing a lot of problems with the page hosting it. I need to remove it, but the 'Edit Page' was not working. The solution: navigate to the Web Part Maintenance page and remove it from there.
How do you get there: add ?contents=1 to the end of your page url.
For example, if my page is http://hostheader/pages/default.aspx, then the Web Part Maintenance page for that page is http://hostheader/pages/default.aspx?contents=1