If I have a site at myapp.herokuapp.com and I set it up have a custom domain of app.mydomain.com, will it still be accessible at myapp.herokuapp.com in addition to the custom domain?
Yes, by default you'll be able to access it from both locations...
