Yes, but I think you should keep the other templates as is. I'm very confusing, aren't I

.
Here's a break down of what I think would be cool:
Merge the footer and header templates into 1 .htm file and keep all those cool ####xyz#### tags. Add a ####body#### tag as you suggested to be replaced with the different Album pages.
Keep the other templates, and their tags, as is for us to customize individually. And have them replace the ####body#### tag in the .htm file when needed.
This way when we want to change the whole page layout, we only change the .htm file. And to change the different Album pages, we change the other templates.
I hope I'm making sense here

.
Thanks.