Hi Andrew,
I *think* I understand what you're saying... Let me try to run through it...
Photo delete should work anywhere, so if it doesn't, that's a bug. I'll have to check that out...
The info is left in descriptions.txt because I've never gotten around to cleaning it out. Not so much a bug as I just never wrote the code. Still plan to someday.

Your album icons shouldn't be under your album, if you can avoid it. I put my img directory at the same level as my album directory, not in it. Since they start with thmb_, they won't show up, but the directory they're in will...
And lastly, when you edit titles and descriptions, it doesn't actually rename the underlying directory or file. It just throws an entry into descriptions.txt, saying for that file/directory, show the following title and description.
Hope that makes sense!