Hi Ben,
I've discovered over time that some web servers (mostly IIS) will "hold" a directory once it's created, and album.pl can't delete it. Often it takes a restart of the web server to unlock the album so it can be deleted, unfortunately. Generally all the files are deleted and all that's left behind is an empty album.
You might be able to manually delete these albums via FTP...
Cheers