Yes, almost all banks close for Columbus Day, as it is a Federal Holiday--which means no mail either.
It is in my town.