English: The Freedman's Bank Building , previously known as the United States Treasury Annex, is located at 701 Madison Place NW across the street from the Treasury Building in Washington, D.C. The Treasury Annex houses the Office of Foreign Assets Control , the Treasury Library , and the headquarters and main branch of the Treasury Department Federal Credit Union . Designed by architect Cass Gilbert , construction of the Beaux-Arts style building was completed in 1919. The building is designated a contributing property to the Lafayette Square Historic District and Fifteenth Street Financial Historic District and is listed on the District of Columbia Inventory of Historic Sites . The building was renamed in 2016 in honor of the Freedman's Savings Bank , which once stood on the site.