The iconic red stone that makes up the building’s exterior is sandstone that was mined by enslaved people at the Seneca Quarry in Maryland, some 30 miles northwest of the National Mall.