The Benjamin Ogle Tayloe House is a Federal-style house located at 21 Madison Place NW in Washington, D.C., in the United States. The house is on the northeast corner of Madison Place NW and Pennsylvania Avenue NW, directly across the street from the White House and the Treasury Building. Built in 1828 by Benjamin Ogle Tayloe, son of Colonel John Tayloe III, the house became a salon for politically powerful people in the federal government.

Col. John Tayloe III, of Richmond County, Virginia, was the premier Virginia planter; a politician, businessman, and tidewater gentry scion. He was prominent in elite social circles. A highly successful planter and early Thoroughbred horse breeder, he was considered the "wealthiest man of his day". A military officer, he also served in the Virginia House of Delegates and Senate of Virginia for nine years.