Harewood Castle was built by Robert de Lisle in the 14th Century and is located in Harewood Park at the extreme north of the village on a ridge near the main road. The tower house is rectangular with four angle-towers and an entrance on the ground floor of the north tower. On the ground floor is the Great Hall with the remains of a great fireplace in the east wall and an ornate recess in the south wall. Above the Great Hall was the solar. To the west of the tower house was the kitchen on a level with the hall. Below was a large, barrel-vaulted basement while above, two upper floors served as dormitories for servants. The remains still stand and are now Grade 1 listed buildings.