The stone walls near the church are part of the Inca ruins at Marcacocha, the main site is in the valley below the church.