The site of a former primary school in Somerset will be turned into homes and offices following a vote by local councillors.