The Town drop from second to fourth, as their second game without a permanent manager ends in defeat by the odd goal.