On point sets with many unit distances in few directions