Rigidity of toric varieties associated to bipartite graphs