Fragile spin liquid in three dimensions