Giving up freedom to simulate quantum mechanics