Upper bounds on fault tolerance thresholds of noisy Clifford-based quantum computers