We should only optimize where we can get a significant improvement