I realized I was holding my breath during push-ups. Correcting that increased my reps and reduced dizziness.