fall by the wayside
verb.
give up in the face of defeat of lacking hope; admit defeat
In the second round, the challenger gave up