I get that same situation fishing for striper all the time. It seems like sometimes they just refuse to commit. Ive tried changing size,color, style and I just come to the conclusion that they are on to me and come back later. The striper move alot and are rarely there when I get back.
The few times i have got them to eat has been by giving a hard twitch and making my 250 turn and face them and one will hit it then.