Are you pressing A on the DS menu one second before your target second? Because the game takes one second to get seeded so you have to start one second before.Yes. (B in this case) It probably has something to do with the roamers because I have no problems hitting wild/stationary Pokemon seeds. This is ridiculous. I tried without advancing the frame and get some other result that doesn't show up.
EDIT: JRT: There's an option for that but I heard it's still being figured out.
Also, are you holding B until you see the shooting stars?