No he can't, just tested with my Clefable who couldn't relearn Stored Power. Sorry :\ Egg moves can be relearned now, but pre-evolution moves can't.
(UNLESS the pre-evolution move was bred in as well. For instance, if you breed a male Ice Shard Donphan (lol) with a female Ice Shard Swinub, obviously a lvl1 Swinub with Ice Shard will hatch; in this case, even if you delete Ice Shard, Mamo can be retaught it, even though he can't learn it by level up. As far as I can find Bulbapedia doesn't explicitly state this; I'm inferring this from my own Mamoswine, who can be retaught Icy Wind, despite him not learning it by level up or as an egg move in the narrow sense. It's been some time since I bred him so I don't remember it all too well, but apparently I was breeding with two Swinub at some point, both of which must have had Icy Wind, causing my then-Swinub to hatch with Icy Wind as well.) tl;dr: all moves the pokemon knows upon hatching can be retaught, but pre-evolution moves can't.