Thanks for the response Hozu that answers my question.
Just to make sure I understand the concept properly, I don't need to worry about calculating frames from when I start the game to when I start the video since it'll automatically be forwarded to whatever the saved frame was from the video...