The Gardner

When I go through the gate to talk to the gardner that is supposidly fishing he is not there so I asume I have done something wrong but can not figure out how to correct it plzzzzzz could someone give me some help.

Have you looked at the floorboard again? You need to do this. Have you gotten
key for drawer & looked at watch?. When you go into garden (gate) just keep going straight past the flagpole & he is there fishing