How does your garden grow???

Hi, I have played all of the Virtual Villagers, and now I am on My Tribe. My first island was going great and we were about ready to set sail, and I came back in the morning to set sail, and they all died of starvation. They had plety of food the night before.

New Island....

I have 4 gardens, and as fast as the produce is planted and ready to pick, the produce starts vanishing. Quicker then it's growing. Why is this.?
And the villigers don't want to pick the produce. They are always wanting to rest, or get rocks or wood, which is in great abundance.
Do you have any answeres?
Thanks,
Sandy

I haven't been playing very long, so these are the only things i can think of:
-change the characters' priorities under details. Make sure "agriculture" is checked.
-also try making the fertilizer potion (guano, saltwater, stardust), and put it on the little farms

good luck with your new tribe.