That usually happens the first couple of years. First year I did strawberries I got one fruit and a fucking pigeon stole it.

Never give up :)