Drain fruit cocktail, and set fruit aside. Combine juice from fruit cocktail, milks, and eggs in a small saucepan. Cook and stir over medium low heat until thick, but not separated. Add lemon flavoring.
Dice pound cake. Layer cake, custard, and fruit in a 9 x 12 casserole dish or a trifle dish. Refrigerate overnight. Serve cold.