In a large bowl, beat the brown sugar, oil, egg and vanilla until smooth. Combine the flour, salt and baking soda; add to sugar mixture alternately with milk. Beat until smooth. Stir in rhubarb and almonds. Pour into two greased 9-in. round baking pans.
For topping, in a small bowl, combine sugar and butter; stir in almonds. Sprinkle over batter. Bake at 350° for 30-35 minutes or until a toothpick inserted in the center comes out clean. Cool on wire racks.