1. Preheat oven to 350 degrees.
2. Grease 2 8x4-inch loaf pans.
3. Combine in a bowl the brown sugar and oil.
4. Stir well until smooth.
5. Add the egg, buttermilk, salt, baking soda, vanilla and flour.
6. Blend until moist.
7. Fold in the diced rhubarb and chopped nuts.
8. Turn batter into prepared loaf pans.
9. Combine the butter and sugar until crumbly, then sprinkle over batter.
10. Bake at 350 degrees for 50 to 55 minutes, or until bread passes the toothpick test.
11. Turn out onto racks and cool before slicing.
12. Slice into about 20 slices per loaf.