As mentioned by several, economic times has put a big damper on a lot of people over the past 3-5 years. Personally I've taken a huge pay cut from what I was earning 3-5 years ago.
The Vet classes tend to be some of the biggest today. The youth can't afford the bikes/equipment. I temember back when I was 15-21, most of my friends could go buy a new 125 every year with their own money.
The tracks in D11 leave a lot to be desired for me. I feel bad saying this but I don't like any of them. However, I can't blame the owners for not investing time/money into them. I mean why spend countless hours prepping/changing layouts for no one to show up. The money isn't there for them.
Another big sticking point for me is time involved. If you just race on a Sunday, you take up most of the weekend. You can't do too much on Sat., as you have to get in bed at a decent time to get up at 6 am. Then sit around all day during 20+ classes of riders. That is a lot of time, when you have family, house chores, etc.
Most adult sports such as volleyball, bowling, sofball etc, can be done in a few hours. There should be a better way to do this. Combine more classes, cut classes, maybe run half the classes in the morning and half in the afternoon? For me this is a huge sticking point.