I would say that it is fair that the individuals with more education possess more influence in decision making. One would rather have people with education and knowledge making decisions as opposed to individuals with less education and understanding making decisions. The critical element in this equation is establishing some type of framework where individual who abuse or misuse their power can be recalled. Perhaps, we are not able to create settings where the best and the brightest always act in the public interest. If this is the case, we can at least create scenarios where individuals are able to recall or remove those who are abusing their power or not acting in the public interest. The systems of checks and balances or popular sovereignty might be one such element where individuals must use their intelligence and knowledge to act for the interests of all.
Sure it's fair. In fact, it's almost impossible to avoid.
Think about how our society is. The people in positions of power are just about all more educated than the average person. They are all certainly skilled (at least in getting elected). It would make very little sense to take a bunch of people who don't know anything and have them be in charge of making decisions for our society.
The problem with Animal Farm isn't that the pigs get to make the decisions. The problem is that no one else has any input. And the problem is that the pigs manipulate the facts to fool the people. That stuff is way more dangerous to society than the fact that the people in power are more educated and skilled than the others.