One of the major complaints about bureaucrats is that they do not really care much about what happens to their clients. For example, it is often said that they take too long doing things like getting permits approved. There are two good ways to make that less of a problem.
First, bureaucrats should be evaluated to some extent on the happiness of their clients. This is how it would be in a private sector firm. A bureaucrat who consistently got things done too slowly or in a sloppy manner should always be retrained or fired. This is something that the public sector does not do as much as the private sector.
A second thing would be to simply make better or fewer rules for the bureaucrats to enforce. This is not something the bureaucrats could necessarily do themsleves, but it would be important. If there were fewer unimportant rules that bureaucrats had to enforce, people would not be angry at them so often.