The main idea of existentialism is that "existence precedes essence." That is like saying that you are born as a tabula rasa, a "blank slate." There is no Divine plan and no preconceived point or reason why we are here. Therefore, we are given the freedom and the responsibility of creating ourselves (mentally, culturally, etc.) and the world. With no divine or moral script, we are free to choose. With that freedom comes great responsibility. Under this existential belief system, if the world is a horrible place, it is our fault. It is necessarily up to us to make ourselves and the world a moral and ethical place.
This insistence on personal (and social) freedom and responsibility puts the burden (but also the honor) of creating the world on people's shoulders. In Existentialism is a Humanism, Jean Paul Sartre writes:
When we say that man chooses himself, not only do we mean that each of us must choose himself, but also that in choosing himself, he is choosing for all men. In fact, in creating the man each of us wills ourselves to be, there is not a single one of our actions that does not at the same time create an image of man as we think he ought to be.
It is important for an atheist (or a religious person for that matter) to embrace the honor and the burden of being responsible for ourselves and the world.