What do you want to grow in the bed? Tall tomatoes or tropicals? How large are you planning on building? Is the south side wall going to be tall enough to accommodate your plants' size. My thinking is that the south is most logical.
My experience reminds me that I had to lean my tomato plants over into the aisle.