Tip 4: Get the water out, or the wall comes down. If you're building a retaining wall to hold back soil that slopes down to it, install gravel behind the wall with a pipe and filter fabric. This will enable you to direct the water where you want it to deposit.