How to Design a Small Back Yard: Ten Tips for Success

Ideas and examples for rowhouse or townhouse landscape design

Do you own a property with a small back yard? Want to make your outdoor space more liveable, pleasant, and environmentally friendly but aren't sure how? I work in these spaces frequently and wanted to share some tips and design examples with you!

DC, Baltimore, Philadelphia, and other older eastern cities have many rowhouses and townhouses with lots between 17 and 30 feet wide. These small back yards can be more challenging, time-consuming, and expensive to design than the yards of larger freestanding homes. The amount of space required for walkways and parking cars can only be reduced so much, meaning that proportionally more of the site is devoted to access and circulation than on a larger lot. Storage also becomes much more of a challenge.

On these lots, accurate measurements become extremely important, tolerances become tighter (an inch or two can make a huge difference to a rowhouse design), and different elements are located right next to or on top of each other. This requires more care in designing and a greater knowledge of construction, zoning, and codes to determine, for example, whether a deck footer can in fact be located next to or on top of a retaining wall. Designing a very small yard can often come to resemble the design  of a tiny house or boat more than a larger yard, with every space serving double duty and storage built into every nook and cranny. Many cities also have strict regulations, lengthy permitting processes, and can require substantial fees before permits are approved. While this post focuses on rowhouse and townhouse design, the advice should also apply to other small lots in urban and suburban areas.

While small gardens can be challenging to design, I think they are some of the most rewarding projects. Due to their small square footage, I can often use higher-quality or remnant materials, resulting in amazing spaces like jewel boxes. And there’s nothing like the satisfaction when the puzzle pieces click together to create a functional and beautiful space that improves someone's relationship with the outdoors and provides habitat and ecological benefit within the city. As a landscape designer I work with these properties frequently and hope these tips will help you out. If you find yourself stuck, feel free to reach out to me for advice or design help! I work locally around Washington, DC and can do concept designs further afield via video consults and plan/photo sketches. If you’re committed to doing it yourself but are stuck and want to set up a brainstorm session to play around with ideas, I’d be up for that too!

Before Images
Existing conditions of a rowhouse with a full story of  elevation change across the lot and an AC compressor located in the way

An AC condenser squarely in the way on a challenging site with lots of side-to-side elevation change.

A rowhouse lot with 22' of grade change from the front yard to the back yard. 13' of that grade change is in the back yard.

There were twenty-two feet of front-to-back grade change on this rowhouse lot, thirteen feet in the back yard alone!

Modern Rowhouse Design

Existing Conditions
A before image of a rowhouse lot with an expanse of concrete. The house is raised a half-story, with an enclosed porch and a crawlspace underneath
Precedent Images
A precedent image board for a modern rowhouse design
Final Design Concept
A modern rowhouse design based on a grid of concrete squares, a corten planter box, and storage built underneath the steps to the house.

A modern concept design for a rowhouse lot. You can see the extra parking length needed due to the 4' clearance for the bifold inswing gates at the back of the parking area. If no gate was required, the parking could have been shifted back and additional plants or a larger-growing tree could have been added. A grid of 3' x 3' concrete pavers forms the basis of both the parking and gathering areas. The spaces between pavers are filled with a creeping groundcover in the gathering area and with decorative stones in the parking area. The steps up to the main level (in brown) were sized at a generous 4' wide to accommodate strollers and to allow trash and recycling cans to nest underneath the steps. A cor-ten planter provides vertical separation between parking and gathering areas. This is an example of a rowhouse with an enclosed back porch over a crawlspace. Exterior access to the basement has been retained and this space was dug out and enlarged to provide storage.

10 Landscape Design Tips for Small Spaces
  1. 1. Measure your space accurately, both horizontally and vertically.
  2. In a small space, a few inches can make or break a design! Locate all utilities, downspouts, windows, drains, trees, pathways, driveways, fences, doors; in short, everything you can think of. If you forget something, don’t worry; you can re-measure and add it later.  
  3. Draw your yard to scale. Any scale is fine. Graph paper is fine. Do one drawing as if you were looking down from the sky at your yard (“plan view”).
  4. If there are significant slopes, walls, or other changes in elevation, do another drawing as if you were looking at one or more sides of the yard (from the back or side). You can set up horizontal string lines between stakes and measure the distance from the string to the ground at various points. I use a Zip Level, which is extremely accurate, but it’s not a cheap piece of equipment.
  5. Don’t forget to look up! Are there overhead wires or tree branches? Draw them in.
  6. If the space is complicated, I would recommend using Sketchup to do a 3D model. Thinking in three dimensions while looking at 2D drawings is an acquired skill that is hard to master and even professionals miss details when working this way. Sketchup isn’t great for modeling uneven terrain or landscape but small lots are often more geometric than most, which lends itself well to this sort of approach.
  7. 2. Know your constraints: regulations, code, and zoning
  8. Most rowhouses and townhouses are in urban areas where there are many restrictions on what you can do with your yard. Make sure to research and understand the zoning code including setbacks, lot coverage regulations, fence height and location rules, impervious surface restrictions, and what will need to go through permitting. This usually takes me no more than an hour in jurisdictions I’m familiar with, but I know exactly where to look. It will likely take you a lot longer.
  9. As you design, you’ll need to know regulations related to building code, for example how much headroom you need above steps, minimum tread depth and maximum riser height, handrail and railing requirements, the maximum height a retaining wall can be before it must go through permitting, etc. These will be essential as you try to squeeze everything into a tight space.
  10. 3. What feels right or wrong about the yard?
  11. Spend some time in the yard. How does it feel? Hot? Exposed? Are you being eaten alive by mosquitoes? Do you feel like you’re on view of your neighbors? Do you like seeing the neighbors and feel that you’re too enclosed and disconnected? How do you want it to feel? What would encourage you to spend more time outdoors?
  12. Spend some time on Pinterest saving images of how you want your space to look and feel. If you can’t figure out how to fix it, that’s what I’m here for. I often hear, “It feels wrong but I don’t know why and I don’t know what to do.” Usually I can pinpoint the issue in a few minutes. Coming up with workable solutions in three dimensions takes a lot longer.
  13. 4. Make use of vertical space. Slopes can be a challenge but also a big asset
  14. Your vertical space is the total height between your doorstep and your property line. In some rowhouses with walkout basements, you have a full story of vertical space to work with. Making use of vertical space is my biggest #1 tip for small back yards. Often we forget how much stuff we want to keep outside: trash and recycling cans, compost bins, garden hoses, bicycles, tools, gardening supplies (soil, pots, etc), rain barrels, lawnmowers, cars, etc. If you can avoid having a freestanding shed in your rowhouse lot, you’ve saved a lot of space. (The other alternative is to create an attractive freestanding shed and use it as a focal point).
  15. If there’s enough vertical space, build storage underneath the steps to the main floor. This is a great place for trash cans, recycling bins, and potentially also bicycles, depending on the dimensions.
  16. Build storage into every vertical surface. Build benches into decks, which saves space over freestanding chairs, and build storage into the benches. If there’s grade change in the yard, can you build storage into the slope and put a patio over top of it? This usually requires getting a structural engineer involved, but it may be worth it in the long run.
  17. If you have a full story of potential vertical space, build a deck with a screen porch or storage underneath. This is expensive and subject to zoning restrictions, but you’ll be able to essentially create space out of thin air. If you can add a pergola overhead for shade/privacy, all the better!
  18. Many rowhouses are slightly elevated (about a half-story) with an enclosed porch on the back. Underneath these porches is a crawl space with steps leading to a lower access door. Excavating these crawl spaces and turning them into screened gathering areas, storage spaces, or additional basement can also create new functional spaces.
  19. 5. Don’t let the air conditioning condenser drive the design!
  20. This is can be a huge issue on small lots. On a larger lot, a 3’ x 3’ condenser isn’t usually an issue. On a small lot, that same condenser takes up 10-20% of the valuable real estate right next to the house, which is exactly where you would want to locate a deck, patio, or other gathering space. The ideal process would be to design first and THEN site the condenser, but I have had to work entire designs around existing condensers, leading to less than optimal results. I would strongly suggest switching to wall-mounted mini-split units if it’s in the budget.
  21. 6. Do you really need those parking spaces? Can they do double duty?
  22. Of all landscape features, parking takes up the most space. Half of a rowhouse back yard can easily be taken by parking, and it’s often more. Each car needs about 10’ by 18’ of space to park (sometimes less if you have a compact car), so two cars parked side-by side need around 20’ x 18’, which is usually nearly the entire width of the property.
  23. Rear vehicle gates are a challenge. Many of my clients want to be able to close and lock gates behind their cars. Inswing gates are the most affordable option (usually outswing gates aren't an option because they’d block a street or alley). Bifold inswing gates need around 3'-6’ of clearance depending on the width of the parking area, meaning your 18’ parking space stretches to 21' to 24’ long. Overhead roll-up garage-style doors are the best option to save space, but some clients don't like how they look. Gates that slide on a track to the side in a style like a tambour door are also space-saving, but the lot must be completely flat and you'll spend at least $40,000 on this type of gate.
  24. Parking can be located underneath an elevated deck or porch, but because these structures are usually located next to the house, this results in a driveway, which is usually wasted space on a rowhouse lot. Strip or ribbon driveways can reduce the amount of pavement required.
  25. If you must have car parking and also need a space for large gatherings, you can use pavers to make the parking area look nice so that it can also be used as a gathering space when the cars are parked elsewhere. Decorative patterns can be made by combining different colors and shapes of pavers.
  26. As a designer, I’d love to use your entire back yard to create a garden oasis instead of parking, but then again I don’t have to live there. This is a challenging one. Until we build better public transit and bike-friendly cities, a huge percentage of our space will be devoted to cars.
  27. 7. Don’t forget shade and privacy! Fences, walls, and hedges are your friend
  28. Trees require growing space for their roots and an overhead area free from wires. The minimum soil volume for a tree to reach a 10’ diameter canopy spread (and no bigger) is 120 cubic feet, which assumes a depth of 3' of growing media. For a 21' diameter tree, 500 cubic feet of soil is needed. Take a look at Casey Trees’ Tree Space Design Report for more information.
  29. Fence height is often capped at 6-7’ depending on your jurisdiction, although DC allows fences up to 10’ with written permission of neighbors.
  30. In England and other countries, brick or stone garden walls are common. These are a great option, although they are more expensive to construct than fences.
  31. In areas where fences are not possible due to zoning or a taller screen is needed, narrow hedges are your friend. They work best in full or part sun. Look for fastigiate or columnar species. Both terms mean they have a naturally narrow growth habit. The taller and narrower you want the hedge and the more shade the site receives, the more challenging this task becomes. For example, almost no plants grow to only 1-2' wide and more than 15' tall in shade. Maybe some clumping bamboos...
  32. Green walls, or structures to support climbing vines, can be constructed, but they're subject to the same height rules as fences if they're located along the property line. They can usually be taller inside the building setback line, and also usually must go through permitting.
  33. 8. Make a mockup!
  34. Here’s an advantage you have over most design firms: the ability to quickly and cheaply do a mockup of your design in your space on your own time. Not sure how big to make a deck? Use chalk or chalk spray paint to mark out a potential space, move your deck furniture in, and try out your ‘deck’ for a few weeks. Not big enough? Make it bigger. This doesn’t always work, for example if you have an uneven grade or need to add retaining walls, but if your lot is mostly flat it gives you a lot of opportunity to try before you build. Can you maneuver your car into the space? You can use concrete blocks, bricks, or inexpensive planters to test ideas. Move them around and live with your design before committing time and money to making them permanent.
  35. 9. Keep it simple!
  36. If you’re a maximalist or very comfortable playing with materiality, feel free to go wild in terms of materials, but I usually suggest no more than 3-4 materials including both horizontal and vertical surfaces in order to tie everything together. Get samples or swatches, and put them next to each other. Find pictures of what they look like installed, because materials can look/feel different at scale.
  37. 10. Push yourself to come up with at least 2-3 different designs
  38. Often ‘design genius’ comes when you’ve already exhausted the obvious solutions and push yourself to come up with more options.

Rowhouse Design Examples

Small Rowhouse Back Yard

Rowhouse Plan Option A

A design for a rowhouse back yard with a large upper patio terrace, bike storage built into the slope underneath the patio, and a lower lawn terrace with a shade tree. Bluestone steppers form a walk along the east side of the yard.

Rowhouse Elevation Option A

A line drawing showing the elevation of bicycle storage tucked underneath a patio with locking doors on a sloped yard in a rowhouse.

Rowhouse Plan Option B

Another option for a rowhouse lot with a smaller upper terrace, planter between the two terraces, a permeable lower terrace, and a freestanding shed taking up a significant portion of the lower terrace.

Rowhouse Existing Conditions

Before image of a small rowhouse lotBefore image of a small rowhouse lot with 7 feet of elevation change, shown from the downhill side outside of the fence

Above: two concept designs for a small 38' x18' rowhouse lot with 7' of elevation change between the back door and the property line. Option A has storage built into the slope underneath the patio, as shown in the elevation drawing. Option B has a freestanding shed, which is the tan rectangle to the upper right on the plan. This takes up much more space but is a more affordable option. Due to a 5' utility easement on the back of this lot, the option on the left has a shrub border at the back but no fence (in case of utility work the shrubs can be removed and then replanted). The option on the right keeps the fence located inside of the easement, which sacrifices the back 5' of the lot to the adjacent open space.

Driveway Doing Double Duty as Patio

A rowhouse lot with a driveway that widens near the house to double as a patio for large gatherings.

The owners of this end unit rowhouse wanted to retain driveway access to the garage under their house and also provide a space for large family gatherings. We proposed a driveway that would do double duty as a patio when cars were parked elsewhere. The driveway is permeable, which allows for stormwater to percolate through the site. These owners preferred a lower and more open fence so they could see and chat with their neighbors. Raised vegetable gardening space is provided behind a retaining wall and a honeylocust tree on the south side of the property will eventually grow up to provide shade.

Making Space from Thin Air

An image of a rowhouse landscape design showing the new two-level modern black metal deck. Steps with wooden treads and cable railings lead up to the second-storey deck with a pergola overhead. Cables provide a place for climbing vines to grow up. A brick walkway allows easy access to the lower portion of the house and gathering area underneath the deck.
An after photo of a rowhouse or townhouse landscape design. Privacy is provided on the small lot by a new wooden fence. This photo is taken from underneath the new metal deck, which shields views from neighbors above and behind and casts shade on an otherwise sunny, south-facing lot. The vines will grow in and provide additional screening to the space. Trash and recycling storage is accommodated underneath the new metal staircase with cable railings.
View of the second storey modern steel deck with overhead pergola. The size was limited by DC building restrictions but is just enough to fit a couch and small table. Cables in the pergola overhead will support flowering vines.

I maximized the vertical space in this small rowhouse lot by adding a second story deck with stairs and a pergola, taking advantage of the fact that the main level was a full story above grade. This double deck added 85 square feet to the 500 s.f. back yard and created two gathering spaces where there had been none. I worked within stringent Washington, DC regulations to maximize the deck footprint and create a usable small backyard landscape design with room for a tree, plantings, trash and recycling storage, and a grill/smoker. The cables support flowering vines, which will grow to provide shade and privacy for the second level of the deck, which is a hot, south-facing space in full view of the neighbors.

I hope these tips for designing small spaces have given you some direction and ideas to pursue as you work on creating your ideal back yard. Remember, if you have questions or need a little help, I’m here for you! Just reach out to me at info@sandboxlandstudio.com and I’ll be in touch.

Happy designing!
Renee