How to fill the space without clashing materials?

I’m trying to create a medieval themed house and I was outlining the roof when I realized that I couldn’t really fill the space between the roof and the floor without clashing the brick materials. Here’s what I have so far(it will be detailed, but I’m going for the overall shape of the design first):
https://gyazo.com/3dc249670f7a950a82fae3c161f88c41

How would I fill the space between the roof outline and the floor without having clashing materials? I’ve tried gap fill, but it doesn’t seem to be a good way to get the job done for this specific case.

Do a sort of duplicate of the bottom portion, but fit it to the needs of the roof. You’ll have to play around with the thickness of the wood borders, but that should complete the look.