How about some kind of community location.
Somewhere to hold (slave)auctions, executions, a place to post warrants or for the town crier to stand on…
Maybe a raised platform with stairs at both ends, somekind of message board or post on the front an rings at the back to tie animals/slaves to.
The kind of place daring last minute rescues and spontaneous revolts happen
If you like small scale skirmish, check out http://planetares6.blogspot.be/?m=0