I think you're right about that "safe for whom/from what" part. Can we stipulate that we're talking about dangers from other humans here? That is, "he let his dogs run loose" might be relevant, and "they told their dogs to chase him" definitely is, but blizzards and earthquakes are beyond the scope of this, even though architecture is a human activity that can make a difference.

At the same time, some of this is doable in English. Wiscon, for example, talks specifically about making safer space for people of color. Six words, and the conversation can continue about "safer in what ways?" and "how can we do that?" and "what does it cost?" Yes, someone can pop up and say "but what about the white people?" but there is no phrasing or language that will prevent someone from interrupting a discussion to say that they want to talk about something else.