In general, yes.
The question that comes to mind is what you hope to accomplish?
If you want the servers to use this “backbone” to communicate with each other (for example, web server talking to database server), then you leave the default gateway as is, and then add persistent static routes through the “backbone” to the other servers.
Since you mentioned various OS’s, I won’t bother specifying routing commands.
But – it’s fairly trivial to implement – been there, done that.