Yes. It’s done all the time.
Just to clarify though – You said that computer A has both wireless and wired (implied). Computer B has only a wired connection.
Questions are whether or not Computer A is crossover wired to computer B? and is computer A running Internet Connection Sharing (ICS)?
Make sure that you don’t use the same addressing scheme for the wireless A-Belkin connection as you do for the wired A-B connection.
Look up ICS how-to info on the Microsoft Knowledge Base.