You will need to hold down C when you hear the chime. As of now you have no operating system on your hard drive hence its reluctance to boot. It has nothing to boot to!
The newly installed or inserted hard disk drive could not be compatible with the system specifications of the computer hardware parts. There might be also other problem with the compatibility issue of the Operating System. Please check all those possible problems.