The college was founded in 1952 when the 'Pre-Officer Cadet Training Unit' and 'Boys Company' was announced to be established by the Secretary of Defence. But it was only in 1953 that Sir Gerard Templer, The British High Commissioner to Malaya had formally formed the 'Federation Military College' or FMC. The college had undergone various changes and later moved from its original site in Port Dickson to its present campus in Sungai Besi Camp in 1961.

The name of the college was redesignated as the 'Royal Military College' after it was awarded with the Agong's Colours by His Majesty the Yang DiPertuan Agong in 1966. In 1967, the term 'Boy' was changed to 'Putera' and the 'Boys Wing' had changed to 'Putera Division'. (Until now, it is the only academic institution that was awarded with Agong's Colours.)

In 1997, the Putera Division was seperated with the Cadet Division when its administration was handed over to the Armed Forces Academy(ATMA). The cadet division and the college HQ was officially moved to the Ulu Tiram Camp.

The college was meant to be the place to train officers for the armed forces but now Puteras or Boys, are free to choose whether to join the army or not although they are encouraged to join the forces since they are taught with basic army skills.

The college is a special place for it had taught us the meaning of courage, integrity, loyalty and honour. It is the place to understand how life is to be lived. We share a brief but meaningful moment there and we know that those moments are the best in our lives. For us the college will always be in our heart.