In the sentence We were hoping to begin a game of chess, to begin is an infinitve functioning as a noun.
An infinitive, to plus a verb form, can be used as a noun, adjective or adverb. In this case, as it is functioning a direct object, is functioning as a noun. To begin a game of chess is the object of the the verb hope, is the answer to the question "what were we hoping?"
