The name of the building was the Hanover House or the Hanover Hotel, and it was located at 101 West 43rd Street on the northwest corner of 43rd Street and Sixth Avenue (now called Avenue of the Americas). Currently, it is the International Center for Photography.
This blogger does a great job analyzing the different views Guthrie would have had out his window as he wrote his most famous song.

