The New York and Harlem Railroad became the first railroad to operate in the US.
Source
More: City's First Railroad, Harlem Line, Harlem Valley Rail Trail
