Martino was born Patrick Carmen Azzara in Philadelphia, Pennsylvania, United States, to father Carmen "Mickey" Azzara (d. 1990) and mother Jean (née Orlando, d. 1989). He was first exposed to jazz by his father, who sang in local clubs and briefly studied guitar. Pat studied with renowned jazz teacher Dennis Sandole, and in his studio met other of Sandole's students; among them, John Coltrane, James Moody, McCoy Tyner and others. Martino began playing professionally at the age of 15 after moving to New York City. He lived for a period with Les Paul and began playing at jazz clubs such as Smalls Paradise. He later moved into a suite in the President Hotel on 48th Street. He played at Smalls for six months of the year, and played summers at the Club Harlem in Atlantic City, New Jersey.