The first public Bat Mitzvah was held in New York City. It was for a girl named Judith Kaplan.

Source