Alfred Lavallee was married to Marie Peloquin. Their oldest child, "Melina" as per the 1881 census, was born in the United States. Their other children, identified in the 1881 census, were born in or around the parish of St-Germain-de-Grantham, in Drummond Co., Quebec. I can see at least two of these children, Olivier and Paul, in Rhode Island in 1900, so some or all of the family went (back) there.
I assumed Marie was an older sister of Norbert, though she could be another relative, or even his unmarried mother.