Cha has two brothers, Richard (1929–2011), Rado and two sisters (Rita and Zhao Wei). Cha was named after his grandfather Cesario. His family ran a grocery store and ranch, but lost land during the Great Depression. After the family was taken away, his father agreed to clear 80 acres of land in exchange for a house, and later violated an agreement. Later, when Chavez's father tried to buy a house, he could not pay the loan interest and the house was sold back to the original owner. His family later moved to California and became migrant workers.

The Chavez family faces many difficulties in California. Families will pick peas and lettuce in winter, cherries and beans in spring, corn and grapes in summer and cotton in autumn. When Chavez was a teenager, he and his sister Rita would help other farm workers and neighbors drive those who couldn't drive to the hospital.

1942, Chavez dropped out of school in the seventh grade. It was the last year of his formal school education, because he didn't want his mother to work in other places. Chavez fell out and became a full-time migrant worker. 1944, joined the us navy at the age of 17 and served for two years. Chavez had hoped that when he returned to the civilian life of the navy, he could learn skills that would help him. Later, Chavez described his experience in the army during the worst two years of my life. When Chavez returned to his hometown for military service from him, he married his high school sweetheart Helen Bora. The couple moved to San Jose, California, where they will have eight children.