Joe Frazier was the 12th child born to Dolly Alston-Frazier and Rubin in Beaufort, South Carolina. He was raised in a rural community of Beaufort called Laurel Bay. Frazier said he was always close to his father, who carried him when he was a toddler "over the 10 acres of farmland" the Fraziers worked as sharecroppers "to the still where he made his bootleg corn liquor, and into town on Saturdays to buy the necessities that a family of 10 needed." Young Frazier was affectionately called "Billie Boy."

In 1964 heavyweight representative Buster Mathis qualified but was injured so Frazier was sent as a replacement. At the Heavyweight boxing event, Frazier knocked out George Oywello of Uganda in the first round, then knocked out Athol McQueen of Australia 40 seconds into the third round. He was then into the semi-final, as the only American boxer left, facing the 6 foot 2, 214 lb. Vadim Yemelyanov of the Soviet Union.  "My left hook was a heat-seeking missile, careening off his face and body time and again. Twice in the second round I knocked him to the canvas. But as I pounded away, I felt a jolt of pain shoot through my left arm. Oh damn, the thumb." Joe would say. Joe knew immediately the thumb of his left hand was damaged, though he wasn't sure as to the extent. "In the midst of the fight, with your adrenaline pumping, it's hard to gauge such things. My mind was on more important matters. Like how I was going to deal with Yemelyanov for the rest of the fight." The match ended when the Soviet's handlers threw in the towel at 1:49 in the second round, and the referee raised Joe's injured hand in victory.  Now that Joe was into the final, he didn't mention his broken thumb to anyone. He went back to his room and soaked his thumb in hot water and Epsom salts. "Pain or not, Joe Frazier of Beaufort, South Carolina, was going for gold." Joe proclaimed. Joe would fight a 30-year-old German mechanic named Hans Huber, who failed to make it on the German Olympic wrestling team. By now Joe was used to fighting bigger guys, but he was not used to doing it with a damaged left hand. When the opening bell sounded on fight night, Joe came out and started swinging punches, he threw his right hand more than usual that night. Every so often he'd used his left hook, but nothing landed with the kind of impact he managed in previous bouts. Under Olympic rules, 5 judges judge a bout, and that night three voted for Joe.

Who did Frazier fight in the 1965 Olympics?
At the Heavyweight boxing event, Frazier knocked out George Oywello of Uganda in the first round, then knocked out Athol McQueen of Australia 40 seconds into the third