Banks was an athlete, starring on the baseball, basketball, and football eleven at Clemson and earning three letters in each. This legend earned All-America honors in both basketball and football. McFadden held the punting record for the Tigers for over four decades. Clemson's first bowl game, the 1940 Coton Bowl, cemented the icon's legacy. The Tigers knocked off Boston College by scoring 6-3 after McFadden batted down four 2nd half passes and averaged 44 yards for the 11 punts he made in the game.

The National Football Foundation selected Banks McFadden to enter the College Football Hall of Fame in 1959. He was the fourth overall pick in the 1940 NFL draft by the Brooklyn Dodgers and had the longest run in the League in 1940 with a 75-yard dash down the field. After eleven pro games, he left his playing days forever to serve his country and coach at his alma mater.