A native of Richmond, Miller excelled in athletics at Benedictine High School. He attended the University of Richmond where he captained both the baseball and basketball teams. His outstanding performance earned him spots on the All-State and All-Southern baseball teams as well as the All-State basketball team.
Following his 1947 graduation from Richmond, Miller coached baseball, basketball and football at Glen Allen High School, the University of Richmond, Hampden-Sydney College, Washington & Lee University and Virginia Military Institute.
As a professional athlete, Miller played baseball for the Norfolk Tars in the Piedmont League and basketball for the Richmond Barons. He assumed the position of manager for the Chase City Baseball Team for a period of five years.
Miller became the voice of VMI football, calling all the plays for a span of 12 years as a radio broadcaster. He spent six years in the same role for Hampden-Sydney.
In 1986, Hampden-Sydney appointed Miller as Athletic Director and head baseball coach. His 1989 team took home the Old Dominion Athletic Conference Baseball Championship and when the new soccer stadium was erected on the campus, it was named in his honor.
Miller was elected to the University of Richmond Athletic Hall of Fame in 1981 and to the Hampden-Sydney Hall of Fame in 1991. He received the Keating Medallion in 1992, presented for distinguished service at Hampden-Sydney College.