Brown was drafted #124 by the Baltimore Ravens in the 2005 NFL Draft. He played for Baltimore from 2005 to 2008 before signing a five year deal worth $37.5 million with the St. Louis Rams in 2009, of which $20 million was guaranteed. Brown was released by the Rams in 2012. In November 2014 it was reported that he quit football to be a farmer in North Carolina and had walked away from the majority of that $37.5 million contract.