Columbia is a city in Marion County, Mississippi, United States, which was formed six years before Mississippi was admitted to statehood. Columbia was named for Columbia, South Carolina, from which many of the early settlers had come. The population was 6,603 at the 2000 census. It is the county seat of Marion County.