There's not much left of the pre-Civil War Methodist Episcopal Church at Old Cahawba. The ruins are unstable, so please just look , and keep out! Old Cahawba Archeaological Park is the site of Alabama's first capital. It is located at the junction of the Cahaba and Alabama rivers.