The activity of caving is not illegal anywhere in the US. Access to caves are often restricted in some manner and some activities inside any cave is illegal. For instance, disturbing Indian burial sites can get you more prison time than murdering someone.