You can join a local chapter of the National Speleological Society at caves.org.

Cindy also wrote a guide here at https://cindywu.org/@cindy/so-you-want-to-cave-DF3MNY