I suggest shutting the gas off at the meter. There should be a valve just below the meter. Use an adjustable wrench, or pliers.
There are tools for turning the gas off at the meter:
https://www.amazon.com/Ready-America-3333-Earthquake-Emergency/dp/B000BQKLWK/