When I had my stone the symptoms were similar but I was also vomiting. In fact I threw up in the ER waiting area while we were waiting to see a doc. CT scan confirmed it was a stone.
To make a long story short, a week later they ended up having to go in and get it since it lodged and was not moving. Pro tip...this is not a procedure you want to have if avoidable
Get to a doctor ASAP