It's a bit dishonest to slip away as an excuse.
In fact, job hunting is a two-way choice process. If you are not satisfied with that company, you can put forward some objective reasons to refuse the other party. If you do this, it is reasonable, and the other party has nothing to say.