Nope, you are not able to keep the pass, it is that after you use the pass you can enter the same raid as many times as you want until the time of that raid expires or you succesfully defeat it.
But the pass is already "consumed" on the first attempt, just before you enter the lobby. So if no ones shows or you fail once the time for that raid ends you will have no pass.