That's the problem. Bruce didn't really doubt Terry would come back, especially with Bruce's disappearance. He didn't want Terry to face the Joker and he especially did not want him to do so alone. If he had to fight him, Bruce would have felt better with being his eyes and ears.

He doesn't say anything to that. "Try your door. I'll try mine."