Shooting IR using an IR filter presents a problem. Since the filter cuts so much of the light, exposure times tend to be too long to hand hold...
Shooting with a camera that has been converted to full time infra-red allows flexibility in that you can shoot at exposure times which can be hand-held.
I modified an old Canon D60 (not he latest 60D) DSLR camera which was not worth much for anything else into a full-time infra-red camera.
However, if I were to do this again, I would shoot IR with a good P&S camera. That way I could carry the camera in a pocket of my photo vest and always have IR capability handy. The D60 and lens is a relatively large solution and I often leave it at home unless I specifically am going out to shoot IR.
There are usually quite a few P&S cemeras which have been converted to IR avaiable on eBay. Some are about the price of a good IR filter alone...