I've also made the compact jump recently, and while I was extremely tempted by the open-platform approach m4/3 offers, I didn't find anything which matched my budget and slightly schizoid personal preferences. Some of the higher-end Olympus cameras were extremely tempting. Test-driving a mate's OM-D E-M1 left me really impressed, but I couldn't justify the cost of that thing, and I actively didn't want to add a ton of lenses, since the whole point of a compact camera (for me) was to run light, supplementing my DSLRs and letting me keep a camera on my person at all times.
The X100 was my primary candidate (budget constraints kept me away from the X-Pro1 and X100S). One showed up at a local camera store, I got a tip from a mate that it was there, and I bought it for $550. It was in the store for 4 hours after the original owner dropped it off. They're popular, so I had to move fast. Added a thumb rest and two more batteries
Many of its ergonomic foibles and "personality" are well-documented, so I won't flog that horse. Suffice it to say that a few days of cursing got it to reasonably-intuitive territory, the high-ISO performance trumps my DSLRs, and yes, you can get away with JPEGs most of the time. All features that make it a fine supplemental camera. Not sure something with a fixed 35mm f/2.0 could ever be a primary/only camera, except for shooters in fairly narrow genres. However, it's been a great bit of kit, and I'm starting to love the little sucker.
There are a few things that I think most reviews overlooked, or simply didn't convey accurately. First, the firmware revision makes a significant difference. Fuji added big features like peaking and a DoF scale (manual focus mode only) in later revisions, and mine was two revs old when I picked it up.
The battery life is short, but to my mind, a greater problem is a fairly uninformative battery meter. It seems to spend about 80% of its time displaying full, then drops rapidly to zero. Which would probably be fine if the battery life was better. Would love to have a vertical/battery grip for this thing, but the market appears to have decided against that.
Speaking of grips, the camera's is quite poor. It likes to slip from your hand, and manipulating any controls feels precarious. Aftermarket thumb grips help.
The EVF is considerably more useful than many say, and than I expected. It provides accurate DoF information (unlike the offset OVF) and in-finder peaking, though the display resolution is a little too low. Peaking appears rather chunky in the viewfinder, big enough to slightly obscure the details you're trying to home in on.
The slow manual focus ring is a problem, but the speed ramps nicely. You have extremely fine control at close ranges, and much coarser, but still sufficient control, at long ranges. It's focus-by-wire, and the direction is reversible, so a focus ring speed multiplier would be a nice touch for future firmware revisions (if any).
Overall, my needs remain better-met by DSLRs, but the X100 filled a gap in my systems, and after one gets to know it, is a very capable little beastie.