I replaced the stick as well. I got the stick and buttons from HimuraGames.com. They are very reliable and they ship fast. The Sanwa sticks are not an exact fit. You have to remove some of the molding that holds in the old stick. It's kinda of a pain, especially if you are a neat freak. A dremel would probably do the job well, as far as keeping it clean. And as you can see in the Pic I had to drill two holes through the Hori Stick to hold the stick in place. Also in case you don't know, the buttons solder directly to the PCB. You have to make the solder holes a little larger for the Sanwa button connectors to fit properly. If you want to cut corners, you can solder a very small piece of solid wire to the button connectors and they will fit perfectly into the PCB holes. One more thing the Sanwa shaft is a little longer than the stock shaft in the Neo Hori.
Currently I am on the hunt for Japanese microswitches, I want to only change the microswitches in my Hori Playstation stick. Rather than replacing the hole stick again. The Jap microswitches are smaller than u.s. ones and the Sanwa microswitches are soldered to a PCB. Sorry for the long response, but if you have any questions let me know.