I tried Jerrill's Printrbot PLUS Z-axis Set Screw Tensioner (thing:57390) but was still having issues due to the glued wooden tag. Then I came accros CursedMagician's Printrbot LC Plus Z-Endstop (thing:26651) but wanted to keep the nylock - so combined them.
Step 1) Print!
Step 2) Insert a #6-32 nylock nut in the hole inside.
Step 3) Attach to Printrbot!