Little bit of an update, I finally got a couple hours to tear down a little more. Confirmed that I had 2 lobes with damage, one lifter was pitted and the other was flat-spotted. Oil had a few larger than glitter specs that moved with a strong magnet on the backside, not much other metal etc.
I think I could probably swap the cam and replace 2 lifters and be good enough, but I think I will take a little more time, pull the engine, and do a little more work. Probably swap springs back to a beehive style and run the summit 8719 cam, unless someone steers me otherwise (and I'm listening...).
Clean the oil pan, replace the leaky rear main, check/replace some bearings, and generally reseal everything. I don't think I need any machine work, so hopefully I can freshen it up for less than a grand with the summit cam and go from there. Then get a full in person tune at some point too...
Anyway, slow progress but at least it's progress.