11-04-06 - 1

So I've read like four books and a hundred papers and now have a strong grasp of collaborative filtering and machine learning. Basically CF is garbage that was made by bad engineers who didn't understand ML. All the true strong modern approaches are more theoretically-sound ML approaches. I should add many people in CF know this and have been advocating standard ML techniques for a while. For example Pazzani has some good papers and one suggests using an SVD->ANN. I don't like the details of his approach, but thebasic idea of SVD->ANN is solid, and just one example of "data reducer"->ML.

Unfortunately even robust ML approaches like SVM are full of unsolved and unsolveable problems which you have to address through "tricks" and guesses and brute force optimization.

Anyway I've decided on my overall approach and believe I'm on the right track. Now I just need my arm to heal so I can type agian. I'm not even trying to code lefty, it's too frustrating and requires too much chording.

One nice online resource is http://www.learning-with-kernels.org/ ; it's a really good book and they put the best chapters online. Chris Burges and Radford Neal also have great tutorials online. I have yet to find really good Neural Net material, there's a ton of garbage on Nets and it's hard to sift through. The Wikipedia pages on all this stuff are good jumping off points, they have good intros then links out to more info.

No comments:

old rants