The source code for SVMTrainer 0.30 is now available. Go to the new SVMTrainer page, download the code, and see if you can get better results than I did.
Read more
Categories: Programmer
Category: Programmer
To-do from CCSC-NW 08
Here is a list of the potential changes to SVMTrainer that were suggested to me during this weekend’s conference. Searcher Implement conditions on acceptable web document sizes to optimize document retrieval time Try using a small initial search as a seed to get other search terms and expand the diversity of my training set –…
Read more
Categories: Programmer
Focusing
The last month has taken me through a couple of choices in how to focus this project. First, I attempted to design a ‘version 2’ that would use project files. The idea was to give a project a group of categories to use, as well as persistent result sets and a dictionary that can be…
Read more
Categories: Programmer
Humble Beginnings
I ran my first couple of training sets today. I must confess, the results are not pretty. Let’s start with the summary: Summary The training set for the text categorization example given by Joachims contains 2000 weighted example vectors. The precision of the resultant model, as estimated by svm_learn, is 93.07%. My first training set…
Read more
Categories: Programmer
Search Limits
Today I learned about some under-documented limits on Google’s AJAX search API. While working on my Searcher class (that will eventually generate training sets for the SVM) I asked Java to print the first 50 page titles that Google returned. Every time I ran the program I would get a JSONException after 28 results. Upon…
Read more
Categories: Programmer