## April 1, 2005

Above is a diagram of my view of some complexity results. P is the set of problems that are solvable in polynomial time. P-Complete is the set of problems which all problems in P can be polynomial-time reduced to...

## March 31, 2005

A Horn clause is restricted to have at most one positive literal. They are typically written as an implication statement which can be converted to a disjunctive clause: Horn clauses are an interesting restriction because they allow efficient resolution and...
Generally speaking in generative learning one is trying to optimize the parameters of a generative model to best explain the data that is observed. In discriminative learning there is no model assumed, but instead a function is optimized to best...

## November 12, 2004

The negative binomial distribution captures the probability of having S-1 successes and F failures in F+S-1 trials and then a success on the (F+S)th trial[1] where the probability of success at any trial is P. Let this function be...

## November 11, 2004

Jeff Bilmes makes an excellent point about distributions and talking about them correctly. In particular: An exponential distribution is a continous distribution. A geometric distribution is the discrete version. A gamma distribution is a continuous distribution. A negative binomial distribution...

## October 20, 2004

There is a progression of sophistication in parameter estimation which goes as follows, from less sophisticated to more sophisticate: Maximum Likelihood: This is a point estimate of a parameter which defines an unobservable distribution. It is obtained by choosing the...

## October 19, 2004

A conjugate prior is a distribution whose aposterior estimate has the same form as the prior. This is good because it allows arbitrary numbers of updates to be made to the distribution as more data becomes available....

## July 16, 2004

From Decision-Theoretic Planning: Structural Assumptions and Computational Leverage: A classical STRIPS operator is described by a precondition and a set of effects. The former identifies the set of states in which the action can be executed, and the latter...