The search functionality is under construction.

Keyword Search Result

[Keyword] noisy learning(1hit)

1-1hit
  • Learning Curves in Learning with NoiseAn Empirical Study

    Hanzhong GU  Haruhisa TAKAHASHI  

     
    PAPER-Bio-Cybernetics and Neurocomputing

      Vol:
    E80-D No:1
      Page(s):
    78-85

    In this paper, we apply the method of relating learning to hypothesis testing [6] to study average generalization performance of concept learning from noisy random training examples. A striking aspect of the method is that a learning problem with a so-called ill-disposed learning algorithm can equivalently be reduced to a simple one, and for this simple problem, even though a direct and exact calculation of the learning curves might still be impossible, a thorough empirical study can easily be performed. One of the main advantages of using the illdisposed algorithm is that it well models lower quality learning in real situations, and hence the result can provide useful implications as far as reliable generalization is concerned. We provide empirical formulas for the learning curves by simple functions of the noise rate and the sample size from a thorough empirical study, which smoothly incorporates the results from noise-free analysis and are quite accurate and adequate for practical applications when the noise rate is relatively small. The resulting learning curve bounds are directly related to the number of system weights and are not pessimistic in practice, and apply to learning settings not necessarily within the Bayesian framework.