This paper presents a hypermedia English learning environment, called HELEN (Hypermedia Environment for Learning ENglish), which integrates traditional methods of learning English, audio-visual facilities for both listening and watching and intelligent tutoring functions for suitable advice to each learner based on natural language understanding. HELEN consists of an authoring stage and a learning stage. In order to support multimodal learning, at the authoring stage HELEN gets voice and video scenes from a video disc and text sentences from an image scanner, then analyzes the sentences both syntactically and semantically by a natural language processing module so that necessary information for conversation, error identification and example sentence retrieval may be extracted. Thus at the learning stage, HELEN is able to aid learners to learn hearing, reading, writing, watching, consulting and noting. Besides these facilities HELEN also supports two facilities for tests in English: One is the test facilities of dictating sentences and the other is QA (questions and answers) facilities to make learner's comprehension state clear. According to the results of these tests, HELEN identifies learner's illegal usage of syntax or semantics, and piles them in a student model. The illegal usage in the model is used as resources for generating questions, treating errors, determining topics, etc. The main part of this paper concerns with the representation method for syntax and semantics of correct and incorrect sentences.