Tokenizer Members

The Tokenizer type exposes the following members.

Constructors


  Name Description
Public method Tokenizer
Initializes a new instance of the Tokenizer class.

Methods


  Name Description
Public method Equals(System.Object)
Determines whether the specified Object is equal to the current Object.
(Inherited from Object.)
Protected method Finalize
Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection.
(Inherited from Object.)
Public method GetHashCode
Serves as a hash function for a particular type.
(Inherited from Object.)
Public method GetType
Gets the Type of the current instance.
(Inherited from Object.)
Public method Matches(String)
Matcheses the specified pattern.
Public method Matches(array<String>[]()[][])
Matcheses the specified patterns.
Protected method MemberwiseClone
Creates a shallow copy of the current Object.
(Inherited from Object.)
Public method Peek
Peeks this instance.
Public method PullWhitespace
Pulls the whitespace.
Public method Take(Int32)
Takes the specified length.
Public method Take()()()()
Takes this instance.
Public method ToString
Returns a string that represents the current object.
(Inherited from Object.)

Properties


  Name Description
Public property EoF
Gets a value indicating whether [eo f].