tokenizer.h File Reference

#include <cassert>
#include <string>
#include <vector>
#include <iostream>
#include <list>
#include <algorithm>
#include <stringspace.h>

Include dependency graph for tokenizer.h:

This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Classes
class	tokenizermisc
	Miscellaneous functions which support or use the tokenizer. More...
class	tokenizer
	Primitive parser with state. More...
Typedefs
typedef list< string >::iterator	liststringi
typedef list< string > ::const_iterator	liststringic
Functions
ostream &	operator<< (ostream &os, tokenizer const &ss)
	Print the tokenizers list of strings.

---

Typedef Documentation

typedef list<string>::iterator liststringi

Definition at line 14 of file tokenizer.h.

typedef list<string>::const_iterator liststringic

Definition at line 15 of file tokenizer.h.

---

Function Documentation

ostream& operator<<	(	ostream &	os,
		tokenizer const &	ss
	)

Print the tokenizers list of strings.

The tokenizer ss can have its printdelimiter configured before printing.

Definition at line 447 of file tokenizer.cpp.

References tokenizer::print().

{
  return ss.print(os);
}