Tokenizer documentation fixes for ticket 2672.

Applied these changes.

The revision date should be changed from ''25 December, 2006'' to ''9 June
2010''. You could also change the webbot element from ''s-format="%d %B,
%Y"'' to ''s-format="%d %B %Y"''. The comma is superfluous in that format.



[SVN r62752]

libs/tokenizer

@@ -1 +1 @@
-Subproject commit f996d6e6c37ee9a120af6aed70a4cec563b85a90
+Subproject commit bf93977326dff75cb100735ebc3e9923b187071d