Some clarifications based on things brought up in class. Plus other stuff...

• To make it easier to grade the projects, let's use the same compiler. Use g++-3.2 with the -Wall option. This compiler was just installed a few weeks ago, and I want to see how it's doing.

  This is one of the latest versions of g++, and it now enforces namespaces. If you need to read about that in the CMSC 214 Tutorial located here.

• You should match double quotes with the next occurring double quotes that is not backslashed.
• You should match single quotes with the next occurring single quotes that is not backslashed.
• Process the string left to right. If the first non-backslashed quote is a double quote, then you look for the next matching double quote.
• Do NOT strip off the double quotes, nor the single quotes during a getLeftToken() operation. (The reason is rather technical).
• Handle the following escape sequences: \n, \', \", \\. Also, handle backslash followed by the delimiter. Thus, if the delimiter is : then \: is not meant to be a real delimiter.
• You may assume ',",\n, \ are NOT delimiters (nor their backslashed version).
• Yes, you have to handle spaces as delimiters.
• You need to CONVERT \n to the actual newline character, \\ to a single backslash, \' to single quote, \" to double quote, and backslash followed by a delimiter to a delimiter.
• The easiest way to test for these strings is to create a text file, and read in a line at a time.

  Here's sample code for how to do this.

  using namespace std ;
  int main()
  {
     string line ;
     while ( getline( cin, line ) )
       {
          // split line based on some delimiter, then print out
          // each token on a separate line, surrounded by slashes.
          // For example, if the line contained "cat, dog  , elk ",
          // print
          //   (1) /cat/
          //   (2) /dog/
          //   (3) /elk/
       }
  }
  

  That will give you some indication if your tokenizer is working.
• Work on easy stuff first, then worry about complicated stuff later. You don't need to get EVERYTHING to work to submit (though certainly, you get more credit). If you worried about time, get the basics to work (such as splitting by spaces and commas, and handling \n).

See the class syllabus for policies concerning email Last Modified: Wed Jun 5 10:38:37 EDT 2002

Web Accessibility