Project 6 grade report and readme

Group 1 - Janos, Junwen, Saajan - time estimates

last updated: 08/14/2006< /font>    

Overview   |   Test Set 1    |    Test Set 2    |    Test Set 3   |   Test Set 4

This scraper is quite elaborate; it exhibits excellent performance and contains a number of extra features which work well.  The layout would have benefited from more testing--the grid and searched-URL list are too small and do not stretch when the form is resized (this is an "anchoring" issue).  After a scrape, the file location could not be copied into the clipboard; it was also too short.  And results did not clear when I changed the semester (I could then no longer verify which semester's results I was viewing).   See below for more GUI details.

The scraper can run multiple copies of itself simultaneously.  This is ill-advised--there is ample chance that multiple scrapers running at once will encounter conflicts with file and database I/O.

Grade: 95  - Please see the individual test sets for details about points lost and extra credit given.



 Click to enlarge   Click to enlarge  url
 
The above message occurs with a Url missing the last /.  This message is too long, and it is unclear whether reattempting serves any purpose.  After 3 attempts, it says:
 
It's good that it referred me to the log file (though, how am I supposed to know where that is?).  But when I tracked it down, the log wasn't helpful after all.  The exception was ToString() dumped there without recording which Url had failed, and the trace of information there was not very helpful to the problem.  This could have been made more useful with additional testing and attention.
Click to enlarge
The above shows what happened when the network was disconnected during a scrape.  It's seems to be identical to what happened when it got a bad URL (see upper right).  I believe these conditions could have been distinguished.

 


Visitors: Hit Counter