CSCI 150 - Foundations of Computer Science

Fall 2013

Programming Exercises: Search Engine

Download urlDist.py.
The Sitegram class represents all of the words in a web page. You will need to:
- Complete the constructor, so that every word from the page is contained in self.hist, and
- Write the countOf() method. This method will return zero if its term is not present, and return the count if it is present.
```
>>> s = Sitegram('http://ozark.hendrix.edu/~ferrer')
>>> s.countOf('Virginia')
1
>>> s.countOf('Robotics')
2
```

The SearchData class contains Sitegrams for various URLs. You need to write the rankedPages() method. It will return a list of all pages containing the search term. The pages with the largest number of counts will appear first; the rest will appear in descending order.

>>> sd = SearchData()
>>> sd.addSite('http://ozark.hendrix.edu/~ferrer/')
>>> sd.addSite('http://ozark.hendrix.edu/~ferrer/courses/150')
>>> sd.rankedPages('hendrix')
[(8, 'http://ozark.hendrix.edu/~ferrer/'), (4, 'http://ozark.hendrix.edu/~ferrer/courses/150')]
>>> sd.rankedPages('projects')
[(1, 'http://ozark.hendrix.edu/~ferrer/courses/150')]
>>> sd.rankedPages('Virginia')
[(1, 'http://ozark.hendrix.edu/~ferrer/')]