changes the way deduplication is done, fixes bugs in group_iterator, a=chris

Author Chris Pollett <chris@pollett.org>
Author date 2010-12-29 07:Dec:th
Author local date 2010-12-28 23:Dec:th -0800
Committer Chris Pollett <chris@pollett.org>
Committer date 2010-12-29 07:Dec:th
Committer local date 2010-12-28 23:Dec:th -0800
Commit 077f9e2e8797f507ec53caf0fee7e71d580a9ee3
Tree 36fbb86bb4bc015b6572474fb06087c4b12acf2f
Parent 0e402501972dea11c9f8b8b4d461d63d05a32c26
changes the way deduplication is done, fixes bugs in group_iterator, a=chris
Affected files:
bin/fetcher.php
bin/queue_server.php
lib/crawl_constants.php
lib/index_archive_bundle.php
lib/index_bundle_iterators/group_iterator.php
lib/index_bundle_iterators/index_bundle_iterator.php
lib/index_shard.php
lib/utility.php
lib/web_archive_bundle.php
lib/web_queue_bundle.php
models/phrase_model.php
tests/index_shard_test.php
ViewGit