[csw-devel] SF.net SVN: opencsw:[389] utilities/mirror_check.py

[wahwah at users.sourceforge.net]

Revision: 389
          http://opencsw.svn.sourceforge.net/opencsw/?rev=389&view=rev
Author:   wahwah
Date:     2011-07-12 13:25:25 +0000 (Tue, 12 Jul 2011)

Log Message:
-----------
mirror_check: Better skipping of non-mirror URLs

Modified Paths:
--------------
    utilities/mirror_check.py

Modified: utilities/mirror_check.py
===================================================================
--- utilities/mirror_check.py	2011-07-12 13:25:13 UTC (rev 388)
+++ utilities/mirror_check.py	2011-07-12 13:25:25 UTC (rev 389)
@@ -104,13 +104,18 @@
                 except urllib2.URLError:
                     result = URL_NOTFOUND
                 finally:
-                    logging.debug("Calling back to report '%s' with '%s'" % (result, self.url))
+                    logging.debug("Calling back to report '%s' with '%s'"
+                                  % (result, self.url))
                     self.callback(self.url, result)
 
         url_fetchers = []
         logging.info("Spawning fetchers.")
         for url in urls:
-            if url in NOCHECK_URLS:
+            skip = False
+            for nocheck_url in NOCHECK_URLS:
+                if url.startswith(nocheck_url):
+                    skip = 1
+            if skip:
                 continue
             t = UrlIdentifier(url, self.CollectData)
             t.start()


This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.