Changes between Version 3 and Version 4 of Swish-e
- Timestamp:
- 09/07/08 22:22:53 (16 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
Swish-e
v3 v4 19 19 email => 'tianxc@ihep.ac.cn', 20 20 base_url => 'http://dayabay.ihep.ac.cn/', 21 test_url => sub { $_[0]->path !~ /\.(?:gif|jpeg|png|gz|root)$/i }, 21 22 delay_sec => '1', 22 max_depth => '1', 23 credentials => 'username:password' 23 max_depth => 'username:password' 24 24 ); 25 25 … … 27 27 email => 'tianxc@ihep.ac.cn', 28 28 base_url => 'http://dayabay.bnl.gov/private/documents/', 29 test_url => sub { $_[0]->path !~ /\.(?:gif|jpeg|png|gz|root)$/i }, 29 30 delay_sec => '1', 30 31 max_depth => '1', … … 35 36 email => 'tianxc@ihep.ac.cn', 36 37 base_url => 'http://dayabay.ihep.ac.cn/cgi-bin/DocDB/ListBy?alldocs=1', 38 test_url => sub { $_[0]->path !~ /\.(?:gif|jpeg|png|gz|root)$/i }, 37 39 delay_sec => '1', 38 40 max_depth => '1', … … 43 45 email => 'tianxc@ihep.ac.cn', 44 46 base_url => 'http://dayabay.ihep.ac.cn/cgi-bin/EngDB/ListBy?alldocs=1', 47 test_url => sub { $_[0]->path !~ /\.(?:gif|jpeg|png|gz|root)$/i }, 45 48 delay_sec => '1', 46 49 max_depth => '1', … … 51 54 email => 'tianxc@ihep.ac.cn', 52 55 base_url => 'http://dayabay.ihep.ac.cn/internal/', 56 test_url => sub { $_[0]->path !~ /\.(?:gif|jpeg|png|gz|root)$/i }, 53 57 delay_sec => '1', 54 58 max_depth => '1', … … 59 63 email => 'tianxc@ihep.ac.cn', 60 64 base_url => 'https://wiki.bnl.gov/dayabay/index.php?title=Main_Page', 65 test_url => sub { $_[0]->path !~ /\.(?:gif|jpeg|png|gz|root)$/i }, 61 66 delay_sec => '1', 62 67 max_depth => '2', … … 66 71 email => 'tianxc@ihep.ac.cn', 67 72 base_url => 'https://wiki.bnl.gov/dayabay-private/index.php?title=Main_Page', 73 test_url => sub { $_[0]->path !~ /\.(?:gif|jpeg|png|gz|root)$/i }, 68 74 delay_sec => '1', 69 75 max_depth => '2', … … 73 79 my %repository = ( 74 80 email => 'tianxc@ihep.ac.cn', 75 base_url => 'http://dayabay.ihep.ac.cn/tracs/dybsvn/browser/', 81 base_url => 'http://dayabay.ihep.ac.cn/svn/dybsvn', 82 test_url => sub { $_[0]->path !~ /\.(?:gif|jpeg|png|gz|root|pdf|ps)$/i }, 76 83 delay_sec => '1', 77 84 max_depth => '10', … … 82 89 email => 'tianxc@ihep.ac.cn', 83 90 base_url => 'http://dayabay.ihep.ac.cn/tracs/dybsvn', 91 test_url => sub { $_[0]->path !~ /\.(?:gif|jpeg|png|gz|root)$/i }, 84 92 delay_sec => '1', 85 93 max_depth => '2', … … 123 131 124 132 == Trouble shooting == 133 * External program failed to return required headers Path-Name (Swish-e 2.4.5) 134 {{{ 135 Warning: document 'http://dayabay.ihep.ac.cn/svn/dybsvn/data/trunk/SimuAlg/output/neutron.output' has no content 136 Warning: document 'http://dayabay.ihep.ac.cn/svn/dybsvn/db/trunk/DatabaseMaintenance/dict/dict.h' has no content 137 Warning: document 'http://dayabay.ihep.ac.cn/svn/dybsvn/db/trunk/DatabaseMaintenance/dict/dict.xml' has no content 138 Warning: document 'http://dayabay.ihep.ac.cn/svn/dybsvn/db/trunk/Util/src/Singleton.cc' has no content 139 Warning: document 'http://dayabay.ihep.ac.cn/svn/dybsvn/dybgaudi/trunk/Control/DybCommon/ChangeLog' has no content 140 Warning: document 'http://dayabay.ihep.ac.cn/svn/dybsvn/gaudi/trunk/Gaudi/options/empty.opts' has no content 141 External Program found: /home/tianxc/local/lib/swish-e/spider.pl 142 143 Warning: Unknown header line: 's' from program spider.pl 144 145 Warning: Unknown header line: '//--------------------------------------------------------------' from program spider.pl 146 147 Warning: Unknown header line: 'ApplicationMgr.EvtMax = 1;' from program spider.pl 148 149 Warning: Unknown header line: 'ApplicationMgr.EvtSel = "NONE";' from program spider.pl 150 err: External program failed to return required headers Path-Name: 151 }}} 152 In spider.pl (see http://swish-e.org/archive/2007-03/11360.html), change: 125 153 {{{ 126 Warning: Unknown header line: 'h-Name: http://www.xxx.xxx/xx.htm' from program spider.pl 127 err: External program failed to return required headers Path-Name:. 154 my $bytecount = length pack 'C0a*', $$content; 128 155 }}} 129 * my $bytecount = length($$content); 130 * see http://swish-e.org/archive/2007-03/11360.html 156 to: 131 157 {{{ 132 HTTP authorization with password protected Trac/mediawiki 158 my $bytecount = length($$content); 133 159 }}} 160 161 * HTTP authorization with password protected Trac/mediawiki 162
