-
Notifications
You must be signed in to change notification settings - Fork 3
/
errors.log
134 lines (121 loc) · 10.5 KB
/
errors.log
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
# This is a curated list of errors I have seen while going hog-wild with crawling.
### Error 1!
[crawler@apollo amzn-scraper]$ ./spider.rb config.yaml
/usr/lib/ruby/1.9/uri/common.rb:130: [BUG] Segmentation fault
ruby 1.9.2p0 (2010-08-18) [i386-linux]
-- control frame ----------
c:0022 p:---- s:0100 b:0100 l:000099 d:000099 CFUNC :===
c:0021 p:0050 s:0096 b:0095 l:000094 d:000094 METHOD /usr/lib/ruby/1.9/uri/common.rb:130
c:0020 p:0013 s:0079 b:0079 l:000078 d:000078 METHOD /usr/lib/ruby/1.9/uri/common.rb:174
c:0019 p:0019 s:0066 b:0066 l:000065 d:000065 METHOD /usr/lib/ruby/1.9/uri/common.rb:628
c:0018 p:0042 s:0062 b:0062 l:000061 d:000061 METHOD /home/crawler/amzn-scraper/gems/ruby/1.9/bundler/gems/mechanize-328d4a58ab5e/lib/mechanize/page/link.rb:39
c:0017 p:0046 s:0059 b:0058 l:000047 d:000057 BLOCK /home/crawler/amzn-scraper/amazon/tasks/extract_asin.rb:11
c:0016 p:---- s:0053 b:0053 l:000052 d:000052 FINISH
c:0015 p:---- s:0051 b:0051 l:000050 d:000050 CFUNC :each
c:0014 p:0026 s:0048 b:0048 l:000047 d:000047 METHOD /home/crawler/amzn-scraper/amazon/tasks/extract_asin.rb:9
c:0013 p:0025 s:0041 b:0041 l:00124c d:000040 BLOCK ./spider.rb:81
c:0012 p:---- s:0038 b:0038 l:000037 d:000037 FINISH
c:0011 p:---- s:0036 b:0036 l:000035 d:000035 CFUNC :collect
c:0010 p:0023 s:0033 b:0033 l:00124c d:000032 BLOCK ./spider.rb:81
c:0009 p:---- s:0027 b:0027 l:000026 d:000026 FINISH
c:0008 p:---- s:0025 b:0025 l:000024 d:000024 CFUNC :call
c:0007 p:0017 s:0020 b:0020 l:000010 d:000019 BLOCK /home/crawler/amzn-scraper/spider/worker.rb:58
c:0006 p:---- s:0016 b:0016 l:000015 d:000015 FINISH
c:0005 p:---- s:0014 b:0014 l:000013 d:000013 CFUNC :each
c:0004 p:0013 s:0011 b:0011 l:000010 d:000010 METHOD /home/crawler/amzn-scraper/spider/worker.rb:56
c:0003 p:0052 s:0007 b:0007 l:0011a4 d:000006 BLOCK /home/crawler/amzn-scraper/spider/worker.rb:50
c:0002 p:---- s:0004 b:0004 l:000003 d:000003 FINISH
c:0001 p:---- s:0002 b:0002 l:000001 d:000001 TOP
---------------------------
-- Ruby level backtrace information ----------------------------------------
/home/crawler/amzn-scraper/spider/worker.rb:50:in `block in spawn'
/home/crawler/amzn-scraper/spider/worker.rb:56:in `work'
/home/crawler/amzn-scraper/spider/worker.rb:56:in `each'
/home/crawler/amzn-scraper/spider/worker.rb:58:in `block in work'
/home/crawler/amzn-scraper/spider/worker.rb:58:in `call'
./spider.rb:81:in `block (3 levels) in <main>'
./spider.rb:81:in `collect'
./spider.rb:81:in `block (4 levels) in <main>'
/home/crawler/amzn-scraper/amazon/tasks/extract_asin.rb:9:in `extract'
/home/crawler/amzn-scraper/amazon/tasks/extract_asin.rb:9:in `each'
/home/crawler/amzn-scraper/amazon/tasks/extract_asin.rb:11:in `block in extract'
/home/crawler/amzn-scraper/gems/ruby/1.9/bundler/gems/mechanize-328d4a58ab5e/lib/mechanize/page/link.rb:39:in `uri'
/usr/lib/ruby/1.9/uri/common.rb:628:in `parse'
/usr/lib/ruby/1.9/uri/common.rb:174:in `parse'
/usr/lib/ruby/1.9/uri/common.rb:130:in `split'
/usr/lib/ruby/1.9/uri/common.rb:130:in `==='
-- C level backtrace information -------------------------------------------
[NOTE]
You may have encountered a bug in the Ruby interpreter or extension libraries.
Bug reports are welcome.
For details: http://www.ruby-lang.org/bugreport.html
Aborted
[crawler@apollo amzn-scraper]$
### Error 2!
/home/crawler/amzn-scraper/gems/ruby/1.9/gems/nokogiri-1.4.4/lib/nokogiri/html/document.rb:84:in `read_memory': failed to allocate memory (NoMemoryError)
from /home/crawler/amzn-scraper/gems/ruby/1.9/gems/nokogiri-1.4.4/lib/nokogiri/html/document.rb:84:in `parse'
from /home/crawler/amzn-scraper/gems/ruby/1.9/gems/nokogiri-1.4.4/lib/nokogiri/html.rb:22:in `parse'
from /home/crawler/amzn-scraper/gems/ruby/1.9/bundler/gems/mechanize-328d4a58ab5e/lib/mechanize/page.rb:91:in `parser'
from /home/crawler/amzn-scraper/gems/ruby/1.9/bundler/gems/mechanize-328d4a58ab5e/lib/mechanize/page.rb:54:in `title'
from ./spider.rb:58:in `block (3 levels) in <main>'
from /home/crawler/amzn-scraper/spider/worker.rb:49:in `call'
from /home/crawler/amzn-scraper/spider/worker.rb:49:in `block in spawn'
#### Error 3!
Rubinius Crash Report #rbxcrashreport
Error: signal SIGSEGV
[[Backtrace]]
0 ruby 0x0000000100021f20 _ZN8rubiniusL12segv_handlerEi + 160
1 libSystem.B.dylib 0x00007fff87f4166a _sigtramp + 26
2 ??? 0x000000010700bf90 0x0 + 4412456848
3 ruby 0x000000010011b8c4 _ZN8rubinius16BlockEnvironment4callEPNS_2VMEPNS_9CallFrameERNS_9ArgumentsEi + 68
4 ruby 0x000000010003926f _ZN8rubinius8VMMethod11interpreterEPNS_2VMEPS0_PNS_20InterpreterCallFrameE + 19007
5 ruby 0x000000010011b6b0 _ZN8rubinius16BlockEnvironment19execute_interpreterEPNS_2VMEPNS_9CallFrameEPS0_RNS_9ArgumentsERNS_15BlockInvocationE + 736
6 ruby 0x000000010011b8c4 _ZN8rubinius16BlockEnvironment4callEPNS_2VMEPNS_9CallFrameERNS_9ArgumentsEi + 68
7 ruby 0x000000010021890b rbx_yield_stack + 235
8 ??? 0x0000000102cace11 0x0 + 4341812753
9 ??? 0x0000000102caca3e 0x0 + 4341811774
10 ruby 0x00000001000379c1 _ZN8rubinius8VMMethod11interpreterEPNS_2VMEPS0_PNS_20InterpreterCallFrameE + 12689
11 ruby 0x0000000100114fe6 _ZN8rubinius8VMMethod19execute_specializedINS_11NoArgumentsEEEPNS_6ObjectEPNS_2VMEPNS_9CallFrameERNS_8DispatchERNS_9ArgumentsE + 822
12 ruby 0x0000000100141591 _ZN8rubinius6Object9send_primEPNS_2VMEPNS_10ExecutableEPNS_9CallFrameERNS_8DispatchERNS_9ArgumentsE + 257
13 ruby 0x00000001000b5dfb _ZN8rubinius10Primitives11object_sendEPNS_2VMEPNS_9CallFrameERNS_8DispatchERNS_9ArgumentsE + 123
14 ruby 0x00000001000219e2 _ZN8rubinius8Dispatch4sendEPNS_2VMEPNS_9CallFrameERNS_9ArgumentsENS_19MethodMissingReasonE + 50
15 ruby 0x0000000100217708 rbx_splat_send + 152
16 ??? 0x0000000102ca34b8 0x0 + 4341773496
17 ruby 0x000000010011b8c4 _ZN8rubinius16BlockEnvironment4callEPNS_2VMEPNS_9CallFrameERNS_9ArgumentsEi + 68
18 ruby 0x000000010021890b rbx_yield_stack + 235
19 ??? 0x0000000102c92498 0x0 + 4341703832
20 ruby 0x000000010011b8c4 _ZN8rubinius16BlockEnvironment4callEPNS_2VMEPNS_9CallFrameERNS_9ArgumentsEi + 68
21 ruby 0x000000010021890b rbx_yield_stack + 235
22 ??? 0x0000000102c48e00 0x0 + 4341403136
23 ruby 0x0000000100037bf7 _ZN8rubinius8VMMethod11interpreterEPNS_2VMEPS0_PNS_20InterpreterCallFrameE + 13255
24 ruby 0x0000000100114c7f _ZN8rubinius8VMMethod19execute_specializedINS_17SplatOnlyArgumentEEEPNS_6ObjectEPNS_2VMEPNS_9CallFrameERNS_8DispatchERNS_9ArgumentsE + 911
25 ruby 0x00000001000379c1 _ZN8rubinius8VMMethod11interpreterEPNS_2VMEPS0_PNS_20InterpreterCallFrameE + 12689
26 ruby 0x000000010011558e _ZN8rubinius8VMMethod19execute_specializedINS_16GenericArgumentsEEEPNS_6ObjectEPNS_2VMEPNS_9CallFrameERNS_8DispatchERNS_9ArgumentsE + 1358
27 ruby 0x0000000100037aa0 _ZN8rubinius8VMMethod11interpreterEPNS_2VMEPS0_PNS_20InterpreterCallFrameE + 12912
28 ruby 0x0000000100114fe6 _ZN8rubinius8VMMethod19execute_specializedINS_11NoArgumentsEEEPNS_6ObjectEPNS_2VMEPNS_9CallFrameERNS_8DispatchERNS_9ArgumentsE + 822
29 ruby 0x00000001000364eb _ZN8rubinius8VMMethod11interpreterEPNS_2VMEPS0_PNS_20InterpreterCallFrameE + 7355
30 ruby 0x0000000100114fe6 _ZN8rubinius8VMMethod19execute_specializedINS_11NoArgumentsEEEPNS_6ObjectEPNS_2VMEPNS_9CallFrameERNS_8DispatchERNS_9ArgumentsE + 822
31 ruby 0x0000000100037aa0 _ZN8rubinius8VMMethod11interpreterEPNS_2VMEPS0_PNS_20InterpreterCallFrameE + 12912
32 ruby 0x000000010011b6b0 _ZN8rubinius16BlockEnvironment19execute_interpreterEPNS_2VMEPNS_9CallFrameEPS0_RNS_9ArgumentsERNS_15BlockInvocationE + 736
33 ruby 0x000000010011b8c4 _ZN8rubinius16BlockEnvironment4callEPNS_2VMEPNS_9CallFrameERNS_9ArgumentsEi + 68
34 ruby 0x000000010016e585 _ZN8rubinius4Proc9call_primEPNS_2VMEPNS_10ExecutableEPNS_9CallFrameERNS_8DispatchERNS_9ArgumentsE + 469
35 ruby 0x00000001000ac493 _ZN8rubinius10Primitives9proc_callEPNS_2VMEPNS_9CallFrameERNS_8DispatchERNS_9ArgumentsE + 195
36 ruby 0x0000000100037aa0 _ZN8rubinius8VMMethod11interpreterEPNS_2VMEPS0_PNS_20InterpreterCallFrameE + 12912
37 ruby 0x000000010011b6b0 _ZN8rubinius16BlockEnvironment19execute_interpreterEPNS_2VMEPNS_9CallFrameEPS0_RNS_9ArgumentsERNS_15BlockInvocationE + 736
38 ruby 0x000000010011b8c4 _ZN8rubinius16BlockEnvironment4callEPNS_2VMEPNS_9CallFrameERNS_9ArgumentsEi + 68
39 ruby 0x000000010016e585 _ZN8rubinius4Proc9call_primEPNS_2VMEPNS_10ExecutableEPNS_9CallFrameERNS_8DispatchERNS_9ArgumentsE + 469
40 ruby 0x00000001000ac493 _ZN8rubinius10Primitives9proc_callEPNS_2VMEPNS_9CallFrameERNS_8DispatchERNS_9ArgumentsE + 195
41 ruby 0x0000000100037bf7 _ZN8rubinius8VMMethod11interpreterEPNS_2VMEPS0_PNS_20InterpreterCallFrameE + 13255
42 ruby 0x0000000100114fe6 _ZN8rubinius8VMMethod19execute_specializedINS_11NoArgumentsEEEPNS_6ObjectEPNS_2VMEPNS_9CallFrameERNS_8DispatchERNS_9ArgumentsE + 822
43 ruby 0x0000000100141680 _ZN8rubinius6Object4sendEPNS_2VMEPNS_9CallFrameEPNS_6SymbolEb + 112
44 ruby 0x00000001000475ee _ZN8rubinius12NativeThread7performEv + 174
45 ruby 0x0000000100025492 _ZN6thread6Thread10trampolineEPv + 18
46 libSystem.B.dylib 0x00007fff87f1a4f6 _pthread_start + 331
47 libSystem.B.dylib 0x00007fff87f1a3a9 thread_start + 13
[[System Info]]
sysname: Darwin
nodename: one
release: 10.7.0
version: Darwin Kernel Version 10.7.0: Sat Jan 29 15:17:16 PST 2011; root:xnu-1504.9.37~1/RELEASE_I386
machine: i386
### Error 4!