 | | | Problem with OCFS | Problem with OCFS 2006-09-25 - By Tobias Axelsson
Back
Hi
We encounter some error messages from three SLES-9 (See http://LES-9.ora-code.com)-SP-3-servers that running
oracle clusterfilesystem. We need to know if they are critical, if we
should continue to use this in a production environment or if we should
wait.
Here are some logs:
We got the errormessage two times from around 13 yesterdays:
Sep 24 13:06:40 priamus kernel: (10300,2):ocfs2_file_sendfile:371 ERROR:
status = -32
Sep 24 21:52:51 priamus kernel: (9684,2):ocfs2_file_sendfile:371 ERROR:
status = -32
Sep 25 08:13:27 priamus kernel: (12191,2):ocfs2_file_sendfile:371 ERROR:
status = -32
Before that it occured alot:
Sep 24 12:05:47 priamus kernel: (9599,2):ocfs2_file_sendfile:371 ERROR:
status = -32
Sep 24 12:07:21 priamus kernel: (9635,2):ocfs2_file_sendfile:371 ERROR:
status = -32
Sep 24 12:08:42 priamus kernel: (9648,2):ocfs2_file_sendfile:371 ERROR:
status = -32
Sep 24 12:09:17 priamus kernel: (9635,2):ocfs2_file_sendfile:371 ERROR:
status = -32
Sep 24 12:10:48 priamus kernel: (9649,2):ocfs2_file_sendfile:371 ERROR:
status = -32
Sep 24 12:11:11 priamus kernel: (9646,2):ocfs2_file_sendfile:371 ERROR:
status = -32
Sep 24 12:18:43 priamus kernel: (9652,2):ocfs2_file_sendfile:371 ERROR:
status = -32
Sep 24 12:21:06 priamus kernel: (9599,2):ocfs2_file_sendfile:371 ERROR:
status = -104
Sep 24 12:27:32 priamus kernel: (9605,2):ocfs2_file_sendfile:371 ERROR:
status = -32
Sep 24 12:27:33 priamus kernel: (9684,2):ocfs2_file_sendfile:371 ERROR:
status = -32
Sep 24 12:29:10 priamus kernel: (9651,2):ocfs2_file_sendfile:371 ERROR:
status = -104
Sep 24 12:29:11 priamus kernel: (9652,2):ocfs2_file_sendfile:371 ERROR:
status = -32
Sep 24 12:43:18 priamus kernel: (10244,2):ocfs2_file_sendfile:371 ERROR:
status = -32
Sep 24 12:58:36 priamus kernel: (10302,2):ocfs2_file_sendfile:371 ERROR:
status = -32
Sep 24 13:00:29 priamus kernel: (10242,2):ocfs2_file_sendfile:371 ERROR:
status = -32
Sep 24 13:02:18 priamus kernel: (10301,2):ocfs2_file_sendfile:371 ERROR:
status = -32
We have'nt that much load today, here are the accesslogs from today,
around the errormessage 08:13:
81.185.96.249 - - [25/Sep/2006:08:13:22 +0200] "GET /scripts/sp-vxu.js
HTTP/1.1" 304 - "http://www.student.vxu.se/" "Mozilla/4.0 (compatible;
MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:24 +0200] "GET /student.css
HTTP/1.1" 304 - "http://www.student.vxu.se/" "Mozilla/4.0 (compatible;
MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:26 +0200] "GET
/images/shadowLeft.gif HTTP/1.1" 200 815 "http://www.student.vxu.se/"
"Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:26 +0200] "GET /linje.gif HTTP/1.1"
200 283 "http://www.student.vxu.se/" "Mozilla/4.0 (compatible; MSIE 6.0;
Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:26 +0200] "GET
/images/triangleBottomRightOut.gif HTTP/1.1" 200 116
"http://www.student.vxu.se/" "Mozilla/4.0 (compatible; MSIE 6.0; Windows
NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:26 +0200] "GET
/images/borderGrey.gif HTTP/1.1" 200 12839 "http://www.student.vxu.se/"
"Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:27 +0200] "GET
/images/shadowRight.gif HTTP/1.1" 200 815 "http://www.student.vxu.se/"
"Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:27 +0200] "GET /images/printer.jpg
HTTP/1.1" 200 5586 "http://www.student.vxu.se/" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:38 +0200] "POST
/minasidor/login.jsp HTTP/1.1" 302 - "http://www.student.vxu.se/"
"Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
194.47.65.180 - - [25/Sep/2006:08:13:41 +0200] "GET / HTTP/1.0" 200
25616 "-" "check_http/1.81 (nagios-plugins 1.4.2)"
81.185.96.249 - - [25/Sep/2006:08:13:40 +0200] "GET /minasidor/main.jsp
HTTP/1.1" 200 26514 "http://www.student.vxu.se/" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:45 +0200] "GET
/scripts/overlib/overlib.js HTTP/1.1" 304 -
"https://www.student.vxu.se/minasidor/main.jsp" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:46 +0200] "GET
/minasidor/student.css HTTP/1.1" 304 -
"https://www.student.vxu.se/minasidor/main.jsp" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:46 +0200] "GET
/images/fillBackground.gif HTTP/1.1" 304 -
"https://www.student.vxu.se/minasidor/main.jsp" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:46 +0200] "GET
/minasidor/images/border.gif HTTP/1.1" 304 -
"https://www.student.vxu.se/minasidor/main.jsp" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:46 +0200] "GET
/minasidor/images/logotypeVXU.gif HTTP/1.1" 304 -
"https://www.student.vxu.se/minasidor/main.jsp" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:47 +0200] "GET
/images/menuBackground.gif HTTP/1.1" 304 -
"https://www.student.vxu.se/minasidor/main.jsp" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:47 +0200] "GET
/images/arrowGrey.gif HTTP/1.1" 304 -
"https://www.student.vxu.se/minasidor/main.jsp" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:47 +0200] "GET
/images/arrowPurple.gif HTTP/1.1" 304 -
"https://www.student.vxu.se/minasidor/main.jsp" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:47 +0200] "GET
/images/arrowBlue.gif HTTP/1.1" 304 -
"https://www.student.vxu.se/minasidor/main.jsp" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:48 +0200] "GET
/images/arrowCyan.gif HTTP/1.1" 304 -
"https://www.student.vxu.se/minasidor/main.jsp" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:48 +0200] "GET
/images/arrowGreen.gif HTTP/1.1" 304 -
"https://www.student.vxu.se/minasidor/main.jsp" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:48 +0200] "GET
/images/arrowBrown.gif HTTP/1.1" 304 -
"https://www.student.vxu.se/minasidor/main.jsp" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:48 +0200] "GET /images/arrowRed.gif
HTTP/1.1" 304 - "https://www.student.vxu.se/minasidor/main.jsp"
"Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:49 +0200] "GET
/minasidor/images/triangleBottomRightLeftMenu.gif HTTP/1.1" 304 -
"https://www.student.vxu.se/minasidor/main.jsp" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:49 +0200] "GET
/alumni/images/alumni_logo-minasidor.gif HTTP/1.1" 304 -
"https://www.student.vxu.se/minasidor/main.jsp" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:49 +0200] "GET
/images/shadowLeft.gif HTTP/1.1" 304 -
"https://www.student.vxu.se/minasidor/main.jsp" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:49 +0200] "GET /images/blackdot.gif
HTTP/1.1" 304 - "https://www.student.vxu.se/minasidor/main.jsp"
"Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:50 +0200] "GET
/minasidor/images/borderBlue.gif HTTP/1.1" 304 -
"https://www.student.vxu.se/minasidor/main.jsp" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:50 +0200] "GET /images/printer.jpg
HTTP/1.1" 304 - "https://www.student.vxu.se/minasidor/main.jsp"
"Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:50 +0200] "GET
/images/triangleBottomRightIn.gif HTTP/1.1" 304 -
"https://www.student.vxu.se/minasidor/main.jsp" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
81.185.96.249 - - [25/Sep/2006:08:13:50 +0200] "GET
/images/shadowRight.gif HTTP/1.1" 304 -
"https://www.student.vxu.se/minasidor/main.jsp" "Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.0; InfoPath.1)"
At this point we have no write to the filesystem, only read, as a saftey
prec. to see that everything worked before starting all features...
The hardware are three LS20 AMD64 IBM bladeservers.
Some more info...
<+> cat /etc/ocfs2/cluster.conf
node:
ip_port = 7777
ip_address = 10.0.1.190
number = 0
name = priamus
cluster = ocfs2
node:
ip_port = 7777
ip_address = 10.0.1.191
number = 1
name = hektor
cluster = ocfs2
node:
ip_port = 7777
ip_address = 10.0.1.192
number = 2
name = paris
cluster = ocfs2
cluster:
node_count = 3
name = ocfs2
Version OCFS2 ?r 1.2.1 (senaste recommended enligt online update).
Version information:
Server version: Apache/2.0.49
Server built: Sep 4 2006 14:51:27
ocfs2-tools-1 (See http://ols-1.ora-code.com).2.1-4.2
ocfs2console-1 (See http://ole-1.ora-code.com).2.1-4.2
apache2-prefork-2 (See http://ork-2.ora-code.com).0.49-27.59
apache2-2.0.49-27.59
The problem is possible to reproduce when some "heavy" load is put at
the Apache server. For three seconds, using two concurrent connections,
I've managed to complete 2544 hits.
Transactions: 2544 hits
Data transferred: 239.95 MB
Response time: 0.00 secs
Transaction rate: 726.86 trans/sec
Throughput: 68.56 MB/sec
Concurrency: 1.98
Using the Apache-setting "EnableSendfile off" seems to solve the
problem, because it is not possible to reproduce even with higher load.
It seems to be a bit slower though, with both "EnableSendfile"
and "EnableMMAP" turned "off" the result is:
Transactions: 2317 hits
Data transferred: 216.07 MB
Response time: 0.00 secs
Transaction rate: 728.62 trans/sec
Throughput: 67.95 MB/sec
Concurrency: 1.98
The small effect of performance is obviously not a problem.
Have anyone else experience this problem. Seems som come on heavy load
when you access more than one file...
Thanks for your time
Tobias
Vaxjo university
Sweden
--
To unsubscribe, email: suse-oracle-unsubscribe@(protected)
For additional commands, email: suse-oracle-help@(protected)
Please see http://www.suse.com/oracle/ before posting
|
|
|