The Python web apps throw 500s

Dagobert Michelsen via buildfarm buildfarm at lists.opencsw.org
Thu Sep 25 14:20:21 CEST 2014


Hi Maciej,

Am 25.09.2014 um 12:13 schrieb Maciej (Matchek) Bliziński via buildfarm <buildfarm at lists.opencsw.org>:
> 11:42 < lblume> automaciej: Is the REST thingie working? I've had troubles since yesterday with checkpkg
> 11:45 < automaciej> I don't know, I haven't logged in recently
> 11:45 < automaciej> show your error message
> 11:46 < automaciej> we had problems in which the web app would stop working, and you had to restart apache to fix it. but I don't know where the problem is exactly.
> 11:46 < automaciej> s/fix/mitigate/
> 11:49 < lblume> automaciej: ib.python.rest.RestCommunicationError: http://buildfarm.opencsw.org/releases/blob/elfdump/elib.python.rest.RestCommunicationError: 
>                 http://buildfarm.opencsw.org/releases/blob/elfdump/eec39f8f198b88684667bd0fe98b56ec/ - HTTP code: 500
> 12:08 < automaciej> nothing in error_log
> 12:09 < automaciej> svcadm restart cswapache2; try again
> 
> We've seen this in the past too. I can't debug this now, but it's a recurring problem, and we should try to debug this some time. It could be in Apache, or in the web app itself. But I the problem is I don't understand why we're not seeing these errors in error_log.
> 
> less /opt/csw/apache2/var/log/buildfarm.opencsw.org-error_log

There are lots of errors in there:


[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]   File "/opt/csw/lib/python2.7/site-packages/web/application.py", line 420, in _delegate
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]     return handle_class(cls)
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]   File "/opt/csw/lib/python2.7/site-packages/web/application.py", line 396, in handle_class
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]     return tocall(*args)
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]   File "/home/web/bin/gar/lib/web/releases_web.py", line 451, in PUT
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]     content_md5_sum=content_md5_sum)
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]   File "/opt/csw/lib/python2.7/site-packages/sqlobject/main.py", line 1226, in __init__
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]     self._create(id, **kw)
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]   File "/opt/csw/lib/python2.7/site-packages/sqlobject/main.py", line 1274, in _create
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]     self._SO_finishCreate(id)
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]   File "/opt/csw/lib/python2.7/site-packages/sqlobject/main.py", line 1298, in _SO_finishCreate
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]     id, names, values)
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]   File "/opt/csw/lib/python2.7/site-packages/sqlobject/dbconnection.py", line 468, in queryInsertID
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]     return self._runWithConnection(self._queryInsertID, soInstance, id, names, values)
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]   File "/opt/csw/lib/python2.7/site-packages/sqlobject/dbconnection.py", line 327, in _runWithConnection
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]     val = meth(conn, *args)
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]   File "/opt/csw/lib/python2.7/site-packages/sqlobject/mysql/mysqlconnection.py", line 155, in _queryInsertID
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]     self._executeRetry(conn, c, q)
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]   File "/opt/csw/lib/python2.7/site-packages/sqlobject/mysql/mysqlconnection.py", line 121, in _executeRetry
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176]     raise OperationalError(ErrorMessage(e))
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] OperationalError: Got a packet bigger than 'max_allowed_packet' bytes
[Thu Sep 25 14:04:52 2014] [error] [client 213.178.77.176] 
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] Traceback (most recent call last):
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]   File "/opt/csw/lib/python2.7/site-packages/web/application.py", line 239, in process
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]     return self.handle()
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]   File "/opt/csw/lib/python2.7/site-packages/web/application.py", line 230, in handle
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]     return self._delegate(fn, self.fvars, args)
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]   File "/opt/csw/lib/python2.7/site-packages/web/application.py", line 420, in _delegate
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]     return handle_class(cls)
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]   File "/opt/csw/lib/python2.7/site-packages/web/application.py", line 396, in handle_class
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]     return tocall(*args)
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]   File "/home/web/bin/gar/lib/web/releases_web.py", line 451, in PUT
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]     content_md5_sum=content_md5_sum)
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]   File "/opt/csw/lib/python2.7/site-packages/sqlobject/main.py", line 1226, in __init__
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]     self._create(id, **kw)
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]   File "/opt/csw/lib/python2.7/site-packages/sqlobject/main.py", line 1274, in _create
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]     self._SO_finishCreate(id)
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]   File "/opt/csw/lib/python2.7/site-packages/sqlobject/main.py", line 1298, in _SO_finishCreate
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]     id, names, values)
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]   File "/opt/csw/lib/python2.7/site-packages/sqlobject/dbconnection.py", line 468, in queryInsertID
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]     return self._runWithConnection(self._queryInsertID, soInstance, id, names, values)
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]   File "/opt/csw/lib/python2.7/site-packages/sqlobject/dbconnection.py", line 327, in _runWithConnection
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]     val = meth(conn, *args)
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]   File "/opt/csw/lib/python2.7/site-packages/sqlobject/mysql/mysqlconnection.py", line 155, in _queryInsertID
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]     self._executeRetry(conn, c, q)
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]   File "/opt/csw/lib/python2.7/site-packages/sqlobject/mysql/mysqlconnection.py", line 121, in _executeRetry
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176]     raise OperationalError(ErrorMessage(e))
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] OperationalError: Got a packet bigger than 'max_allowed_packet' bytes
[Thu Sep 25 14:05:03 2014] [error] [client 213.178.77.176] 
[Thu Sep 25 14:07:46 2014] [info] [client 62.210.215.117] (32)Broken pipe: core_output_filter: writing data to the network



Best regards

  — Dago

-- 
"You don't become great by trying to be great, you become great by wanting to do something,
and then doing it so hard that you become great in the process." - xkcd #896

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opencsw.org/pipermail/buildfarm/attachments/20140925/debe1037/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 2418 bytes
Desc: not available
URL: <http://lists.opencsw.org/pipermail/buildfarm/attachments/20140925/debe1037/attachment-0001.p7s>


More information about the buildfarm mailing list